00010000:00000010:1.1F:1713480634.532182:0:27:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800b431fa00. 00010000:00000010:1.1:1713480634.532191:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff88008c32c000. 00010000:00000010:1.1:1713480634.562201:0:27:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff88007e0eb400. 00010000:00000010:1.1:1713480634.562207:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff880136af0900. 00010000:00000010:1.1:1713480634.562210:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff88008c32c900. 00010000:00000010:1.1:1713480634.568196:0:11:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800b422ec00. 00010000:00000010:1.1:1713480634.568201:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800804ec6c0. 00080000:00000010:1.1:1713480634.577195:0:11:0:(osd_handler.c:1615:osd_oxc_free()) kfreed 'oxe': 68 at ffff88012d2c83c0. 00010000:00010000:3.0:1713481296.469973:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.469989:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078199f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784430912:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.470009:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.470026:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784431360:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.470051:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470099:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470104:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470109:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470113:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470116:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470139:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e084900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.470141:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470146:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470158:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470161:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e084900/0xdfc0fb148a36df9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa85a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.470283:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2550:3492:x1796714784430144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5941us (5987us total) trans 4295960484 rc 0/0 00000100:00100000:3.0:1713481296.470288:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561724 00000100:00100000:3.0:1713481296.470321:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784431936:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.470339:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.470363:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079a95880/2, rc 0, transno 993188 00000100:00100000:3.0:1713481296.470369:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784430144:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.470390:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882347904 00000100:00100000:3.0:1713481296.470392:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882347904 00010000:00010000:3.0:1713481296.470403:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918c86c0/0xdfc0fb148801fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2671:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9623d4 expref: 25590 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.470419:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819825 00000100:00100000:3.0:1713481296.470422:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25590:1959:x1796714882347904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.470429:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.470432:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918c86c0/0xdfc0fb148801fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9623d4 expref: 25590 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.470438:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918c86c0/0xdfc0fb148801fc5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9623d4 expref: 25589 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.470450:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918c86c0/0xdfc0fb148801fc5 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9623d4 expref: 25588 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.470460:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.470461:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.470463:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470468:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470480:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.470493:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25587:1959:x1796714882347904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.470499:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819825 00010000:00010000:3.0:1713481296.470584:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470590:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470598:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470603:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470607:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470611:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008fd45d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.470614:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470620:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470632:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470640:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd45d40/0xdfc0fb148a36df2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.470789:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+3830:3493:x1796714784430080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6578us (6621us total) trans 4296040667 rc 0/0 00000100:00100000:3.0:1713481296.470796:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561723 00000100:00100000:3.0:1713481296.470833:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784432896:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.470865:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.470900:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800784c0000/2, rc 0, transno 993189 00000100:00100000:3.0:1713481296.470906:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800784c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784430656:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.470919:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a290e00/2, rc 0, transno 1073371 00000100:00100000:3.0:1713481296.470927:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784430080:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.470936:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.470943:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007731ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784432832:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.470965:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.470993:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.470998:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471003:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471007:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471012:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471015:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e3ef840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.471017:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471024:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471034:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471038:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e3ef840/0xdfc0fb148a36e31 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.471080:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084820700/2, rc 0, transno 1073372 00000100:00100000:3.0:1713481296.471087:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784431552:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.471101:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561752 00000100:00100000:3.0:1713481296.471105:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2554:3493:x1796714784433216:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.471115:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43109 count 1 00010000:00010000:3.0:1713481296.471142:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471153:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd89b00/0xdfc0fb148688257 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2082 expref: 26719 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.471159:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.471160:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.471163:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471180:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd89b00/0xdfc0fb148688257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2082 expref: 26719 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.471190:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd89b00/0xdfc0fb148688257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2082 expref: 26719 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.471201:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800755a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784433600:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.471219:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801329bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.471234:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784433536 00000100:00100000:3.0:1713481296.471237:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784433536 00000100:00100000:3.0:1713481296.471257:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561753 00000100:00100000:3.0:1713481296.471262:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+3831:3491:x1796714784433536:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.471273:0:16460:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9850 count 1 00010000:00010000:3.0:1713481296.471283:0:16460:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095e48900/0xdfc0fb148a36f26 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x267a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471294:0:16460:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ffff600/0xdfc0fb148802004 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x267a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962452 expref: 25584 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.471300:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.471302:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.471304:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095e48900/0xdfc0fb148a36f26 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x267a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471320:0:16460:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007ffff600/0xdfc0fb148802004 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x267a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962452 expref: 25584 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.471330:0:16460:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007ffff600/0xdfc0fb148802004 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x267a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962452 expref: 25584 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.471346:0:16460:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800755a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16460:1796714784433664:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.471359:0:16460:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007aba30c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.471766:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471772:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471777:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471780:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471785:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471788:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e3edf80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.471790:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471794:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471805:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471812:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e3edf80/0xdfc0fb148a36e1c lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471882:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471890:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471897:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471902:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471905:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471909:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e086640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.471910:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471914:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 5/0,0 mode: PW/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471922:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.471927:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e086640/0xdfc0fb148a36e0e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.472035:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472340:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472476:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472524:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472555:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472567:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472578:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472594:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472607:0:15512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882349376 00000100:00100000:3.0:1713481296.472610:0:15512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882349376 00000100:00100000:3.0:1713481296.472627:0:15512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26089 00000100:00100000:3.0:1713481296.472631:0:15512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2382:18679:x1796714882349376:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.472652:0:15512:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.472664:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a12fa80/0xdfc0fb148a2f571 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42e77 expref: 2382 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.472694:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880124cd1c00) 00010000:00010000:3.0:1713481296.472696:0:15512:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.472713:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.472721:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.472729:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.472735:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.472739:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.472742:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.472751:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.472754:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.472758:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.472785:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.472790:0:15512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801207a2400/0xdfc0fb148a2f89d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42f9d expref: 2037 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.472794:0:15512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.472808:0:15512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801207a2400/0xdfc0fb148a2f89d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42f9d expref: 2037 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.472817:0:15512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8801207a2400/0xdfc0fb148a2f89d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42f9d expref: 2037 pid: 15576 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.472823:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15512:1796714784433984:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.472841:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c2e4840 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.472867:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472892:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472909:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472930:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472948:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.472993:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473013:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473066:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473090:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784432640:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.473112:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121fb5f80/0xdfc0fb148a36ee7 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4753b expref: 19681 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473137:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121fb5f80, rc 0) 00000100:00100000:3.0:1713481296.473149:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19681:8499:x1796714882347584:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3707us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.473154:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561744 00000100:00100000:3.0:1713481296.473170:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561760 00000100:00100000:3.0:1713481296.473173:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dda2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19680:17009:x1796714882349824:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.473179:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.473188:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a027180/0xdfc0fb148a36fdc lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47588 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.473197:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.473204:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473206:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473208:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a027180/0xdfc0fb148a36fdc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47588 expref: 19681 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473215:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a027180/0xdfc0fb148a36fdc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47588 expref: 19681 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473219:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a027180, rc 0) 00000100:00100000:3.0:1713481296.473229:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dda2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19681:17009:x1796714882349824:12345-192.168.202.24@tcp:101:dd.0 Request processed in 55us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.473233:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561760 00000100:00100000:3.0:1713481296.473281:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473287:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882350080 00000100:00100000:3.0:1713481296.473289:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882350080 00000100:00100000:3.0:1713481296.473307:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561762 00000100:00100000:3.0:1713481296.473310:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24472:15045:x1796714882350080:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.473315:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.473324:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904fd8c0/0xdfc0fb148a3701b lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa475a4 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.473332:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.473339:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473340:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473343:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904fd8c0/0xdfc0fb148a3701b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475a4 expref: 24473 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473350:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904fd8c0/0xdfc0fb148a3701b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475a4 expref: 24473 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473354:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904fd8c0, rc 0) 00000100:00100000:3.0:1713481296.473363:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24473:15045:x1796714882350080:12345-192.168.202.24@tcp:101:dd.0 Request processed in 52us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.473366:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561762 00000100:00100000:3.0:1713481296.473458:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473474:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473487:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473496:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882350336 00000100:00100000:3.0:1713481296.473498:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882350336 00000100:00100000:3.0:1713481296.473507:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882350400 00000100:00100000:3.0:1713481296.473508:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882350400 00000100:00100000:3.0:1713481296.473517:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561763 00000100:00100000:3.0:1713481296.473520:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24474:10479:x1796714882350336:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.473524:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.473532:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904fdf80/0xdfc0fb148a37037 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa475ab expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473544:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dd16400/0xdfc0fb148916d36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c650d expref: 24475 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.473548:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473549:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473552:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904fdf80/0xdfc0fb148a37037 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475ab expref: 24475 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473563:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dd16400/0xdfc0fb148916d36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c650d expref: 24475 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.473569:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dd16400/0xdfc0fb148916d36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c650d expref: 24475 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.473575:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ad87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784434112:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.473587:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e5fcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.473613:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819833 00000100:00100000:3.0:1713481296.473617:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26719:1959:x1796714882350144:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.473622:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.473626:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098554900/0xdfc0fb14868823b lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa861:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d204a expref: 26719 pid: 16539 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.473633:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098554900/0xdfc0fb14868823b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa861:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d204a expref: 26719 pid: 16539 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.473646:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473646:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473648:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ab49d40/0xdfc0fb148a36ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa861:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473653:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ab49d40/0xdfc0fb148a36ed9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa861:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473678:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.473689:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26719:1959:x1796714882350144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.473694:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819833 00010000:00010000:3.0:1713481296.473718:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473723:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473728:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473731:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473735:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473738:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e3ec480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.473740:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473744:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473755:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473759:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e3ec480/0xdfc0fb148a36e54 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.473805:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473818:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.473824:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882350272 00000100:00100000:3.0:1713481296.473826:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882350272 00010000:00010000:3.0:1713481296.473841:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbd58c0/0xdfc0fb148959b17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeae2 expref: 26717 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.473850:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882350208 00000100:00100000:3.0:1713481296.473851:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882350208 00010000:00010000:3.0:1713481296.473857:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800869a6d00/0xdfc0fb1488e7dea lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5492 expref: 19681 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.473874:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819834 00000100:00100000:3.0:1713481296.473877:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26717:1959:x1796714882350272:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.473882:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.473892:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cbd58c0/0xdfc0fb148959b17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeae2 expref: 26717 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.473898:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cbd58c0/0xdfc0fb148959b17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeae2 expref: 26717 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.473916:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbd58c0/0xdfc0fb148959b17 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeae2 expref: 26717 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.473927:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473928:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.473930:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008497a640/0xdfc0fb148a36eee lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x82c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47534 expref: 26716 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473936:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008497a640/0xdfc0fb148a36eee lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47534 expref: 26716 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.473948:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008497a640/0xdfc0fb148a36eee lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47534 expref: 26716 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.473953:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784434368:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.473965:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.474002:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.474036:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784434432:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.474053:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.474078:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561765 00000100:00100000:3.0:1713481296.474082:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19681:18836:x1796714882350464:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.474087:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.474096:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009433cfc0/0xdfc0fb148a37045 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x804e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa475b9 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474111:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880079748fc0/0xdfc0fb1489199a5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x804e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c7e12 expref: 25579 pid: 16474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474115:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.474115:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.474132:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009433cfc0/0xdfc0fb148a37045 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x804e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475b9 expref: 19681 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474145:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880079748fc0/0xdfc0fb1489199a5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x804e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c7e12 expref: 25579 pid: 16474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474152:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880079748fc0/0xdfc0fb1489199a5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x804e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c7e12 expref: 25579 pid: 16474 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.474157:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800891b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784434496:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.474169:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.474344:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784433600:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.474359:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.474401:0:16460:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16460:1796714784433664:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.474423:0:16460:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095e48900/0xdfc0fb148a36f26 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x267a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.474457:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.474544:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.474574:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819836 00000100:00100000:3.0:1713481296.474581:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25580:1959:x1796714882350720:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.474590:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.474596:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ea46c0/0xdfc0fb148801ffd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962444 expref: 25580 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.474603:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ea46c0/0xdfc0fb148801ffd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962444 expref: 25580 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.474615:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ea46c0/0xdfc0fb148801ffd lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962444 expref: 25580 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.474627:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.474628:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.474630:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474635:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474648:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.474659:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25579:1959:x1796714882350720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.474679:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819836 00010000:00010000:3.0:1713481296.474707:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474712:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474717:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474720:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474724:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474727:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085d46880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.474729:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474733:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474740:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.474745:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085d46880/0xdfc0fb148a36f11 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.474886:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.474913:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.474927:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882350784 00000100:00100000:3.0:1713481296.474930:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882350784 00010000:00010000:3.0:1713481296.474942:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009753f3c0/0xdfc0fb148688249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2066 expref: 26715 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.474965:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882350912 00000100:00100000:3.0:1713481296.474967:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882350912 00010000:00010000:3.0:1713481296.474975:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd88d80/0xdfc0fb148688242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2058 expref: 26716 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.474989:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819842 00000100:00100000:3.0:1713481296.474993:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26716:1959:x1796714882350912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.474998:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.475000:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd88d80/0xdfc0fb148688242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2058 expref: 26716 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.475007:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd88d80/0xdfc0fb148688242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2058 expref: 26716 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.475020:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd88d80/0xdfc0fb148688242 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2058 expref: 26716 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.475030:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475031:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475033:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475038:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475050:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.475061:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26714:1959:x1796714882350912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.475065:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819842 00000100:00100000:3.0:1713481296.475076:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882351040 00000100:00100000:3.0:1713481296.475078:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882351040 00010000:00010000:3.0:1713481296.475084:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd89b00/0xdfc0fb148688257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2082 expref: 26714 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.475095:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819843 00000100:00100000:3.0:1713481296.475098:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008318e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26714:1959:x1796714882351040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.475104:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.475106:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd89b00/0xdfc0fb148688257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa865:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2082 expref: 26713 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.475112:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd89b00/0xdfc0fb148688257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa865:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2082 expref: 26713 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.475135:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd89b00/0xdfc0fb148688257 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa865:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2082 expref: 26713 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.475148:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475149:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475151:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475156:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475166:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.475175:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008318e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26712:1959:x1796714882351040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.475178:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819843 00010000:00010000:3.0:1713481296.475193:0:16452:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475199:0:16452:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475203:0:16452:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475207:0:16452:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475210:0:16452:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475217:0:16452:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090914000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.475219:0:16452:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475223:0:16452:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475232:0:16452:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475235:0:16452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090914000/0xdfc0fb148a36f0a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.475357:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+2558:3493:x1796714784432832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4315us (4390us total) trans 4295960494 rc 0/0 00000100:00100000:3.0:1713481296.475364:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561749 00010000:00010000:3.0:1713481296.475391:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475398:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475405:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475412:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475419:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475425:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e48d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.475428:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475435:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475448:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475455:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095e48d80/0xdfc0fb148a36f1f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.475576:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2559:3493:x1796714784433216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4470us (4527us total) trans 4295960495 rc 0/0 00000100:00100000:3.0:1713481296.475581:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561752 00000100:00100000:3.0:1713481296.475606:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561769 00000100:00100000:3.0:1713481296.475611:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2560:3491:x1796714784434880:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.475625:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43115 count 1 00010000:00010000:3.0:1713481296.475636:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475647:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2ed200/0xdfc0fb14868827a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d20d6 expref: 26711 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.475654:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475655:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475658:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475689:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2ed200/0xdfc0fb14868827a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d20d6 expref: 26711 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.475698:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c2ed200/0xdfc0fb14868827a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d20d6 expref: 26711 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.475707:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784435072:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.475726:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007aba30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.475751:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561771 00000100:00100000:3.0:1713481296.475755:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+2561:3493:x1796714784435008:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.475768:0:16452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43117 count 1 00010000:00010000:3.0:1713481296.475779:0:16452:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a024d80/0xdfc0fb148a3706f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa86d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475789:0:16452:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098556f40/0xdfc0fb14868828f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa86d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d20f2 expref: 26711 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.475795:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475796:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.475799:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a024d80/0xdfc0fb148a3706f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa86d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.475822:0:16452:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098556f40/0xdfc0fb14868828f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa86d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d20f2 expref: 26711 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.475831:0:16452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098556f40/0xdfc0fb14868828f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa86d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d20f2 expref: 26711 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.475840:0:16452:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091829c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0001_UUID:16452:1796714784435264:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.475887:0:16452:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801329bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.477193:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882351232 00000100:00100000:3.0:1713481296.477198:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882351232 00000100:00100000:3.0:1713481296.477225:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882351360 00000100:00100000:3.0:1713481296.477228:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882351360 00000100:00100000:3.0:1713481296.477245:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485611 00000100:00100000:3.0:1713481296.477249:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18863:x1796714882351232:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.477257:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.477266:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097d10000/0xdfc0fb148a37076 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa475c7 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.477512:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485612 00000100:00100000:3.0:1713481296.477518:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2037:18864:x1796714882351360:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.477534:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.477547:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097d12400/0xdfc0fb148a37084 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa475ce expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.477626:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c6d:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.477691:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097d12400/0xdfc0fb148a37084 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475ce expref: 2039 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.477698:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097d12400/0xdfc0fb148a37084 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475ce expref: 2039 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.477726:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097d12400, rc 0) 00000100:00100000:3.0:1713481296.477752:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:18864:x1796714882351360:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 233us (2235us total) trans 4295107507 rc 301/301 00000100:00100000:3.0:1713481296.477758:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485612 00000100:00100000:3.0:1713481296.477799:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882351936 00000100:00100000:3.0:1713481296.477803:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882351936 00000100:00100000:3.0:1713481296.477834:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485613 00000100:00100000:3.0:1713481296.477840:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801204d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2201:18580:x1796714882351936:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.477854:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.477862:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007febad00/0xdfc0fb148a37092 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa475e3 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.477924:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.477934:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.477942:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.477955:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.477960:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.477967:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478014:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc2640/0xdfc0fb148a370b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478021:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc2640/0xdfc0fb148a370b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478025:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc2640/0xdfc0fb148a370b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000004:00200000:3.0:1713481296.478042:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x383b:0x0]: returning size 5 00000004:00200000:3.0:1713481296.478045:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.478051:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc2640/0xdfc0fb148a370b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478057:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc2640/0xdfc0fb148a370b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478062:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478065:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478069:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478073:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478075:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bdc3600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.478077:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478081:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478086:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3835:0x0].0x0 (ffff8800849c8a00) 00010000:00010000:3.0:1713481296.478087:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.478089:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478092:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3600/0xdfc0fb148a37099 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478104:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478107:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478110:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478113:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bdc3840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.478114:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478117:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478142:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3835:0x0].0x3331 (ffff880133dbce00) 00010000:00010000:3.0:1713481296.478144:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.478145:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 2/0,0 mode: --/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478150:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc3840/0xdfc0fb148a370ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.478182:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007febad00/0xdfc0fb148a37092 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475e3 expref: 2203 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478197:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc2640/0xdfc0fb148a370b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475e3 expref: 2202 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478203:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x383b:0x0].0x0 (ffff880093395600) 00010000:00010000:3.0:1713481296.478205:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.478207:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdc2640, rc 0) 00000100:00100000:3.0:1713481296.478231:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801204d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18580:x1796714882351936:12345-192.168.202.24@tcp:101:rm.0 Request processed in 390us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.478238:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485613 00000100:00100000:3.0:1713481296.478281:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15512:1796714784433984:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.478300:0:15512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00000004:00200000:3.0:1713481296.478456:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x3899:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.478501:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097d10000/0xdfc0fb148a37076 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475c7 expref: 2794 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478507:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097d10000/0xdfc0fb148a37076 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475c7 expref: 2794 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478515:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097d10000, rc 0) 00000100:00100000:3.0:1713481296.478534:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18863:x1796714882351232:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1284us (3991us total) trans 4295105856 rc 301/301 00000100:00100000:3.0:1713481296.478539:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485611 00000100:00100000:3.0:1713481296.478559:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882352192 00000100:00100000:3.0:1713481296.478563:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882352192 00000100:00100000:3.0:1713481296.478582:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485614 00000100:00100000:3.0:1713481296.478587:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:18604:x1796714882352192:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.478593:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.478601:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009bdc2f40/0xdfc0fb148a370c3 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa475f1 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478649:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008cfad8c0/0xdfc0fb148a370ca lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.478654:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008cfad8c0/0xdfc0fb148a370ca lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.478658:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008cfad8c0/0xdfc0fb148a370ca lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:3.0:1713481296.478687:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x1d5:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.478689:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713481296.478707:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009bdc2f40/0xdfc0fb148a370c3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475f1 expref: 2040 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478723:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008cfad8c0/0xdfc0fb148a370ca lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475f1 expref: 2039 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478727:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x0 (ffff88011f854900) 00010000:00010000:3.0:1713481296.478728:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.478730:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008cfad8c0, rc 0) 00000100:00100000:3.0:1713481296.478745:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2039:18604:x1796714882352192:12345-192.168.202.24@tcp:101:rm.0 Request processed in 159us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.478752:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485614 00000100:00100000:3.0:1713481296.478777:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882352064 00000100:00100000:3.0:1713481296.478780:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882352064 00000100:00100000:3.0:1713481296.478794:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26090 00000100:00100000:3.0:1713481296.478797:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012246c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2039:18706:x1796714882352064:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.478811:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713481296.478820:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008341ed00/0xdfc0fb148a36f9d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4755e expref: 2039 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478834:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff88009a8c3700) 00010000:00010000:3.0:1713481296.478847:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121fb4d80/0xdfc0fb148a36dc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa474cb expref: 2038 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.478858:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff88011d9d3100) 00010000:00010000:3.0:1713481296.478866:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.478875:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.478881:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478885:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478892:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.478896:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478902:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478910:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.478913:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478917:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478952:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.478956:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478960:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478980:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.478983:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.478988:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.478996:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784435520:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.479019:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.479031:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097848780 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.479052:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784435520 00000100:00100000:3.0:1713481296.479054:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784435520 00000100:00100000:3.0:1713481296.479068:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82791 00000100:00100000:3.0:1713481296.479071:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:15514:x1796714784435520:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.479077:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.479085:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b0ce1c0/0xdfc0fb148a370f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a370ed expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.479096:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b0ce1c0/0xdfc0fb148a370f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a370ed expref: 12 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.479102:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b0ce1c0/0xdfc0fb148a370f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a370ed expref: 12 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.479106:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff88008ad14900) 00010000:00010000:3.0:1713481296.479108:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1713481296.479109:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b0ce1c0, rc 0) 00000100:00100000:3.0:1713481296.479143:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784435520:12345-0@lo:101:mdt_io00_009.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.479147:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82791 00000100:00100000:3.0:1713481296.479174:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784435520:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.479182:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a370f4 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.479187:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a370f4 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.479209:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x51a6:0x0] 00010000:00010000:3.0:1713481296.479216:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.479220:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479224:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.479256:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784435648:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.479283:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.479298:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097ba1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.479313:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784435648 00000100:00100000:3.0:1713481296.479316:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784435648 00000100:00100000:3.0:1713481296.479332:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82792 00000100:00100000:3.0:1713481296.479337:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784435648:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.479390:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784435648:12345-0@lo:1000:mdt_io00_009.0 Request processed in 53us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.479395:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82792 00000100:00100000:3.0:1713481296.479424:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784435648:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.479499:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479504:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479507:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479510:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b0cf3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.479512:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479518:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479523:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff880134451300) 00010000:00010000:3.0:1713481296.479525:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.479526:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479530:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0cf3c0/0xdfc0fb148a370fb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479550:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479553:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479556:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479559:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c23af40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.479560:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479562:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479566:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff880134451f00) 00010000:00010000:3.0:1713481296.479567:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.479568:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479571:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c23af40/0xdfc0fb148a370e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000004:00080000:3.0:1713481296.479581:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x51a6:0x0] 00010000:00010000:3.0:1713481296.479583:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a370f4 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.479588:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a370f4 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.479591:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0ce640/0xdfc0fb148a370ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a370f4 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.479609:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713481296.479613:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479616:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479619:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479622:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083220b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.479624:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479627:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479631:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff880090b3b900) 00010000:00010000:3.0:1713481296.479632:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.479633:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479638:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a370df lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479649:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479653:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479656:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479661:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479680:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098ea4b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.479683:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479688:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479695:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.479697:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.479699:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479704:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098ea4b40/0xdfc0fb148a370d1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479717:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479722:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479727:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479731:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bb94d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.479733:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479738:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479745:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff88011f854d00) 00010000:00010000:3.0:1713481296.479746:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.479748:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.479753:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009bb94d80/0xdfc0fb148a370d8 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.479797:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012246c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2036:18706:x1796714882352064:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 996us (1957us total) trans 0 rc -39/-39 00000100:00100000:3.0:1713481296.479803:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26090 00010000:00010000:3.0:1713481296.479853:0:15512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.479860:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.479882:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0cf600/0xdfc0fb148a37117 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.479888:0:15512:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0cf600/0xdfc0fb148a37117 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.479899:0:15512:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0cf600/0xdfc0fb148a37117 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15512 initiator: MDT1 00000100:00100000:3.0:1713481296.479911:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784435968:0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713481296.479937:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.479955:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120ff7480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.479972:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784435968 00000100:00100000:3.0:1713481296.479975:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784435968 00000100:00100000:3.0:1713481296.479991:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784436032 00000100:00100000:3.0:1713481296.479993:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784436032 00000100:00100000:3.0:1713481296.480014:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82793 00000100:00100000:3.0:1713481296.480018:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:15512:x1796714784435968:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:3.0:1713481296.480024:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.480031:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b0cdd40/0xdfc0fb148a37125 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a37117 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480043:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b0cdd40/0xdfc0fb148a37125 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a37117 expref: 13 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480049:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b0cdd40/0xdfc0fb148a37125 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37117 expref: 13 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480054:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88008fd42700) 00010000:00010000:3.0:1713481296.480055:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1713481296.480056:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b0cdd40, rc 0) 00000100:00100000:3.0:1713481296.480079:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:15512:x1796714784435968:12345-0@lo:101:mdt_io00_007.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.480083:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82793 00000100:00100000:3.0:1713481296.480117:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784435968:0@lo:101:mdt_io00_007.0 00010000:00010000:3.0:1713481296.480147:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0cf600/0xdfc0fb148a37117 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37125 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480155:0:15512:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0cf600/0xdfc0fb148a37117 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37125 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.480170:0:15512:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x50b7:0x0] 00000100:00100000:3.0:1713481296.480188:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f985500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784436160:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713481296.480205:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.480220:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880120ff7780 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.480562:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800891b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784434496:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.480591:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009433cfc0/0xdfc0fb148a37045 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x804e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475b9 expref: 19682 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480602:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009433cfc0, rc 0) 00000100:00100000:3.0:1713481296.480622:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19682:18836:x1796714882350464:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6539us (6619us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.480627:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561765 00000100:00100000:3.0:1713481296.480660:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784434368:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.480695:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.480709:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26710:1959:x1796714882350272:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6831us (6903us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.480714:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819834 00000100:00100000:3.0:1713481296.480790:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485617 00000100:00100000:3.0:1713481296.480794:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2382:18712:x1796714882352576:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.480800:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.480808:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49d40/0xdfc0fb148a37148 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4760d expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480858:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a711f80/0xdfc0fb148a3714f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.480863:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a711f80/0xdfc0fb148a3714f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.480868:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a711f80/0xdfc0fb148a3714f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000004:00200000:3.0:1713481296.480904:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2aaf:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.480907:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713481296.480925:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49d40/0xdfc0fb148a37148 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4760d expref: 2384 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480936:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a711f80/0xdfc0fb148a3714f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4760d expref: 2383 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.480940:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880096358c00) 00010000:00010000:3.0:1713481296.480942:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.480943:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a711f80, rc 0) 00000100:00100000:3.0:1713481296.480958:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2383:18712:x1796714882352576:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 164us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.480962:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485617 00000100:00100000:3.0:1713481296.481003:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784435072:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.481025:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.481093:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091829c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0001_UUID:16452:1796714784435264:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.481114:0:16452:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a024d80/0xdfc0fb148a3706f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa86d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.481146:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882352704 00000100:00100000:3.0:1713481296.481149:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882352704 00000100:00100000:3.0:1713481296.481165:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485618 00000100:00100000:3.0:1713481296.481169:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2201:18678:x1796714882352704:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.481188:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.481197:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7118c0/0xdfc0fb148a37156 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47614 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.481256:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481261:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481265:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481275:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x230:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481281:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481287:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481320:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097201440/0xdfc0fb148a3716b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481328:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097201440/0xdfc0fb148a3716b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481332:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097201440/0xdfc0fb148a3716b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00010000:3.0:1713481296.481340:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097201440/0xdfc0fb148a3716b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481346:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481349:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481353:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481356:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481359:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007da3fa80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.481360:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481363:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481367:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff880096358100) 00010000:00010000:3.0:1713481296.481368:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.481370:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481373:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007da3fa80/0xdfc0fb148a3715d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481382:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481385:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481388:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481391:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097201f80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.481392:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481395:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481398:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x36 (ffff880096358f00) 00010000:00010000:3.0:1713481296.481399:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.481400:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481403:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097201f80/0xdfc0fb148a37164 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.481426:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7118c0/0xdfc0fb148a37156 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47614 expref: 2203 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.481438:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097201440/0xdfc0fb148a3716b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47614 expref: 2202 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.481445:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c5b:0x0].0x0 (ffff88008175cb00) 00010000:00010000:3.0:1713481296.481446:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.481448:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097201440, rc 0) 00000100:00100000:3.0:1713481296.481463:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18678:x1796714882352704:12345-192.168.202.24@tcp:101:rm.0 Request processed in 294us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.481467:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485618 00000100:00100000:3.0:1713481296.481495:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ad87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784434112:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.481523:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904fdf80/0xdfc0fb148a37037 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475ab expref: 24475 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.481534:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904fdf80, rc 0) 00000100:00100000:3.0:1713481296.481554:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24475:10479:x1796714882350336:12345-192.168.202.24@tcp:101:dd.0 Request processed in 8032us (8095us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.481560:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561763 00000100:00100000:3.0:1713481296.481580:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882353344 00000100:00100000:3.0:1713481296.481583:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882353344 00000100:00100000:3.0:1713481296.481596:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882353408 00000100:00100000:3.0:1713481296.481598:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882353408 00000100:00100000:3.0:1713481296.481610:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561779 00000100:00100000:3.0:1713481296.481615:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19682:11552:x1796714882353344:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.481623:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.481633:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013306a1c0/0xdfc0fb148a37172 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4761b expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.481649:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5b00/0xdfc0fb148959b25 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeafe expref: 19683 pid: 16490 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.481656:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.481658:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.481662:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013306a1c0/0xdfc0fb148a37172 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4761b expref: 19683 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.481694:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5b00/0xdfc0fb148959b25 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeafe expref: 19683 pid: 16490 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.481703:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5b00/0xdfc0fb148959b25 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeafe expref: 19683 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.481714:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784436544:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.481738:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.481773:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784436480 00000100:00100000:3.0:1713481296.481776:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784436480 00000100:00100000:3.0:1713481296.481796:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82798 00000100:00100000:3.0:1713481296.481800:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:15512:x1796714784436480:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713481296.481853:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:15512:x1796714784436480:12345-0@lo:1000:mdt_io00_007.0 Request processed in 53us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.481858:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82798 00000100:00100000:3.0:1713481296.481889:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078395500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784436480:0@lo:1000:mdt_io00_007.0 00000040:00080000:3.0:1713481296.482270:0:15512:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x9a:0x0].1978, 576 off1623360 00000040:00080000:3.0:1713481296.482380:0:15512:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xa5:0x0].853, 656 off789488 00000004:00080000:3.0:1713481296.482384:0:15512:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009e5fcc00 with version 16893 00000100:00100000:3.0:1713481296.482477:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882354176 00000100:00100000:3.0:1713481296.482480:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882354176 00000100:00100000:3.0:1713481296.482494:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485619 00000100:00100000:3.0:1713481296.482498:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18604:x1796714882354176:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.482503:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.482511:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801330698c0/0xdfc0fb148a37187 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4764c expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.482596:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013306bcc0/0xdfc0fb148a3718e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x3833:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.482602:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013306bcc0/0xdfc0fb148a3718e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x3833:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.482606:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013306bcc0/0xdfc0fb148a3718e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x3833:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000004:00200000:3.0:1713481296.482610:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x3833:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.482649:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801330698c0/0xdfc0fb148a37187 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4764c expref: 2205 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.482678:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013306bcc0/0xdfc0fb148a3718e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x3833:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4764c expref: 2204 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.482683:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3833:0x0].0x0 (ffff88009c535800) 00010000:00010000:3.0:1713481296.482685:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1713481296.482687:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013306bcc0, rc 0) 00000100:00100000:3.0:1713481296.482699:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18604:x1796714882354176:12345-192.168.202.24@tcp:101:rm.0 Request processed in 201us (611us total) trans 4295105857 rc 0/0 00000100:00100000:3.0:1713481296.482703:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485619 00000100:00100000:3.0:1713481296.483009:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882352640 00000100:00100000:3.0:1713481296.483013:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882352640 00010000:00010000:3.0:1713481296.483028:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120fe0240/0xdfc0fb14891d112 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca698 expref: 24474 pid: 16526 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.483049:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819855 00000100:00100000:3.0:1713481296.483053:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24474:1960:x1796714882352640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.483061:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.483064:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120fe0240/0xdfc0fb14891d112 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca698 expref: 24474 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.483074:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120fe0240/0xdfc0fb14891d112 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca698 expref: 24474 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.483092:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120fe0240/0xdfc0fb14891d112 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca698 expref: 24474 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.483105:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.483106:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.483109:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134e92640/0xdfc0fb148a3703e lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475b2 expref: 24473 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483115:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134e92640/0xdfc0fb148a3703e lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475b2 expref: 24473 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483145:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134e92640/0xdfc0fb148a3703e lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475b2 expref: 24473 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.483154:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784436992:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.483168:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007aba30c0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.483450:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084302d80/2, rc 0, transno 993204 00000100:00100000:3.0:1713481296.483457:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784434432:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.483513:0:6937:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784437120 00000100:00100000:3.0:1713481296.483516:0:6937:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784437120 00000100:00100000:3.0:1713481296.483533:0:6937:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82799 00000100:00100000:3.0:1713481296.483540:0:6937:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:8077:x1796714784437120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713481296.483654:0:6937:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8077:x1796714784437120:12345-0@lo:1000:osp_up0-1.0 Request processed in 115us (170us total) trans 4295105858 rc 0/0 00000100:00100000:3.0:1713481296.483660:0:6937:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82799 00010000:00010000:3.0:1713481296.483705:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483710:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483715:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483719:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483723:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483731:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009433ef40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.483733:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483737:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483745:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483749:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009433ef40/0xdfc0fb148a37061 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa86b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.483870:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2567:3491:x1796714784434880:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8258us (8379us total) trans 4295960502 rc 0/0 00000100:00100000:3.0:1713481296.483875:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561769 00000100:00100000:3.0:1713481296.483895:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561785 00000100:00100000:3.0:1713481296.483899:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19686:17935:x1796714882353536:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.483905:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.483913:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013306af40/0xdfc0fb148a371b1 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47630 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.483924:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.483932:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.483933:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.483937:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013306af40/0xdfc0fb148a371b1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47630 expref: 19687 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483943:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013306af40/0xdfc0fb148a371b1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47630 expref: 19687 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.483948:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013306af40, rc 0) 00000100:00100000:3.0:1713481296.483960:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19687:17935:x1796714882353536:12345-192.168.202.24@tcp:101:dd.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.483963:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561785 00000100:00100000:3.0:1713481296.484008:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784437376:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.484029:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.484057:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784437376 00000100:00100000:3.0:1713481296.484060:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784437376 00000100:00100000:3.0:1713481296.484077:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561786 00000100:00100000:3.0:1713481296.484081:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2567:3492:x1796714784437376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.484093:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43123 count 1 00010000:00010000:3.0:1713481296.484103:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484111:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968ea640/0xdfc0fb1486882b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2146 expref: 26704 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.484116:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.484117:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.484134:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484151:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968ea640/0xdfc0fb1486882b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2146 expref: 26704 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.484158:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968ea640/0xdfc0fb1486882b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2146 expref: 26704 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.484164:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a2a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784437440:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.484179:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124a8e6c0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.484206:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787fca80/2, rc 0, transno 993206 00000100:00100000:3.0:1713481296.484211:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784434880:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.484230:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.484235:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800755a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784437504:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.484260:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.484278:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784437504 00000100:00100000:3.0:1713481296.484280:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784437504 00000100:00100000:3.0:1713481296.484290:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561787 00000100:00100000:3.0:1713481296.484293:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2568:3492:x1796714784437504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.484301:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43124 count 1 00010000:00010000:3.0:1713481296.484309:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090916400/0xdfc0fb148a371bf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa874:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484317:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3b9f80/0xdfc0fb1486882c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2154 expref: 26704 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.484321:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.484323:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.484324:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090916400/0xdfc0fb148a371bf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484336:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a3b9f80/0xdfc0fb1486882c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2154 expref: 26704 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.484341:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a3b9f80/0xdfc0fb1486882c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2154 expref: 26704 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.484347:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784437568:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.484357:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800869346c0 going to sleep for 11 seconds 00000004:00010000:3.0:1713481296.484384:0:15512:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801322a5c00 reply state ffff88009ca37000 transno 4295107508 ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484389:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484394:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880124cd1c00) 00010000:00010000:3.0:1713481296.484395:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1713481296.484397:0:15512:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1713481296.484399:0:15512:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x50b7:0x0] 00010000:00010000:3.0:1713481296.484403:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0cf600/0xdfc0fb148a37117 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37125 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484407:0:15512:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007b0cf600/0xdfc0fb148a37117 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37125 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484413:0:15512:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484418:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484422:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484425:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484428:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008837e880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.484429:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484432:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484437:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.484438:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.484439:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484442:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008837e880/0xdfc0fb148a36f65 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00000004:00010000:3.0:1713481296.484452:0:15512:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801322a5c00 reply state ffff88009ca37000 transno 4295107508 ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484456:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484460:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88009d156700) 00010000:00010000:3.0:1713481296.484461:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.484462:0:15512:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:3.0:1713481296.484465:0:15512:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801322a5c00 reply state ffff88009ca37000 transno 4295107508 ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484470:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.484472:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88012ca0c100) 00010000:00010000:3.0:1713481296.484474:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.484474:0:15512:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1713481296.484492:0:15512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2384:18679:x1796714882349376:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 11860us (11897us total) trans 4295107508 rc 0/0 00000100:00100000:3.0:1713481296.484496:0:15512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26089 00000100:00100000:3.0:1713481296.484517:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882353792 00000100:00100000:3.0:1713481296.484519:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882353792 00000100:00100000:3.0:1713481296.484531:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882353856 00000100:00100000:3.0:1713481296.484532:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882353856 00000100:00100000:3.0:1713481296.484558:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561789 00000100:00100000:3.0:1713481296.484561:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25578:17924:x1796714882353856:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.484566:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.484574:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc22640/0xdfc0fb148a371cd lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4763e expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484585:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350a8000/0xdfc0fb148a15fa2 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397c6 expref: 25579 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.484590:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.484591:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.484593:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc22640/0xdfc0fb148a371cd lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4763e expref: 25579 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484607:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350a8000/0xdfc0fb148a15fa2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397c6 expref: 25579 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.484613:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350a8000/0xdfc0fb148a15fa2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397c6 expref: 25579 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.484618:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784437632:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.484630:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086934a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.484886:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882354048 00000100:00100000:3.0:1713481296.484888:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882354048 00000100:00100000:3.0:1713481296.484903:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485621 00000100:00100000:3.0:1713481296.484906:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18580:x1796714882354048:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.484921:0:15577:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1713481296.484931:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091728d80/0xdfc0fb148a05d66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x383b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa33724 expref: 2204 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484949:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc2640/0xdfc0fb148a370b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475e3 expref: 2203 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484961:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ffeac0/0xdfc0fb148a05b67 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x383b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa33659 expref: 2202 pid: 15591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484970:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x383b:0x0].0x0 (ffff880093395600) 00010000:00010000:3.0:1713481296.484976:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c239f80/0xdfc0fb148a354f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3835:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa46130 expref: 2201 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.484987:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3835:0x0].0x0 (ffff8800849c8a00) 00010000:00010000:3.0:1713481296.484989:0:15577:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.484997:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 3/0,1 mode: --/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485002:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485006:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485012:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134e90d80/0xdfc0fb148a371e2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3835:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485015:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134e90d80/0xdfc0fb148a371e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485018:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134e90d80/0xdfc0fb148a371e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485049:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485053:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485056:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00000040:00080000:3.0:1713481296.485180:0:15577:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13562, 64 off876160 00010000:00010000:3.0:1713481296.485214:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485225:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485232:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485238:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485243:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485248:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485253:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485258:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009161a880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.485261:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485266:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485273:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x383b:0x0].0x0 (ffff880093395600) 00010000:00010000:3.0:1713481296.485275:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.485278:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 3/0,0 mode: --/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485283:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009161a880/0xdfc0fb148a371f0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x383b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485302:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485308:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485313:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485318:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c7e4fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.485320:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485325:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485330:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x383b:0x0].0x0 (ffff880093395600) 00010000:00010000:3.0:1713481296.485331:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.485333:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485336:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7e4fc0/0xdfc0fb148a371e9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x383b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485425:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485429:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485432:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485435:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485437:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134e91440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.485439:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485443:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485447:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3835:0x0].0x0 (ffff8800849c8a00) 00010000:00010000:3.0:1713481296.485449:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.485450:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 3/0,0 mode: --/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485452:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134e91440/0xdfc0fb148a371db lrc: 0/0,0 mode: --/CW res: [0x200000404:0x3835:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00000004:00010000:3.0:1713481296.485459:0:15577:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800921b8700 reply state ffff88009b086000 transno 4295105859 ns: mdt-lustre-MDT0000_UUID lock: ffff880134e90d80/0xdfc0fb148a371e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485463:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134e90d80/0xdfc0fb148a371e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x3835:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485466:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3835:0x0].0x3331 (ffff88011f854500) 00010000:00010000:3.0:1713481296.485467:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.485469:0:15577:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.485488:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18580:x1796714882354048:12345-192.168.202.24@tcp:36:rm.0 Request processed in 581us (616us total) trans 4295105859 rc 0/0 00000100:00100000:3.0:1713481296.485493:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485621 00000100:00100000:3.0:1713481296.485507:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882354688 00000100:00100000:3.0:1713481296.485509:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882354688 00000100:00100000:3.0:1713481296.485520:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485622 00000100:00100000:3.0:1713481296.485523:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:18716:x1796714882354688:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.485529:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.485535:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008341cfc0/0xdfc0fb148a37213 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4766f expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.485585:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485591:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485596:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485602:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485606:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485609:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485636:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880083222ac0/0xdfc0fb148a37228 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.485641:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880083222ac0/0xdfc0fb148a37228 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485646:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880083222ac0/0xdfc0fb148a37228 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000004:00200000:3.0:1713481296.485677:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c6f:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.485680:0:15577:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.485689:0:15577:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880083222ac0/0xdfc0fb148a37228 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485696:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485702:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485707:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485713:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485717:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008341e1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.485720:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485726:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485731:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.485733:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.485734:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485738:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008341e1c0/0xdfc0fb148a3721a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485747:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485750:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485753:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485756:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009669ed00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.485758:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485761:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485764:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff88011f854200) 00010000:00010000:3.0:1713481296.485765:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.485767:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485769:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009669ed00/0xdfc0fb148a37221 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.485791:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008341cfc0/0xdfc0fb148a37213 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4766f expref: 2040 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.485798:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880083222ac0/0xdfc0fb148a37228 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4766f expref: 2039 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.485801:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff88011f854100) 00010000:00010000:3.0:1713481296.485803:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.485804:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083222ac0, rc 0) 00000100:00100000:3.0:1713481296.485816:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2039:18716:x1796714882354688:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 292us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.485820:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485622 00000100:00100000:3.0:1713481296.486054:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a266b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784438016:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.486078:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.486149:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561795 00000100:00100000:3.0:1713481296.486155:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800771eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2569:3491:x1796714784438016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.486169:0:15499:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43126 count 1 00010000:00010000:3.0:1713481296.486181:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.486193:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098556880/0xdfc0fb1486882d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2170 expref: 26702 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.486198:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.486199:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.486200:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.486213:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098556880/0xdfc0fb1486882d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2170 expref: 26702 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.486218:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098556880/0xdfc0fb1486882d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2170 expref: 26702 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.486225:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800771eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784438144:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.486240:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0840 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.486297:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801209b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438080:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486350:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800771e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438272:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486366:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.486378:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.486390:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784438272 00000100:00100000:3.0:1713481296.486392:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784438272 00000100:00100000:3.0:1713481296.486406:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82802 00000100:00100000:3.0:1713481296.486409:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801209b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438272:12345-0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486453:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801209b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438272:12345-0@lo:1000:mdt00_024.0 Request processed in 43us (86us total) trans 0 rc -2/-2 00000100:00100000:3.0:1713481296.486457:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82802 00000100:00100000:3.0:1713481296.486493:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800771e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438272:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486552:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800771e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438400:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486573:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.486584:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ce4a180 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.486594:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784438400 00000100:00100000:3.0:1713481296.486596:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784438400 00000100:00100000:3.0:1713481296.486609:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82803 00000100:00100000:3.0:1713481296.486612:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438400:12345-0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486647:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438400:12345-0@lo:1000:mdt00_024.0 Request processed in 34us (73us total) trans 0 rc -2/-2 00000100:00100000:3.0:1713481296.486652:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82803 00000100:00100000:3.0:1713481296.486700:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800771e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438400:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486743:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e32f100 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438464:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486823:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.486835:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.486845:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784438464 00000100:00100000:3.0:1713481296.486846:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784438464 00000100:00100000:3.0:1713481296.486857:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82804 00000100:00100000:3.0:1713481296.486859:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438464:12345-0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.486969:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438464:12345-0@lo:1000:mdt00_024.0 Request processed in 107us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.486977:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82804 00000100:00100000:3.0:1713481296.487005:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e32f100 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438464:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.487322:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e32f100 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438528:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.487350:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.487363:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.487376:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784438528 00000100:00100000:3.0:1713481296.487379:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784438528 00000100:00100000:3.0:1713481296.487395:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82805 00000100:00100000:3.0:1713481296.487399:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438528:12345-0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.487515:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:15576:x1796714784438528:12345-0@lo:1000:mdt00_024.0 Request processed in 114us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.487522:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82805 00000100:00100000:3.0:1713481296.487553:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e32f100 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784438528:0@lo:1000:mdt00_024.0 00000040:00080000:3.0:1713481296.488160:0:15576:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x9a:0x0].1979, 2152 off1625512 00000040:00080000:3.0:1713481296.488204:0:15576:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xa5:0x0].854, 2352 off791840 00000004:00080000:3.0:1713481296.488206:0:15576:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800967a0000 with version 16894 00000100:00100000:3.0:1713481296.488234:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784436544:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.488252:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013306a1c0/0xdfc0fb148a37172 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4761b expref: 19690 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488261:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013306a1c0, rc 0) 00000100:00100000:3.0:1713481296.488278:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19690:11552:x1796714882353344:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6663us (7057us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.488283:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561779 00000100:00100000:3.0:1713481296.488312:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784436992:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.488326:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.488338:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24473:1960:x1796714882352640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5284us (5378us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.488343:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819855 00000100:00100000:3.0:1713481296.488779:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882355520 00000100:00100000:3.0:1713481296.488782:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882355520 00000100:00100000:3.0:1713481296.488796:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561799 00000100:00100000:3.0:1713481296.488799:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19690:18836:x1796714882355520:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.488805:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.488813:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083220fc0/0xdfc0fb148a372a6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x804f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47699 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488825:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800961f8900/0xdfc0fb148919cae lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x804f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c800a expref: 25578 pid: 16469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488830:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.488831:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.488833:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083220fc0/0xdfc0fb148a372a6 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x804f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47699 expref: 19691 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488843:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800961f8900/0xdfc0fb148919cae lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x804f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c800a expref: 25578 pid: 16469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488849:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800961f8900/0xdfc0fb148919cae lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x804f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c800a expref: 25578 pid: 16469 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.488859:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e32f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784438848:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.488873:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.488893:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819865 00000100:00100000:3.0:1713481296.488896:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26703:1959:x1796714882355136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.488902:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.488906:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098555200/0xdfc0fb1486882b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa872:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2138 expref: 26703 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.488912:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098555200/0xdfc0fb1486882b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa872:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2138 expref: 26703 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.488925:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098555200/0xdfc0fb1486882b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa872:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2138 expref: 26703 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.488934:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.488935:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.488937:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488942:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488953:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.488962:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26702:1959:x1796714882355136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.488968:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819865 00010000:00010000:3.0:1713481296.488991:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.488996:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489001:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489005:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489008:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489011:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f81c6c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.489013:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489017:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489023:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489027:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f81c6c0/0xdfc0fb148a371a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.489157:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2573:3490:x1796714784437184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5571us (5618us total) trans 4295960507 rc 0/0 00000100:00100000:3.0:1713481296.489163:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561783 00000004:00080000:3.0:1713481296.489197:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ad87100/2, rc 0, transno 993211 00000100:00100000:3.0:1713481296.489202:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ad87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784437184:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.489227:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e32ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784439040:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.489241:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.489260:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784439040 00000100:00100000:3.0:1713481296.489262:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784439040 00000100:00100000:3.0:1713481296.489274:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561801 00000100:00100000:3.0:1713481296.489276:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2573:3490:x1796714784439040:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.489284:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43129 count 1 00010000:00010000:3.0:1713481296.489293:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007da54fc0/0xdfc0fb148a372b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa879:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489301:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2efa80/0xdfc0fb1486882e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d219a expref: 26702 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.489305:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.489306:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.489308:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007da54fc0/0xdfc0fb148a372b4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489318:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2efa80/0xdfc0fb1486882e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d219a expref: 26701 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.489327:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c2efa80/0xdfc0fb1486882e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d219a expref: 26701 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.489333:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784439104:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.489345:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800803ec0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.489498:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136178a80/2, rc 0, transno 993212 00000100:00100000:3.0:1713481296.489503:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784436800:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.489520:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.489524:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784439168:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.489557:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.489579:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561803 00000100:00100000:3.0:1713481296.489582:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2574:3490:x1796714784439168:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.489591:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43130 count 1 00010000:00010000:3.0:1713481296.489600:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489608:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007960d200/0xdfc0fb1486882ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21a8 expref: 26700 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.489612:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.489612:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.489614:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.489624:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007960d200/0xdfc0fb1486882ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21a8 expref: 26700 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.489631:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007960d200/0xdfc0fb1486882ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21a8 expref: 26700 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.489637:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099988380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784439296:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.489648:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800801e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.489888:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a2a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784437440:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.489908:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490113:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490129:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490134:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490138:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490142:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490145:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133069f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.490148:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490152:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490161:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490165:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133069f80/0xdfc0fb148a371b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.490267:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2575:3492:x1796714784437376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6185us (6237us total) trans 4295960509 rc 0/0 00000100:00100000:3.0:1713481296.490272:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561786 00000100:00100000:3.0:1713481296.490298:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784437632:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.490319:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc22640/0xdfc0fb148a371cd lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4763e expref: 25580 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.490326:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc22640, rc 0) 00000100:00100000:3.0:1713481296.490335:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25580:17924:x1796714882353856:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5773us (5817us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.490339:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561789 00000100:00100000:3.0:1713481296.490361:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784437568:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.490376:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090916400/0xdfc0fb148a371bf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.490485:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882355584 00000100:00100000:3.0:1713481296.490488:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882355584 00000100:00100000:3.0:1713481296.490511:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125629 00000100:00100000:3.0:1713481296.490516:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18604:x1796714882355584:12345-192.168.202.24@tcp:37:rm.0 00000100:00100000:3.0:1713481296.491024:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125631 00000100:00100000:3.0:1713481296.491029:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18863:x1796714882356608:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1713481296.491096:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18863:x1796714882356608:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 66us (179us total) trans 4295105860 rc 0/0 00000100:00100000:3.0:1713481296.491101:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125631 00000100:00100000:3.0:1713481296.491186:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784439616 00000100:00100000:3.0:1713481296.491190:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784439616 00000100:00100000:3.0:1713481296.491213:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82806 00000100:00100000:3.0:1713481296.491218:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8077:x1796714784439616:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713481296.491592:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:8077:x1796714784439616:12345-0@lo:1000:osp_up0-1.0 Request processed in 373us (1049us total) trans 4295105861 rc 0/0 00000100:00100000:3.0:1713481296.491597:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82806 00000100:00100000:3.0:1713481296.491635:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800771eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784438144:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.491653:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.491715:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cb3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.491721:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.491726:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.491736:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.491739:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.491742:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.491758:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007df0c240/0xdfc0fb148a37308 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.491761:0:15576:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007df0c240/0xdfc0fb148a37308 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.491766:0:15576:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007df0c240/0xdfc0fb148a37308 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15576 initiator: MDT1 00000100:00100000:3.0:1713481296.491773:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122bafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784440064:0@lo:101:mdt00_024.0 00000100:00100000:3.0:1713481296.491793:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.491802:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800801e23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.491830:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882356928 00000100:00100000:3.0:1713481296.491832:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882356928 00000100:00100000:3.0:1713481296.491845:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125632 00000100:00100000:3.0:1713481296.491847:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18580:x1796714882356928:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:3.0:1713481296.491910:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:18580:x1796714882356928:12345-192.168.202.24@tcp:35:rm.0 Request processed in 61us (147us total) trans 4295105862 rc 0/0 00000100:00100000:3.0:1713481296.491914:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125632 00000100:00100000:3.0:1713481296.491941:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485628 00000100:00100000:3.0:1713481296.491944:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2042:18716:x1796714882356800:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.491950:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.491956:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007df0db00/0xdfc0fb148a37324 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa476d1 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492006:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.492013:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492018:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492023:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.492027:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492030:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492042:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492046:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492049:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492052:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492056:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d3f7840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.492058:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492061:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492066:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.492067:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.492069:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492072:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a37332 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492083:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492086:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492089:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492092:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d3f73c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.492093:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492096:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492099:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88012ca0c100) 00010000:00010000:3.0:1713481296.492100:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.492102:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492105:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37339 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.492144:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007df0db00/0xdfc0fb148a37324 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa476d1 expref: 2043 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492149:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007df0db00/0xdfc0fb148a37324 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa476d1 expref: 2043 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492160:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007df0db00, rc 0) 00000100:00100000:3.0:1713481296.492172:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2042:18716:x1796714882356800:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 228us (423us total) trans 0 rc 301/301 00000100:00100000:3.0:1713481296.492177:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485628 00000100:00100000:3.0:1713481296.492201:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784440064 00000100:00100000:3.0:1713481296.492203:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784440064 00000100:00100000:3.0:1713481296.492214:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82807 00000100:00100000:3.0:1713481296.492216:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:15576:x1796714784440064:12345-0@lo:101:mdt00_024.0 00010000:00010000:3.0:1713481296.492224:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.492232:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3f4000/0xdfc0fb148a3734e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a37308 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492241:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3f4000/0xdfc0fb148a3734e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a37308 expref: 17 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492247:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3f4000/0xdfc0fb148a3734e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37308 expref: 17 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492255:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d8:0x0].0x0 (ffff880090b3b900) 00010000:00010000:3.0:1713481296.492257:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.492258:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d3f4000, rc 0) 00000100:00100000:3.0:1713481296.492282:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:15576:x1796714784440064:12345-0@lo:101:mdt00_024.0 Request processed in 64us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.492285:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82807 00000100:00100000:3.0:1713481296.492304:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122bafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-mdtlov_UUID:15576:1796714784440064:0@lo:101:mdt00_024.0 00010000:00010000:3.0:1713481296.492311:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007df0c240/0xdfc0fb148a37308 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3734e expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492317:0:15576:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007df0c240/0xdfc0fb148a37308 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3734e expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713481296.492328:0:15576:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880078e68a80 reply state ffff88007dce4000 transno 4295107509 ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.492333:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.492337:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22e:0x0].0x0 (ffff88007c218500) 00010000:00010000:3.0:1713481296.492338:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.492340:0:15576:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713481296.492342:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007df0c240/0xdfc0fb148a37308 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3734e expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492346:0:15576:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007df0c240/0xdfc0fb148a37308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3734e expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.492351:0:15576:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x1d8:0x0] 00000004:00010000:3.0:1713481296.492356:0:15576:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880078e68a80 reply state ffff88007dce4000 transno 4295107509 ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.492360:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.492363:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb3:0x0].0x0 (ffff88007c218b00) 00010000:00010000:3.0:1713481296.492364:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.492365:0:15576:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1713481296.492367:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cb3:0x0]: returning size 4096 00000004:00080000:3.0:1713481296.492370:0:15576:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:3.0:1713481296.492654:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134e921c0/0xdfc0fb148a3712c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37133 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492661:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134e921c0/0xdfc0fb148a3712c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37133 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492858:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880134e921c0/0xdfc0fb148a3712c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37133 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492876:0:15576:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1713481296.492880:0:15576:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:3.0:1713481296.492883:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880081e23cc0/0xdfc0fb148a3722f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xdfc0fb148a37236 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492888:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880081e23cc0/0xdfc0fb148a3722f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xdfc0fb148a37236 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.492895:0:15576:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1713481296.492924:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2042:18803:x1796714882352448:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 12998us (13045us total) trans 4295107509 rc 0/0 00000100:00100000:3.0:1713481296.492930:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485615 00000100:00100000:3.0:1713481296.492975:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784440256 00000100:00100000:3.0:1713481296.492979:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784440256 00000100:00100000:3.0:1713481296.492999:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784440320 00000100:00100000:3.0:1713481296.493002:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784440320 00010000:00010000:3.0:1713481296.493010:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008af3eac0/0xdfc0fb148a37236 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdfc0fb148a3722f expref: 18 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.493027:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98304 00000100:00100000:3.0:1713481296.493031:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+18:3490:x1796714784440256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.493037:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.493044:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090462400/0xdfc0fb148a37133 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3712c expref: 18 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493062:0:14813:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.493064:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.493103:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+17:3490:x1796714784440256:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.493109:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98304 00010000:00010000:3.0:1713481296.493155:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493161:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493166:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493169:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493177:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493181:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083220b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.493183:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493186:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493195:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493201:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083220b40/0xdfc0fb148a3723d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.493356:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800771eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2579:3491:x1796714784438016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7199us (7275us total) trans 4295960513 rc 0/0 00000100:00100000:3.0:1713481296.493362:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561795 00000100:00100000:3.0:1713481296.493406:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784440512 00000100:00100000:3.0:1713481296.493409:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784440512 00000100:00100000:3.0:1713481296.493421:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561813 00000100:00100000:3.0:1713481296.493424:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2579:3490:x1796714784440512:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.493433:0:15499:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43135 count 1 00010000:00010000:3.0:1713481296.493441:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493452:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b64d80/0xdfc0fb14868830d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21ee expref: 26694 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.493457:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.493458:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.493460:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.493470:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b64d80/0xdfc0fb14868830d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21ee expref: 26694 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.493475:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b64d80/0xdfc0fb14868830d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21ee expref: 26694 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.493481:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784440576:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.493502:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134300300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.495616:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18604:x1796714882355584:12345-192.168.202.24@tcp:37:rm.0 Request processed in 5099us (6095us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.495622:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125629 00000100:00100000:3.0:1713481296.495923:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e32f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784438848:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.495940:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880083220fc0/0xdfc0fb148a372a6 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x804f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47699 expref: 19692 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.495948:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083220fc0, rc 0) 00000100:00100000:3.0:1713481296.495963:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19692:18836:x1796714882355520:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 7163us (7351us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.495968:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561799 00000100:00100000:3.0:1713481296.495992:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784439104:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.496009:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007da54fc0/0xdfc0fb148a372b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.496300:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099988380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784439296:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.496319:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.496824:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882358144 00000100:00100000:3.0:1713481296.496829:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882358144 00000100:00100000:3.0:1713481296.496860:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561816 00000100:00100000:3.0:1713481296.496865:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19692:8499:x1796714882358144:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.496872:0:16502:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.496882:0:16502:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d3f58c0/0xdfc0fb148a373be lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47702 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.496900:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dfaf180/0xdfc0fb1488e7df1 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54a0 expref: 19693 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.496907:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.496908:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.496911:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d3f58c0/0xdfc0fb148a373be lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47702 expref: 19693 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.496929:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dfaf180/0xdfc0fb1488e7df1 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54a0 expref: 19693 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.496939:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dfaf180/0xdfc0fb1488e7df1 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54a0 expref: 19693 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.496949:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099988380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784440768:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.496972:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800803ec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.496998:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122bafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784440576:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.497018:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1713481296.499490:0:6914:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295105862 is committed 00000001:00080000:3.0:1713481296.499503:0:6914:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295105861 is committed 00000001:00080000:3.0:1713481296.499508:0:6914:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295105860 is committed 00010000:00010000:3.0:1713481296.499693:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008af3eac0/0xdfc0fb148a37236 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdfc0fb148a3722f expref: 14 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.499714:0:15497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff88008f9e3d00) 00010000:00010000:3.0:1713481296.499719:0:15497:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f9680/0xdfc0fb148a37259 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.499726:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f9680/0xdfc0fb148a37259 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.499730:0:15497:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f9680/0xdfc0fb148a37259 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.499751:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.499785:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+13:3492:x1796714784440320:12345-0@lo:103:ldlm_bl.0 Request processed in 6747us (6790us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.499791:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819876 00000100:00100000:3.0:1713481296.499829:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801209b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784440320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.499861:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784441024 00000100:00100000:3.0:1713481296.499863:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784441024 00000100:00100000:3.0:1713481296.499881:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82808 00000100:00100000:3.0:1713481296.499884:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+32:10467:x1796714784441024:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1713481296.499950:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+32:10467:x1796714784441024:12345-0@lo:1000:mdt00_005.0 Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.499955:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82808 00000100:00100000:3.0:1713481296.499978:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882357696 00000100:00100000:3.0:1713481296.499981:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882357696 00010000:00010000:3.0:1713481296.499993:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbcc0/0xdfc0fb1486882dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d218c expref: 26701 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.500007:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882358080 00000100:00100000:3.0:1713481296.500008:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882358080 00010000:00010000:3.0:1713481296.500015:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3b9440/0xdfc0fb1486882f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa87b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21b6 expref: 26703 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.500031:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819880 00000100:00100000:3.0:1713481296.500035:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25581:1959:x1796714882358016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.500041:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.500052:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121cb8b40/0xdfc0fb148916d3d lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6514 expref: 25581 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.500059:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121cb8b40/0xdfc0fb148916d3d lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6514 expref: 25581 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.500078:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121cb8b40/0xdfc0fb148916d3d lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6514 expref: 25581 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.500089:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.500090:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.500093:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c230000/0xdfc0fb148a372c9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa476a7 expref: 25580 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500100:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c230000/0xdfc0fb148a372c9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa476a7 expref: 25580 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500114:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007c230000/0xdfc0fb148a372c9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa476a7 expref: 25580 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.500137:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801209b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784441088:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.500154:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134300300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.500179:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819883 00000100:00100000:3.0:1713481296.500183:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26698:1959:x1796714882357696:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.500189:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.500192:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbcc0/0xdfc0fb1486882dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa878:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d218c expref: 26697 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.500199:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbcc0/0xdfc0fb1486882dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa878:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d218c expref: 26696 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.500216:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3bbcc0/0xdfc0fb1486882dc lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa878:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d218c expref: 26696 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.500224:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.500225:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.500227:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979c5f80/0xdfc0fb148a372ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500232:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979c5f80/0xdfc0fb148a372ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500244:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.500257:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26694:1959:x1796714882357696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.500265:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819883 00010000:00010000:3.0:1713481296.500532:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500538:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500543:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500547:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500554:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500559:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d3f7180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.500560:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500564:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500573:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500577:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d3f7180/0xdfc0fb148a37363 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa87f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.500737:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2582:3490:x1796714784440512:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7311us (7339us total) trans 4295960516 rc 0/0 00000100:00100000:3.0:1713481296.500742:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561813 00010000:00010000:3.0:1713481296.500772:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500777:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500781:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500786:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500791:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500794:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ab48480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.500796:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500799:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500808:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.500811:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ab48480/0xdfc0fb148a372c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa87a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.500922:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2583:3490:x1796714784439168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11338us (11363us total) trans 4295960519 rc 0/0 00000100:00100000:3.0:1713481296.500926:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561803 00000004:00080000:3.0:1713481296.500967:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0b8000/2, rc 0, transno 993221 00000100:00100000:3.0:1713481296.500973:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784439936:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.500984:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012405a680/2, rc 0, transno 993222 00000100:00100000:3.0:1713481296.500987:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784439680:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.500999:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784441536:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.501060:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.501080:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801202a9c00/2, rc 0, transno 993223 00000100:00100000:3.0:1713481296.501086:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784439168:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.501138:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784441728:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.501152:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.501354:0:15512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882358848 00000100:00100000:3.0:1713481296.501357:0:15512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882358848 00000100:00100000:3.0:1713481296.501377:0:15512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26091 00000100:00100000:3.0:1713481296.501381:0:15512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007573a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2043:18716:x1796714882358848:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.501401:0:15512:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.501412:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083222ac0/0xdfc0fb148a37228 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4766f expref: 2043 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.501423:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff88011f854100) 00010000:00010000:3.0:1713481296.501431:0:15512:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.501445:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.501452:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501457:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501464:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.501471:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501474:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501483:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.501486:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501489:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501527:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.501532:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501536:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00000004:00010000:3.0:1713481296.501656:0:15512:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007573a680 reply state ffff880090b19000 transno 4295107512 ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501661:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501665:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff880091f06b00) 00010000:00010000:3.0:1713481296.501681:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:3.0:1713481296.501683:0:15512:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713481296.501687:0:15512:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501692:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501695:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501698:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501701:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d3f73c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.501703:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501706:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501711:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.501712:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.501714:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501716:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f73c0/0xdfc0fb148a37427 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00000004:00010000:3.0:1713481296.501723:0:15512:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007573a680 reply state ffff880090b19000 transno 4295107512 ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501727:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501731:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88012ca0c100) 00010000:00010000:3.0:1713481296.501732:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.501734:0:15512:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:3.0:1713481296.501735:0:15512:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007573a680 reply state ffff880090b19000 transno 4295107512 ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501740:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.501743:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff880091f06d00) 00010000:00010000:3.0:1713481296.501744:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.501744:0:15512:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1713481296.501763:0:15512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007573a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2044:18716:x1796714882358848:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 381us (445us total) trans 4295107512 rc 0/0 00000100:00100000:3.0:1713481296.501767:0:15512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26091 00000100:00100000:3.0:1713481296.501794:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561829 00000100:00100000:3.0:1713481296.501798:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25581:18792:x1796714882359232:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.501803:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.501811:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007df0db00/0xdfc0fb148a3746d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc4fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4773a expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.501822:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc4fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.501829:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.501830:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.501833:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007df0db00/0xdfc0fb148a3746d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4773a expref: 25582 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.501840:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007df0db00/0xdfc0fb148a3746d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc4fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4773a expref: 25582 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.501845:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007df0db00, rc 0) 00000100:00100000:3.0:1713481296.501868:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25582:18792:x1796714882359232:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.501873:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561829 00000100:00100000:3.0:1713481296.501906:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882359360 00000100:00100000:3.0:1713481296.501910:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882359360 00000100:00100000:3.0:1713481296.501932:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882359488 00000100:00100000:3.0:1713481296.501935:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882359488 00000100:00100000:3.0:1713481296.501950:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125633 00000100:00100000:3.0:1713481296.501955:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:18678:x1796714882359360:12345-192.168.202.24@tcp:37:rm.0 00000100:00100000:3.0:1713481296.502509:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099988380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784440768:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.502526:0:16502:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d3f58c0/0xdfc0fb148a373be lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47702 expref: 19696 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.502533:0:16502:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d3f58c0, rc 0) 00000100:00100000:3.0:1713481296.502543:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+19696:8499:x1796714882358144:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5678us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.502548:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561816 00000004:00080000:3.0:1713481296.502593:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078698000/2, rc 0, transno 993224 00000100:00100000:3.0:1713481296.502597:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784440192:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.502624:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784442240:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.502640:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.502664:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784442240 00000100:00100000:3.0:1713481296.502679:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784442240 00000100:00100000:3.0:1713481296.502692:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561832 00000100:00100000:3.0:1713481296.502695:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2586:3493:x1796714784442240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.502706:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43142 count 1 00010000:00010000:3.0:1713481296.502716:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.502725:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134e3ba80/0xdfc0fb14868833e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa886:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2250 expref: 26690 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.502729:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.502730:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.502732:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.502742:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134e3ba80/0xdfc0fb14868833e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa886:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2250 expref: 26690 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.502748:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134e3ba80/0xdfc0fb14868833e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa886:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2250 expref: 26690 pid: 16493 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.502755:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784442432:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.502767:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800909a4240 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.502912:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136153100/2, rc 0, transno 993225 00000100:00100000:3.0:1713481296.502918:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784440384:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.502948:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784442496:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.502964:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.503356:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882360256 00000100:00100000:3.0:1713481296.503361:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882360256 00000100:00100000:3.0:1713481296.503384:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485639 00000100:00100000:3.0:1713481296.503388:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18580:x1796714882360256:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.503406:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.503418:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc21b00/0xdfc0fb148a36c1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x51ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47446 expref: 2192 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.503437:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51ba:0x0].0x0 (ffff8800823b3c00) 00010000:00010000:3.0:1713481296.503440:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.503449:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503455:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503460:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503467:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4f3c0/0xdfc0fb148a374dd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3834:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503470:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4f3c0/0xdfc0fb148a374dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3834:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503474:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4f3c0/0xdfc0fb148a374dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3834:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503505:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503509:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503513:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000040:00080000:3.0:1713481296.503617:0:15484:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14426, 64 off931456 00010000:00010000:3.0:1713481296.503650:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503655:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503660:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503663:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503685:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503688:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503692:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503694:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008334a640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.503696:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503699:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503703:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51ba:0x0].0x0 (ffff8800823b3c00) 00010000:00010000:3.0:1713481296.503704:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.503706:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 3/0,0 mode: --/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503712:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008334a640/0xdfc0fb148a374eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x51ba:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503729:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503732:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503735:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503738:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120173a80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.503739:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503742:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503745:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51ba:0x0].0x0 (ffff8800823b3c00) 00010000:00010000:3.0:1713481296.503746:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.503748:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503750:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880120173a80/0xdfc0fb148a374e4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x51ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503830:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503833:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503836:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503839:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503842:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079b34480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.503844:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503846:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503850:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3834:0x0].0x0 (ffff880084a2b700) 00010000:00010000:3.0:1713481296.503851:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.503853:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503855:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079b34480/0xdfc0fb148a374d6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x3834:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000004:00010000:3.0:1713481296.503862:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880079bfbb80 reply state ffff880091d50000 transno 4295105865 ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4f3c0/0xdfc0fb148a374dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3834:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503866:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4f3c0/0xdfc0fb148a374dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x3834:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.503870:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3834:0x0].0x34 (ffff880096ac7200) 00010000:00010000:3.0:1713481296.503871:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.503872:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.503898:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18580:x1796714882360256:12345-192.168.202.24@tcp:36:rm.0 Request processed in 509us (597us total) trans 4295105865 rc 0/0 00000100:00100000:3.0:1713481296.503903:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485639 00000100:00100000:3.0:1713481296.505390:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18678:x1796714882359360:12345-192.168.202.24@tcp:37:rm.0 Request processed in 3433us (3639us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.505396:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125633 00000100:00100000:3.0:1713481296.505429:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801209b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784441088:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.505445:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.505455:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25578:1959:x1796714882358016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5420us (5564us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.505460:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819880 00000100:00100000:3.0:1713481296.505523:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784442432:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.505538:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.505556:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485642 00000100:00100000:3.0:1713481296.505559:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:18818:x1796714882360576:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.505566:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.505574:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880083349d40/0xdfc0fb148a3751c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47779 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.505625:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880083348240/0xdfc0fb148a37523 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.505630:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880083348240/0xdfc0fb148a37523 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.505634:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880083348240/0xdfc0fb148a37523 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:3.0:1713481296.505699:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cb3:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.505702:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713481296.505724:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083349d40/0xdfc0fb148a3751c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47779 expref: 2047 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.505733:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880083348240/0xdfc0fb148a37523 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47779 expref: 2046 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.505738:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb3:0x0].0x0 (ffff88007c218b00) 00010000:00010000:3.0:1713481296.505739:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.505741:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083348240, rc 0) 00000100:00100000:3.0:1713481296.505757:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:18818:x1796714882360576:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 198us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.505761:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485642 00000100:00100000:3.0:1713481296.506902:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882360832 00000100:00100000:3.0:1713481296.506907:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882360832 00010000:00010000:3.0:1713481296.506921:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b658c0/0xdfc0fb148688314 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21fc expref: 26691 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.506939:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819893 00000100:00100000:3.0:1713481296.506943:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26691:1960:x1796714882360832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.506949:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.506952:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b658c0/0xdfc0fb148688314 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa880:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21fc expref: 26691 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.506960:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b658c0/0xdfc0fb148688314 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa880:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21fc expref: 26691 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.506972:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b658c0/0xdfc0fb148688314 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa880:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d21fc expref: 26691 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.506982:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.506983:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.506986:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008391a640/0xdfc0fb148a373f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.506991:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008391a640/0xdfc0fb148a373f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507005:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.507025:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26689:1960:x1796714882360832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.507030:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819893 00010000:00010000:3.0:1713481296.507051:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507057:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507061:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507065:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507069:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507076:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081e23cc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.507079:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507083:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507090:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507094:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081e23cc0/0xdfc0fb148a374ba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.507236:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2588:3493:x1796714784442240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4540us (4595us total) trans 4295960523 rc 0/0 00000100:00100000:3.0:1713481296.507241:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561832 00000004:00080000:3.0:1713481296.507266:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099988380/2, rc 0, transno 993227 00000100:00100000:3.0:1713481296.507270:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784442240:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.507303:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e55ce00/2, rc 0, transno 993226 00000100:00100000:3.0:1713481296.507306:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784441216:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.507309:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.507314:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ed38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784442880:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.507327:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.507348:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.507352:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880136151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784442944:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.507362:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.507379:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784442944 00000100:00100000:3.0:1713481296.507381:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784442944 00000100:00100000:3.0:1713481296.507393:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561838 00000100:00100000:3.0:1713481296.507396:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007956ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2589:3493:x1796714784442944:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.507405:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43145 count 1 00010000:00010000:3.0:1713481296.507414:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507422:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092181440/0xdfc0fb148688353 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d227a expref: 26686 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.507427:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.507428:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.507429:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.507439:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092181440/0xdfc0fb148688353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d227a expref: 26686 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.507444:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092181440/0xdfc0fb148688353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d227a expref: 26686 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.507451:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d256a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784443008:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.507466:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800909a4240 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.507699:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007810d880/2, rc 0, transno 993228 00000100:00100000:3.0:1713481296.507705:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784441472:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.507714:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078ce6680/2, rc 0, transno 993229 00000100:00100000:3.0:1713481296.507716:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784441280:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.507744:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.507748:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007732aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784443136:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.507763:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.507791:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784443200:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.507804:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.508085:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882361152 00000100:00100000:3.0:1713481296.508088:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882361152 00000100:00100000:3.0:1713481296.508104:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26092 00000100:00100000:3.0:1713481296.508108:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009411aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:18700:x1796714882361152:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.508136:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713481296.508146:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800849b5b00/0xdfc0fb148a37451 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47725 expref: 2388 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508159:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff880134404b00) 00010000:00010000:3.0:1713481296.508174:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083698fc0/0xdfc0fb148a3732b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa476c3 expref: 2387 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508186:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff880097db1c00) 00010000:00010000:3.0:1713481296.508191:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.508201:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.508207:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508211:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508218:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.508222:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508225:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508232:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.508235:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508238:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508271:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.508275:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508279:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508285:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.508288:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508291:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508323:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508327:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508330:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508332:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079a8b840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.508334:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508337:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508341:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff8801367b1f00) 00010000:00010000:3.0:1713481296.508342:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.508344:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508347:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8b840/0xdfc0fb148a37570 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508362:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508364:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508367:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508370:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079a88d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.508372:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508376:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508379:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff88012f283100) 00010000:00010000:3.0:1713481296.508380:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1713481296.508381:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508384:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88d80/0xdfc0fb148a37569 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508397:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508399:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508402:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508404:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079a88240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.508405:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508408:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508412:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88012f283e00) 00010000:00010000:3.0:1713481296.508413:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.508415:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508420:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079a88240/0xdfc0fb148a3755b lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508430:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508432:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508436:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508439:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508441:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079a8a400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.508442:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508445:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508448:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.508449:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.508450:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508453:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8a400/0xdfc0fb148a3754d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508460:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508463:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508466:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508469:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079a8aac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.508470:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508473:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508476:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff88012f283500) 00010000:00010000:3.0:1713481296.508477:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.508478:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.508481:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8aac0/0xdfc0fb148a37554 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.508505:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009411aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2386:18700:x1796714882361152:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 395us (446us total) trans 0 rc -39/-39 00000100:00100000:3.0:1713481296.508509:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26092 00000100:00100000:3.0:1713481296.508582:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882361280 00000100:00100000:3.0:1713481296.508585:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882361280 00010000:00010000:3.0:1713481296.508594:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120fe3600/0xdfc0fb148688337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa885:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2242 expref: 26687 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.508608:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819900 00000100:00100000:3.0:1713481296.508611:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26687:1960:x1796714882361536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.508618:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.508622:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800834e0480/0xdfc0fb148688345 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa887:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d225e expref: 26686 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.508629:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800834e0480/0xdfc0fb148688345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa887:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d225e expref: 26685 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.508642:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800834e0480/0xdfc0fb148688345 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa887:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d225e expref: 26685 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.508654:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.508655:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.508657:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a374c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa887:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508662:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a374c1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa887:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508685:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.508701:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26684:1960:x1796714882361536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.508705:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819900 00000100:00100000:3.0:1713481296.508720:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819901 00000100:00100000:3.0:1713481296.508723:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26683:1960:x1796714882361280:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.508728:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.508731:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120fe3600/0xdfc0fb148688337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa885:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2242 expref: 26683 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.508741:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120fe3600/0xdfc0fb148688337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa885:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2242 expref: 26683 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.508751:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120fe3600/0xdfc0fb148688337 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa885:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2242 expref: 26683 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.508763:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.508764:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.508766:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508771:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508790:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.508799:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26681:1960:x1796714882361280:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.508804:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819901 00010000:00010000:3.0:1713481296.508820:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508825:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508829:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508837:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508841:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508845:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e48900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.508846:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508850:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508862:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.508866:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095e48900/0xdfc0fb148a37419 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.508981:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e32f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2593:3492:x1796714784441728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7792us (7827us total) trans 4295960528 rc 0/0 00000100:00100000:3.0:1713481296.508985:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561825 00000004:00080000:3.0:1713481296.509011:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122bafb80/2, rc 0, transno 993232 00000100:00100000:3.0:1713481296.509015:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784441728:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.509036:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.509040:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784443584:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.509054:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.509073:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784443584 00000100:00100000:3.0:1713481296.509075:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784443584 00000100:00100000:3.0:1713481296.509085:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561844 00000100:00100000:3.0:1713481296.509088:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dda2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2594:3493:x1796714784443584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.509097:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43149 count 1 00010000:00010000:3.0:1713481296.509106:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509114:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800834e2400/0xdfc0fb14868836f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22b2 expref: 26680 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.509118:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509136:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509137:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509148:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800834e2400/0xdfc0fb14868836f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22b2 expref: 26680 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.509154:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800834e2400/0xdfc0fb14868836f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22b2 expref: 26680 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.509160:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784443648:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.509175:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801205cc0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.509202:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880124059500/2, rc 0, transno 993231 00000100:00100000:3.0:1713481296.509207:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784442496:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.509215:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007db8a300/2, rc 0, transno 993233 00000100:00100000:3.0:1713481296.509217:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784441536:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.509251:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.509255:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dda0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784443712:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.509274:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.509297:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784443712 00000100:00100000:3.0:1713481296.509299:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784443712 00000100:00100000:3.0:1713481296.509311:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784443776 00000100:00100000:3.0:1713481296.509313:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784443776 00000100:00100000:3.0:1713481296.509327:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561847 00000100:00100000:3.0:1713481296.509330:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2595:3491:x1796714784443776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.509338:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43151 count 1 00010000:00010000:3.0:1713481296.509346:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509354:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800834e0000/0xdfc0fb14868837d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ce expref: 26680 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.509357:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509358:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509360:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509370:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800834e0000/0xdfc0fb14868837d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ce expref: 26680 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.509376:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800834e0000/0xdfc0fb14868837d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ce expref: 26680 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.509386:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800771e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784443904:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.509398:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ce4af00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.509415:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882361472 00000100:00100000:3.0:1713481296.509417:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882361472 00010000:00010000:3.0:1713481296.509426:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d17cc0/0xdfc0fb148a16226 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0xb357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397cd expref: 24475 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.509436:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882361600 00000100:00100000:3.0:1713481296.509438:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882361600 00010000:00010000:3.0:1713481296.509445:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098576880/0xdfc0fb14891a28f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8050:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8486 expref: 25060 pid: 16469 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.509456:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819902 00000100:00100000:3.0:1713481296.509459:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24475:1960:x1796714882361472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.509464:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.509466:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d17cc0/0xdfc0fb148a16226 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0xb357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397cd expref: 24475 pid: 16480 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.509472:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d17cc0/0xdfc0fb148a16226 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397cd expref: 24475 pid: 16480 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.509483:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509484:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509486:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800849b4480/0xdfc0fb148a37466 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47733 expref: 24475 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509494:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800849b4480/0xdfc0fb148a37466 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47733 expref: 24475 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509506:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800849b4480/0xdfc0fb148a37466 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47733 expref: 24475 pid: 16537 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.509511:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784443968:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.509522:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ce4a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.509538:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819903 00000100:00100000:3.0:1713481296.509542:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+25040:1960:x1796714882361600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.509547:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.509550:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098576880/0xdfc0fb14891a28f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8050:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8486 expref: 25040 pid: 16469 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.509556:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098576880/0xdfc0fb14891a28f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8050:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8486 expref: 25040 pid: 16469 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.509571:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098576880/0xdfc0fb14891a28f lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8050:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8486 expref: 25040 pid: 16469 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.509583:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509584:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.509586:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a68fc0/0xdfc0fb148a374cf lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8050:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4776b expref: 19146 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509595:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a68fc0/0xdfc0fb148a374cf lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8050:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4776b expref: 19146 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509605:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a68fc0/0xdfc0fb148a374cf lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8050:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4776b expref: 19146 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.509610:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784444160:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.509622:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089178840 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.509636:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882361856 00000100:00100000:3.0:1713481296.509638:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882361856 00000100:00100000:3.0:1713481296.509658:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485644 00000100:00100000:3.0:1713481296.509661:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:18811:x1796714882361728:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.509686:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.509692:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8ba80/0xdfc0fb148a375d2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4779c expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509743:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.509749:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509754:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509761:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.509767:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509771:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509793:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.509797:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509800:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00200000:3.0:1713481296.509810:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c7b:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.509812:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.509819:0:15475:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509824:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509827:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509830:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509833:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509836:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120641440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.509837:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509841:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509846:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.509847:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.509849:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509852:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120641440/0xdfc0fb148a375d9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509864:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509867:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509870:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509873:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206421c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.509874:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509877:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509880:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88011f854700) 00010000:00010000:3.0:1713481296.509881:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.509882:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509885:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801206421c0/0xdfc0fb148a375e0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.509913:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079a8ba80/0xdfc0fb148a375d2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4779c expref: 2048 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509923:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4779c expref: 2047 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.509927:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88011f854b00) 00010000:00010000:3.0:1713481296.509928:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713481296.509930:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120642d00, rc 0) 00000100:00100000:3.0:1713481296.509943:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18811:x1796714882361728:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 280us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.509947:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485644 00000100:00100000:3.0:1713481296.509960:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882362176 00000100:00100000:3.0:1713481296.509962:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882362176 00000100:00100000:3.0:1713481296.509975:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485646 00000100:00100000:3.0:1713481296.509978:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18870:x1796714882362176:12345-192.168.202.24@tcp:36:lfs.0 00000100:00100000:3.0:1713481296.510024:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18870:x1796714882362176:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 45us (108us total) trans 0 rc -17/-17 00000100:00100000:3.0:1713481296.510029:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485646 00000100:00100000:3.0:1713481296.510106:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882362304 00000100:00100000:3.0:1713481296.510109:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882362304 00000100:00100000:3.0:1713481296.510140:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882362432 00000100:00100000:3.0:1713481296.510142:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882362432 00000100:00100000:3.0:1713481296.510156:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485647 00000100:00100000:3.0:1713481296.510160:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18769:x1796714882362304:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.510166:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.510173:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120643a80/0xdfc0fb148a37618 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x521d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa477d4 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510193:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880120643a80/0xdfc0fb148a37618 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x521d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477d4 expref: 2796 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510199:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880120643a80/0xdfc0fb148a37618 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x521d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477d4 expref: 2796 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510208:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x521d:0x0].0x0 (ffff88009cc58900) 00010000:00010000:3.0:1713481296.510209:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713481296.510211:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120643a80, rc 0) 00000100:00100000:3.0:1713481296.510222:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:18769:x1796714882362304:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 61us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.510226:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485647 00000100:00100000:3.0:1713481296.510240:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485649 00000100:00100000:3.0:1713481296.510243:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18578:x1796714882362496:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.510251:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.510257:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120641d40/0xdfc0fb148a3762d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa477e2 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510303:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880120640000/0xdfc0fb148a37634 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.510308:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880120640000/0xdfc0fb148a37634 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.510312:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120640000/0xdfc0fb148a37634 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000004:00200000:3.0:1713481296.510329:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385d:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.510331:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713481296.510348:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880120641d40/0xdfc0fb148a3762d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477e2 expref: 2196 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510359:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880120640000/0xdfc0fb148a37634 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477e2 expref: 2195 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510363:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88011f854800) 00010000:00010000:3.0:1713481296.510365:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.510366:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120640000, rc 0) 00000100:00100000:3.0:1713481296.510378:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2194:18578:x1796714882362496:12345-192.168.202.24@tcp:101:rm.0 Request processed in 134us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.510382:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485649 00000100:00100000:3.0:1713481296.510400:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485651 00000100:00100000:3.0:1713481296.510403:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2048:18604:x1796714882362880:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.510408:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.510414:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120640900/0xdfc0fb148a37649 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa477e9 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510460:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.510465:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510470:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510479:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.510483:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510486:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510510:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120643840/0xdfc0fb148a3766c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.510514:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120643840/0xdfc0fb148a3766c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510517:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120643840/0xdfc0fb148a3766c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000004:00200000:3.0:1713481296.510532:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c34:0x0]: returning size 0 00000004:00200000:3.0:1713481296.510533:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.510539:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880120643840/0xdfc0fb148a3766c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510543:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120643840/0xdfc0fb148a3766c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510547:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510551:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510554:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510560:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510563:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120642880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.510564:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510567:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510572:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x0 (ffff88011f854900) 00010000:00010000:3.0:1713481296.510573:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.510574:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 3/0,0 mode: --/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510577:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120642880/0xdfc0fb148a3765e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510585:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510588:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510591:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510594:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120642640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.510595:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510598:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510604:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x3831 (ffff88011f854400) 00010000:00010000:3.0:1713481296.510605:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.510607:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510609:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120642640/0xdfc0fb148a37665 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.510631:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120640900/0xdfc0fb148a37649 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477e9 expref: 2050 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510644:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880120643840/0xdfc0fb148a3766c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477e9 expref: 2049 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.510647:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c34:0x0].0x0 (ffff88008ad70600) 00010000:00010000:3.0:1713481296.510649:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.510650:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120643840, rc 0) 00000100:00100000:3.0:1713481296.510662:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2049:18604:x1796714882362880:12345-192.168.202.24@tcp:101:rm.0 Request processed in 258us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.510682:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485651 00000100:00100000:3.0:1713481296.510704:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882362816 00000100:00100000:3.0:1713481296.510706:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882362816 00000100:00100000:3.0:1713481296.510717:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125635 00000100:00100000:3.0:1713481296.510720:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2049:18678:x1796714882362816:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:3.0:1713481296.510781:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18678:x1796714882362816:12345-192.168.202.24@tcp:35:rm.0 Request processed in 60us (472us total) trans 4295107514 rc 0/0 00000100:00100000:3.0:1713481296.510786:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125635 00000100:00100000:3.0:1713481296.511206:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16553:1796714784442624:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.511225:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.511237:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1959:x1796714882360000:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7927us (7983us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.511241:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819891 00000100:00100000:3.0:1713481296.511636:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d256a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784443008:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.511651:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.511843:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882363200 00000100:00100000:3.0:1713481296.511846:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882363200 00010000:00010000:3.0:1713481296.511856:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092181440/0xdfc0fb148688353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d227a expref: 26683 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.511869:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819905 00000100:00100000:3.0:1713481296.511873:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009421b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26683:1959:x1796714882363200:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.511877:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.511880:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092181440/0xdfc0fb148688353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa889:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d227a expref: 26683 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.511886:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092181440/0xdfc0fb148688353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa889:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d227a expref: 26683 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.511896:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092181440/0xdfc0fb148688353 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa889:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d227a expref: 26683 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.511907:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.511908:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.511910:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511915:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511928:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.511945:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009421b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26683:1959:x1796714882363200:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.511949:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819905 00010000:00010000:3.0:1713481296.511965:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511970:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511974:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511978:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511982:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511989:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083348fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.511991:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.511994:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.512001:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.512005:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083348fc0/0xdfc0fb148a37531 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.512113:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007956ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2597:3493:x1796714784442944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4715us (4748us total) trans 4295960530 rc 0/0 00000100:00100000:3.0:1713481296.512117:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561838 00000004:00080000:3.0:1713481296.512156:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136151880/2, rc 0, transno 993234 00000100:00100000:3.0:1713481296.512161:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784442944:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.512235:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.512239:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784444608:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.512256:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.512279:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784444608 00000100:00100000:3.0:1713481296.512282:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784444608 00000100:00100000:3.0:1713481296.512292:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561857 00000100:00100000:3.0:1713481296.512294:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2597:3493:x1796714784444608:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.512304:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43153 count 1 00010000:00010000:3.0:1713481296.512314:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.512322:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d273c0/0xdfc0fb14868838b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa891:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ea expref: 26680 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.512327:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.512328:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.512330:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.512340:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d273c0/0xdfc0fb14868838b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa891:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ea expref: 26680 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.512345:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d273c0/0xdfc0fb14868838b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa891:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ea expref: 26680 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.512351:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784444736:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.512365:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.512377:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882363328 00000100:00100000:3.0:1713481296.512379:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882363328 00010000:00010000:3.0:1713481296.512387:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800834e2d00/0xdfc0fb14868835a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2288 expref: 26681 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.512408:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819907 00000100:00100000:3.0:1713481296.512411:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26681:1960:x1796714882363328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.512418:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.512421:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800834e2d00/0xdfc0fb14868835a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2288 expref: 26681 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.512426:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800834e2d00/0xdfc0fb14868835a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa88a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2288 expref: 26681 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.512437:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800834e2d00/0xdfc0fb14868835a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa88a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2288 expref: 26681 pid: 16488 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.512449:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.512450:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.512452:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929fa1c0/0xdfc0fb148a3753f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.512457:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929fa1c0/0xdfc0fb148a3753f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa88a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.512474:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.512495:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26680:1960:x1796714882363328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.512499:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819907 00000004:00080000:3.0:1713481296.512644:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007732aa00/2, rc 0, transno 993236 00000100:00100000:3.0:1713481296.512656:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007732aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784443136:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.512714:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784444800:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.512732:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.513564:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882363648 00000100:00100000:3.0:1713481296.513568:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882363648 00000100:00100000:3.0:1713481296.513588:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882363520 00000100:00100000:3.0:1713481296.513590:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882363520 00000100:00100000:3.0:1713481296.513605:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485653 00000100:00100000:3.0:1713481296.513608:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2387:18711:x1796714882363520:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.513615:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.513622:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a640/0xdfc0fb148a37696 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47805 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.513686:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.513692:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513697:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513704:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.513708:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513712:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513725:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513728:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513734:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513737:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513740:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e59b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.513742:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513745:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513749:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.513750:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.513752:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513755:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e59b00/0xdfc0fb148a376a4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513764:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513767:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513770:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513773:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e5af40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.513775:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513781:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513784:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x34 (ffff88011f854200) 00010000:00010000:3.0:1713481296.513785:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.513786:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513789:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5af40/0xdfc0fb148a376ab lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.513814:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a640/0xdfc0fb148a37696 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47805 expref: 2388 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.513824:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a640/0xdfc0fb148a37696 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47805 expref: 2388 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.513830:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095e5a640, rc 0) 00000100:00100000:3.0:1713481296.513845:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2387:18711:x1796714882363520:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 236us (274us total) trans 0 rc 301/301 00000100:00100000:3.0:1713481296.513849:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485653 00000100:00100000:3.0:1713481296.514212:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784443968:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.514241:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.514256:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24475:1960:x1796714882361472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4796us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.514261:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819902 00000100:00100000:3.0:1713481296.514336:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784443648:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.514351:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.514373:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800771e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784443904:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.514385:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.514401:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784444160:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.514416:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.514432:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24779:1960:x1796714882361600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4890us (5193us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.514436:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819903 00000100:00100000:3.0:1713481296.514473:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.514513:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.514555:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485655 00000100:00100000:3.0:1713481296.514559:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18651:x1796714882363776:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.514566:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.514573:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5b600/0xdfc0fb148a376dc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4781a expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.514623:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.514628:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514633:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514641:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.514645:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514649:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514658:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514661:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514664:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514683:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514686:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e58d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.514688:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514691:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514695:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.514696:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.514698:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514701:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58d80/0xdfc0fb148a376f1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514712:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514716:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514719:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514721:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e5bcc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.514722:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514725:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514728:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3031 (ffff88011f854300) 00010000:00010000:3.0:1713481296.514729:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.514730:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514733:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5bcc0/0xdfc0fb148a376f8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.514756:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5b600/0xdfc0fb148a376dc lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4781a expref: 2052 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.514760:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5b600/0xdfc0fb148a376dc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4781a expref: 2052 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.514766:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095e5b600, rc 0) 00000100:00100000:3.0:1713481296.514781:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18651:x1796714882363776:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 222us (267us total) trans 0 rc 301/301 00000100:00100000:3.0:1713481296.514786:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485655 00000100:00100000:3.0:1713481296.514819:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784444736:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.514836:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.526407:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882363968 00000100:00100000:3.0:1713481296.526413:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882363968 00010000:00010000:3.0:1713481296.526430:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921806c0/0xdfc0fb148688376 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22c0 expref: 26676 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.526445:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819912 00000100:00100000:3.0:1713481296.526449:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076aff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26676:1957:x1796714882363968:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.526456:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.526459:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800921806c0/0xdfc0fb148688376 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22c0 expref: 26676 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526466:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921806c0/0xdfc0fb148688376 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa88e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22c0 expref: 26676 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526479:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921806c0/0xdfc0fb148688376 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa88e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22c0 expref: 26676 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526488:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526489:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526491:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929f9b00/0xdfc0fb148a3758c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526500:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929f9b00/0xdfc0fb148a3758c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa88e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526517:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.526537:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076aff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26676:1957:x1796714882363968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 87us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.526542:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819912 00000100:00100000:3.0:1713481296.526555:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819913 00000100:00100000:3.0:1713481296.526559:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076affb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24472:1957:x1796714882364096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.526564:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.526568:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dae7cc0/0xdfc0fb148942221 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e0070 expref: 24472 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526575:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dae7cc0/0xdfc0fb148942221 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e0070 expref: 24472 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526587:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dae7cc0/0xdfc0fb148942221 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e0070 expref: 24472 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526596:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526597:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526599:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dd97840/0xdfc0fb148a375cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477b8 expref: 26676 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526604:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dd97840/0xdfc0fb148a375cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477b8 expref: 26676 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526618:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007dd97840/0xdfc0fb148a375cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477b8 expref: 26676 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.526626:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083a97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784445376:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.526644:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.526661:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819915 00000100:00100000:3.0:1713481296.526676:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26675:1957:x1796714882364352:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.526682:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.526686:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092181b00/0xdfc0fb148688384 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa890:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22dc expref: 26675 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526693:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092181b00/0xdfc0fb148688384 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa890:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22dc expref: 26675 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526705:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092181b00/0xdfc0fb148688384 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa890:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22dc expref: 26674 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526712:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526713:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526716:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f933840/0xdfc0fb148a37681 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa890:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526720:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f933840/0xdfc0fb148a37681 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa890:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526738:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.526751:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26674:1957:x1796714882364352:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.526756:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819915 00000100:00100000:3.0:1713481296.526795:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.526808:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882364032 00000100:00100000:3.0:1713481296.526810:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882364032 00010000:00010000:3.0:1713481296.526819:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800834e0000/0xdfc0fb14868837d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ce expref: 26673 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.526829:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819917 00000100:00100000:3.0:1713481296.526832:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dda1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26673:1957:x1796714882364032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.526837:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.526839:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800834e0000/0xdfc0fb14868837d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ce expref: 26673 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526845:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800834e0000/0xdfc0fb14868837d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ce expref: 26673 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526856:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800834e0000/0xdfc0fb14868837d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22ce expref: 26672 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.526867:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526867:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.526869:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526874:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526884:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.526909:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dda1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26671:1957:x1796714882364032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.526914:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819917 00010000:00010000:3.0:1713481296.526933:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526938:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526942:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526946:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526950:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526953:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079a89440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.526955:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526963:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526971:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.526974:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079a89440/0xdfc0fb148a37593 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa88f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.527137:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2602:3491:x1796714784443776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17788us (17821us total) trans 4295960536 rc 0/0 00000100:00100000:3.0:1713481296.527142:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561847 00000100:00100000:3.0:1713481296.527159:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784445504 00000100:00100000:3.0:1713481296.527161:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784445504 00000100:00100000:3.0:1713481296.527179:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561861 00000100:00100000:3.0:1713481296.527182:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2602:3492:x1796714784445504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.527193:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43157 count 1 00010000:00010000:3.0:1713481296.527203:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527212:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007960f180/0xdfc0fb1486883a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa895:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2322 expref: 26670 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.527216:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.527217:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.527219:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527231:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007960f180/0xdfc0fb1486883a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa895:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2322 expref: 26670 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.527239:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007960f180/0xdfc0fb1486883a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa895:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2322 expref: 26670 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.527246:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784445632:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.527262:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089178840 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.527281:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527287:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527291:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527295:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527299:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527302:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079a886c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.527304:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527308:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527320:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527324:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079a886c0/0xdfc0fb148a3757e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa88d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.527436:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dda2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2604:3493:x1796714784443584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 18346us (18380us total) trans 4295960538 rc 0/0 00000100:00100000:3.0:1713481296.527442:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561844 00000100:00100000:3.0:1713481296.527464:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561863 00000100:00100000:3.0:1713481296.527467:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2603:3491:x1796714784445568:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.527477:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43158 count 1 00010000:00010000:3.0:1713481296.527485:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527493:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092181d40/0xdfc0fb1486883ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa896:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2330 expref: 26669 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.527497:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.527498:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.527500:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527514:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092181d40/0xdfc0fb1486883ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa896:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2330 expref: 26669 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.527522:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092181d40/0xdfc0fb1486883ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa896:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2330 expref: 26669 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.527528:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084874380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784445888:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.527539:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801205cc0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.527560:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a2a1180/2, rc 0, transno 993242 00000100:00100000:3.0:1713481296.527567:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784443584:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.527581:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527586:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527590:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527594:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527597:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527604:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f936ac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.527606:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527610:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527620:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527623:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f936ac0/0xdfc0fb148a37688 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.527745:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2605:3493:x1796714784444608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15449us (15487us total) trans 4295960539 rc 0/0 00000100:00100000:3.0:1713481296.527750:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561857 00000004:00080000:3.0:1713481296.527776:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099806300/2, rc 0, transno 993243 00000100:00100000:3.0:1713481296.527783:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784444608:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.527811:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007994c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784446080:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.527894:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.527929:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819921 00000100:00100000:3.0:1713481296.527936:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26671:1957:x1796714882364608:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.527943:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.527946:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092181f80/0xdfc0fb148688399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa893:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2306 expref: 26671 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.527953:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092181f80/0xdfc0fb148688399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa893:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2306 expref: 26671 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.527968:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092181f80/0xdfc0fb148688399 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa893:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2306 expref: 26671 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.527976:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.527977:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.527979:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f98af40/0xdfc0fb148a376ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa893:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527984:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f98af40/0xdfc0fb148a376ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa893:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.527996:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.528008:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26669:1957:x1796714882364608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.528012:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819921 00000100:00100000:3.0:1713481296.528083:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.528108:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.528117:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882364928 00000100:00100000:3.0:1713481296.528135:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882364928 00000100:00100000:3.0:1713481296.528149:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882364992 00000100:00100000:3.0:1713481296.528150:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882364992 00000100:00100000:3.0:1713481296.528159:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485658 00000100:00100000:3.0:1713481296.528162:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2052:18651:x1796714882364928:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.528171:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.528181:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58b40/0xdfc0fb148a3773e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4782f expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528237:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.528243:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528249:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000004:00200000:3.0:1713481296.528266:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.528268:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.528277:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528292:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e58b40/0xdfc0fb148a3773e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4782f expref: 2054 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528312:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4782f expref: 2053 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528317:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.528319:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.528320:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095e5a880, rc 0) 00000100:00100000:3.0:1713481296.528332:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2053:18651:x1796714882364928:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 168us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.528336:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485658 00000100:00100000:3.0:1713481296.528349:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485659 00000100:00100000:3.0:1713481296.528353:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2052:18728:x1796714882364992:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.528358:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.528363:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e48d80/0xdfc0fb148a37753 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47836 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528409:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.528414:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528418:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528423:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.528428:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528431:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528462:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963f9680/0xdfc0fb148a37768 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.528465:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800963f9680/0xdfc0fb148a37768 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528469:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800963f9680/0xdfc0fb148a37768 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000004:00200000:3.0:1713481296.528482:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2caf:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.528484:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.528489:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800963f9680/0xdfc0fb148a37768 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528494:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528498:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528501:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528504:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528506:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e49440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.528508:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528511:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528515:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.528516:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.528518:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528521:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e49440/0xdfc0fb148a3775a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528530:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528533:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528539:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528542:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e4b180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.528543:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528546:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528549:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff8800941fc300) 00010000:00010000:3.0:1713481296.528551:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.528552:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528555:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e4b180/0xdfc0fb148a37761 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.528573:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e48d80/0xdfc0fb148a37753 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47836 expref: 2054 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528583:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800963f9680/0xdfc0fb148a37768 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47836 expref: 2053 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528587:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009285f800) 00010000:00010000:3.0:1713481296.528588:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.528589:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800963f9680, rc 0) 00000100:00100000:3.0:1713481296.528601:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2053:18728:x1796714882364992:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 247us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.528605:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485659 00000100:00100000:3.0:1713481296.528712:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.528726:0:15512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882365376 00000100:00100000:3.0:1713481296.528728:0:15512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882365376 00000100:00100000:3.0:1713481296.528742:0:15512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26093 00000100:00100000:3.0:1713481296.528745:0:15512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2053:18818:x1796714882365376:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.528764:0:15512:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.528773:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083348240/0xdfc0fb148a37523 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47779 expref: 2053 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528785:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb3:0x0].0x0 (ffff88007c218b00) 00010000:00010000:3.0:1713481296.528787:0:15512:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.528813:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.528817:0:15512:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.528823:0:15512:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15512 initiator: MDT1 00000100:00100000:3.0:1713481296.528830:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784446528:0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713481296.528851:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.528863:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.528882:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882365248 00000100:00100000:3.0:1713481296.528885:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882365248 00000100:00100000:3.0:1713481296.528902:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882365184 00000100:00100000:3.0:1713481296.528904:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882365184 00000100:00100000:3.0:1713481296.528917:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98306 00000100:00100000:3.0:1713481296.528920:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2191:1958:x1796714882365248:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:3.0:1713481296.528926:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.528935:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fc22880/0xdfc0fb148a36fd5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47581 expref: 2191 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.528948:0:16520:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00010000:00010000:3.0:1713481296.528950:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.528958:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2191:1958:x1796714882365248:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.528963:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98306 00000100:00100000:3.0:1713481296.528975:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98307 00000100:00100000:3.0:1713481296.528980:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007812fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2190:1958:x1796714882365184:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:3.0:1713481296.528984:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.528991:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f8240/0xdfc0fb148a373ef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47676 expref: 2190 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.529003:0:16520:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb3:0x0].0x0 (ffff880135da2200) 00010000:00010000:3.0:1713481296.529011:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.529019:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007812fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2189:1958:x1796714882365184:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.529023:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98307 00000100:00100000:3.0:1713481296.529044:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485662 00000100:00100000:3.0:1713481296.529047:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18831:x1796714882365696:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.529057:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.529062:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008af3fa80/0xdfc0fb148a377ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47860 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.529112:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529135:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529140:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529150:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529154:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529157:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529187:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007da54fc0/0xdfc0fb148a377c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529192:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007da54fc0/0xdfc0fb148a377c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529196:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007da54fc0/0xdfc0fb148a377c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000004:00200000:3.0:1713481296.529245:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51f8:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.529247:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1713481296.529255:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007da54fc0/0xdfc0fb148a377c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529260:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529263:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529269:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529273:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529275:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083628000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.529276:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529279:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529283:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.529284:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.529286:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529289:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083628000/0xdfc0fb148a377b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529299:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529302:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529305:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529308:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124a4d440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.529310:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529315:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529319:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x34 (ffff880092dc3f00) 00010000:00010000:3.0:1713481296.529320:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.529322:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529324:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124a4d440/0xdfc0fb148a377bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.529354:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008af3fa80/0xdfc0fb148a377ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47860 expref: 2794 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.529364:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007da54fc0/0xdfc0fb148a377c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51f8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47860 expref: 2793 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.529367:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f8:0x0].0x0 (ffff8801349f1b00) 00010000:00010000:3.0:1713481296.529368:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.529370:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007da54fc0, rc 0) 00000100:00100000:3.0:1713481296.529381:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18831:x1796714882365696:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 334us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.529386:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485662 00000100:00100000:3.0:1713481296.529432:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882365760 00000100:00100000:3.0:1713481296.529434:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882365760 00000100:00100000:3.0:1713481296.529446:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882365888 00000100:00100000:3.0:1713481296.529448:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882365888 00010000:00010000:3.0:1713481296.529456:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007960c6c0/0xdfc0fb148688392 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa892:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22f8 expref: 26668 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.529471:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819923 00000100:00100000:3.0:1713481296.529474:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26668:1958:x1796714882365888:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.529479:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.529482:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007960c6c0/0xdfc0fb148688392 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa892:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22f8 expref: 26668 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.529488:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007960c6c0/0xdfc0fb148688392 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa892:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22f8 expref: 26668 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.529502:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007960c6c0/0xdfc0fb148688392 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa892:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d22f8 expref: 26668 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.529513:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.529514:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.529517:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008368a1c0/0xdfc0fb148a3768f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa892:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.529521:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008368a1c0/0xdfc0fb148a3768f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa892:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.529533:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.529543:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26667:1958:x1796714882365888:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.529547:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819923 00000100:00100000:3.0:1713481296.529640:0:16612:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882365440 00000100:00100000:3.0:1713481296.529643:0:16612:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882365440 00002000:00010000:3.0:1713481296.529662:0:16612:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161096/15352 (0->18446744073709551615) 00002000:00100000:3.0:1713481296.529678:0:16612:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800773d0700 with x1796714882365440 ext(0->18446744073709551615) 00002000:00010000:3.0:1713481296.529684:0:16612:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800773d0700. 00000100:00100000:3.0:1713481296.529698:0:16612:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 376552 00000100:00100000:3.0:1713481296.529701:0:16612:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800773d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_042:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24473:1960:x1796714882365440:12345-192.168.202.24@tcp:10:dir_create.sh.0 00002000:00010000:3.0:1713481296.529794:0:16612:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000408:0x3bf8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1713481296.529796:0:16612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000408:0x3bf8:0x0] updating lvb mtime from disk: 0 -> 1713481295 00002000:00010000:3.0:1713481296.529798:0:16612:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000408:0x3bf8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713481296.529799:0:16612:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000408:0x3bf8:0x0] updating lvb ctime from disk: 0 -> 1713481295 00002000:00010000:3.0:1713481296.529800:0:16612:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000408:0x3bf8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1713481296.529812:0:16612:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800773d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_042:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24474:1960:x1796714882365440:12345-192.168.202.24@tcp:10:dir_create.sh.0 Request processed in 110us (204us total) trans 4295960543 rc 0/0 00000100:00100000:3.0:1713481296.529816:0:16612:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 376552 00002000:00010000:3.0:1713481296.529818:0:16612:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161096/15352 (0->18446744073709551615) 00002000:00100000:3.0:1713481296.529820:0:16612:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800773d0700 with x1796714882365440 ext(0->18446744073709551615) 00002000:00010000:3.0:1713481296.529822:0:16612:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800773d0700. 00000100:00100000:3.0:1713481296.529849:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882366144 00000100:00100000:3.0:1713481296.529852:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882366144 00000100:00100000:3.0:1713481296.529872:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125636 00000100:00100000:3.0:1713481296.529875:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2189:18580:x1796714882366144:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:3.0:1713481296.529947:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2190:18580:x1796714882366144:12345-192.168.202.24@tcp:35:rm.0 Request processed in 71us (135us total) trans 4295105869 rc 0/0 00000100:00100000:3.0:1713481296.529952:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125636 00000100:00100000:3.0:1713481296.530048:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.530061:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882366528 00000100:00100000:3.0:1713481296.530064:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882366528 00000100:00100000:3.0:1713481296.530076:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485664 00000100:00100000:3.0:1713481296.530079:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2053:18678:x1796714882366528:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.530091:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.530098:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800830bf600/0xdfc0fb148a377df lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4787c expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.530192:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800830bef40/0xdfc0fb148a377ed lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.530200:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800830bef40/0xdfc0fb148a377ed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.530207:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800830bef40/0xdfc0fb148a377ed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000004:00200000:3.0:1713481296.530215:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c5b:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.530275:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800830bf600/0xdfc0fb148a377df lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4787c expref: 2056 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.530292:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800830bef40/0xdfc0fb148a377ed lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c5b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4787c expref: 2055 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.530298:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c5b:0x0].0x0 (ffff880091937400) 00010000:00010000:3.0:1713481296.530300:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1713481296.530303:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800830bef40, rc 0) 00000100:00100000:3.0:1713481296.530328:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2055:18678:x1796714882366528:12345-192.168.202.24@tcp:101:rm.0 Request processed in 247us (279us total) trans 4295107517 rc 0/0 00000100:00100000:3.0:1713481296.530335:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485664 00000100:00100000:3.0:1713481296.530372:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083a97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784445376:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.530390:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.530405:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076affb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24473:1957:x1796714882364096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3844us (3937us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.530411:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819913 00000100:00100000:3.0:1713481296.530495:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784446528:0@lo:101:mdt_io00_007.0 00010000:00010000:3.0:1713481296.530506:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a377e6 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.530512:0:15512:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a377e6 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.530533:0:15512:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1713481296.530617:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800830bfa80/0xdfc0fb148a37817 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.530621:0:15512:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800830bfa80/0xdfc0fb148a37817 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.530625:0:15512:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800830bfa80/0xdfc0fb148a37817 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15512 initiator: MDT1 00000100:00100000:3.0:1713481296.530632:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784446912:0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713481296.530664:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.530691:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.530703:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882366400 00000100:00100000:3.0:1713481296.530705:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882366400 00000100:00100000:3.0:1713481296.530725:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485665 00000100:00100000:3.0:1713481296.530729:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2055:18604:x1796714882366400:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.530746:0:10467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1713481296.530755:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120643840/0xdfc0fb148a3766c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477e9 expref: 2055 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.530773:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800905e3a80/0xdfc0fb148a06f3a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa33f20 expref: 2054 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.530788:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c34:0x0].0x0 (ffff88008ad70600) 00010000:00010000:3.0:1713481296.530806:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008cfad8c0/0xdfc0fb148a370ca lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1d5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa475f1 expref: 2053 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.530821:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x0 (ffff88011f854900) 00010000:00010000:3.0:1713481296.530828:0:10467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.530839:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.530844:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.530848:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.530855:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1d5:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.530858:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.530861:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.530886:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.530890:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.530894:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000040:00080000:3.0:1713481296.531014:0:10467:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31879, 64 off2048448 00010000:00010000:3.0:1713481296.531038:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.531042:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531046:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531050:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531054:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531057:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531060:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531062:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986b5200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.531064:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531067:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531072:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c34:0x0].0x0 (ffff8800891aca00) 00010000:00010000:3.0:1713481296.531073:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.531075:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 3/0,0 mode: --/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531078:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b5200/0xdfc0fb148a37841 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2c34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531097:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531099:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531102:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531105:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986b58c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.531106:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531109:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531113:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c34:0x0].0x0 (ffff8800891aca00) 00010000:00010000:3.0:1713481296.531114:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.531115:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531133:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b58c0/0xdfc0fb148a3783a lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531224:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531228:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531231:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531234:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531236:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133bf9f80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.531238:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531241:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531245:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x0 (ffff8801344b6800) 00010000:00010000:3.0:1713481296.531246:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.531247:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 3/0,0 mode: --/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531250:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133bf9f80/0xdfc0fb148a3782c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000004:00010000:3.0:1713481296.531267:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880076af5c00 reply state ffff88009a4b8000 transno 4295107518 ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531272:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531275:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x3831 (ffff88012bb55800) 00010000:00010000:3.0:1713481296.531276:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.531278:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.531298:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2054:18604:x1796714882366400:12345-192.168.202.24@tcp:36:rm.0 Request processed in 568us (805us total) trans 4295107518 rc 0/0 00000100:00100000:3.0:1713481296.531303:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485665 00000100:00100000:3.0:1713481296.531332:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784446912:0@lo:101:mdt_io00_007.0 00010000:00010000:3.0:1713481296.531340:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800830bfa80/0xdfc0fb148a37817 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3781e expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.531345:0:15512:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800830bfa80/0xdfc0fb148a37817 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3781e expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.531355:0:15512:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:3.0:1713481296.531368:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800986b4900/0xdfc0fb148a37856 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.531371:0:15512:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800986b4900/0xdfc0fb148a37856 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.531375:0:15512:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800986b4900/0xdfc0fb148a37856 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15512 initiator: MDT1 00000100:00100000:3.0:1713481296.531381:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784447232:0@lo:101:mdt_io00_007.0 00000100:00100000:3.0:1713481296.531397:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.531417:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.531433:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ee28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784445632:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.531453:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.531465:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882366976 00000100:00100000:3.0:1713481296.531467:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882366976 00000100:00100000:3.0:1713481296.531480:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485666 00000100:00100000:3.0:1713481296.531483:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2054:18811:x1796714882366976:12345-192.168.202.24@tcp:36:dir_create.sh.0 00010000:00010000:3.0:1713481296.531498:0:10467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.531507:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800908ae880/0xdfc0fb148a24f5b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c83:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3f5ba expref: 2054 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.531524:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c83:0x0].0x0 (ffff880092aae500) 00010000:00010000:3.0:1713481296.531526:0:10467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.531608:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.531613:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531617:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000001:00080000:3.0:1713481296.531632:0:10467:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4295107519 00000004:00010000:3.0:1713481296.531643:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880076a5b480 reply state ffff88009bb8a000 transno 4295107520 ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531648:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.531652:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c83:0x0].0x0 (ffff880092aae500) 00010000:00010000:3.0:1713481296.531653:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.531654:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.531694:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2056:18811:x1796714882366976:12345-192.168.202.24@tcp:36:dir_create.sh.0 Request processed in 209us (309us total) trans 4295107520 rc 0/0 00000100:00100000:3.0:1713481296.531697:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485666 00000020:00080000:3.0:1713481296.531700:0:10467:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1713481296.531726:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084874380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784445888:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.531748:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.531765:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882367040 00000100:00100000:3.0:1713481296.531768:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882367040 00000100:00100000:3.0:1713481296.531788:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485667 00000100:00100000:3.0:1713481296.531791:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:18723:x1796714882367040:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:3.0:1713481296.531797:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.531803:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27180/0xdfc0fb148a3786b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa478a6 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.531830:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.531835:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531840:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531845:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.531849:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531852:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531873:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.531879:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531883:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000004:00200000:3.0:1713481296.531892:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2caf:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.531893:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.531898:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531902:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531905:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531909:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531911:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531914:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078c25d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.531915:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531918:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531922:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.531923:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.531924:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531928:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078c25d40/0xdfc0fb148a37872 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531943:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531946:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531949:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531952:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098542d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.531953:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531956:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531959:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff8800941fc300) 00010000:00010000:3.0:1713481296.531960:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.531961:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531964:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098542d00/0xdfc0fb148a37879 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.531985:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27180/0xdfc0fb148a3786b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478a6 expref: 2390 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.531996:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478a6 expref: 2389 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532003:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009285f800) 00010000:00010000:3.0:1713481296.532004:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.532005:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098543a80, rc 0) 00000100:00100000:3.0:1713481296.532021:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2389:18723:x1796714882367040:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 229us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.532024:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485667 00000100:00100000:3.0:1713481296.532053:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784447232:0@lo:101:mdt_io00_007.0 00010000:00010000:3.0:1713481296.532061:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800986b4900/0xdfc0fb148a37856 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3785d expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532066:0:15512:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800986b4900/0xdfc0fb148a37856 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3785d expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.532077:0:15512:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:3.0:1713481296.532097:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784447296:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713481296.532115:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.532142:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801205cc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.532153:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882368384 00000100:00100000:3.0:1713481296.532155:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882368384 00000100:00100000:3.0:1713481296.532167:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485668 00000100:00100000:3.0:1713481296.532171:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2056:18753:x1796714882368384:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.532177:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.532178:0:10467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713481296.532184:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800963f9680/0xdfc0fb148a37768 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47836 expref: 2056 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532198:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009285f800) 00010000:00010000:3.0:1713481296.532200:0:10467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.532205:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c000/0xdfc0fb148a37887 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa478bb expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532265:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.532271:0:10467:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478a6 expref: 2388 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532275:0:10467:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 4/0,1 mode: --/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.532286:0:10467:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478a6 expref: 2388 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532291:0:10467:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478a6 expref: 2388 pid: 15483 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.532298:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:10467:1796714784447360:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.532317:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ce4af00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.532331:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882367744 00000100:00100000:3.0:1713481296.532333:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882367744 00000100:00100000:3.0:1713481296.532347:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26094 00000100:00100000:3.0:1713481296.532350:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2389:18831:x1796714882367744:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.532363:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.532372:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092bbb180/0xdfc0fb148a2ed83 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42bf3 expref: 2389 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532390:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00010000:00010000:3.0:1713481296.532392:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.532407:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2d1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784447424:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.532425:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.532438:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e7fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.532547:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784447296:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713481296.532587:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120090e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784447488:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713481296.532600:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.532610:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.532626:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2d1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784447424:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.532657:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.532661:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.532679:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.532686:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2d1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784447552:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.532702:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.532718:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ce4a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.532758:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.532848:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.532878:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120090e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784447488:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713481296.532921:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001-mdtlov_UUID:15512:1796714784447616:0@lo:1000:mdt_io00_007.0 00000100:00100000:3.0:1713481296.532946:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.532965:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801205cc0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.532980:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532988:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.532996:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533001:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533008:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533013:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e598c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.533016:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533022:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533035:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533045:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095e598c0/0xdfc0fb148a3771b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.533226:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2609:3492:x1796714784445504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6040us (6073us total) trans 4295960544 rc 0/0 00000100:00100000:3.0:1713481296.533233:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561861 00000004:00080000:3.0:1713481296.533269:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086f04a80/2, rc 0, transno 993248 00000100:00100000:3.0:1713481296.533278:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784445504:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.533296:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533304:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533311:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533317:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533323:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533329:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095e5ba80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.533332:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533339:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533353:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533360:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095e5ba80/0xdfc0fb148a37729 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.533430:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882367296 00000100:00100000:3.0:1713481296.533434:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882367296 00010000:00010000:3.0:1713481296.533446:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800832318c0/0xdfc0fb1486883bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa898:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d234c expref: 26664 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.533474:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882367488 00000100:00100000:3.0:1713481296.533477:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882367488 00010000:00010000:3.0:1713481296.533489:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc3dd40/0xdfc0fb14891a464 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8504 expref: 22192 pid: 9203 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.533505:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819930 00000100:00100000:3.0:1713481296.533510:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+22192:1959:x1796714882367488:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.533518:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.533523:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc3dd40/0xdfc0fb14891a464 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8504 expref: 22192 pid: 9203 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.533533:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc3dd40/0xdfc0fb14891a464 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8504 expref: 22192 pid: 9203 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.533556:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc3dd40/0xdfc0fb14891a464 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8051:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8504 expref: 22192 pid: 9203 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.533573:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.533575:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.533579:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801237ceac0/0xdfc0fb148a37776 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4783d expref: 16963 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533587:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801237ceac0/0xdfc0fb148a37776 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4783d expref: 16960 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.533609:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801237ceac0/0xdfc0fb148a37776 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8051:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4783d expref: 16950 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.533619:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784447936:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.533640:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c0eb600 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.533662:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.533688:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784447872:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.533813:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2611:3491:x1796714784445568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6343us (6501us total) trans 4295960546 rc 0/0 00000100:00100000:3.0:1713481296.533821:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561863 00000100:00100000:3.0:1713481296.534191:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.534224:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120beaa00/2, rc 0, transno 993251 00000100:00100000:3.0:1713481296.534232:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784445952:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.534279:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784448256:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.534301:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.534340:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882368128 00000100:00100000:3.0:1713481296.534344:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882368128 00010000:00010000:3.0:1713481296.534357:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5200/0xdfc0fb148959ab5 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb21 expref: 16712 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.534375:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819932 00000100:00100000:3.0:1713481296.534380:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16705:1959:x1796714882368128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.534387:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.534400:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5200/0xdfc0fb148959ab5 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb21 expref: 16697 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.534409:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5200/0xdfc0fb148959ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb21 expref: 16697 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.534428:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.534430:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.534433:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099965b00/0xdfc0fb148a377ca lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47867 expref: 16692 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.534441:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099965b00/0xdfc0fb148a377ca lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47867 expref: 16688 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.534457:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099965b00/0xdfc0fb148a377ca lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47867 expref: 16678 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.534466:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784448448:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.534488:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e7fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.534508:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485670 00000100:00100000:3.0:1713481296.534513:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2191:18651:x1796714882368000:12345-192.168.202.24@tcp:36:lfs.0 00000100:00100000:3.0:1713481296.534559:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:15576:1796714784448512:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.534585:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.534601:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e7f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.534621:0:6937:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784448512 00000100:00100000:3.0:1713481296.534624:0:6937:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784448512 00000100:00100000:3.0:1713481296.534648:0:6937:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82820 00000100:00100000:3.0:1713481296.534652:0:6937:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+32:15576:x1796714784448512:12345-0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.534730:0:6937:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+32:15576:x1796714784448512:12345-0@lo:1000:mdt00_024.0 Request processed in 76us (143us total) trans 0 rc -2/-2 00000100:00100000:3.0:1713481296.534737:0:6937:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82820 00000100:00100000:3.0:1713481296.534768:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:15576:1796714784448512:0@lo:1000:mdt00_024.0 00010000:00010000:3.0:1713481296.534806:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.534814:0:15576:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.534820:0:15576:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.534830:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:15576:1796714784448576:0@lo:101:mdt00_024.0 00000100:00100000:3.0:1713481296.534849:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.534862:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800909a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.534876:0:6937:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784448576 00000100:00100000:3.0:1713481296.534878:0:6937:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784448576 00000100:00100000:3.0:1713481296.534896:0:6937:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82821 00000100:00100000:3.0:1713481296.534900:0:6937:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+32:15576:x1796714784448576:12345-0@lo:101:mdt00_024.0 00010000:00010000:3.0:1713481296.534907:0:6937:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.534917:0:6937:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6f840/0xdfc0fb148a37905 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a378f0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.534932:0:6937:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4782f expref: 2056 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.534940:0:6937:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6f840/0xdfc0fb148a37905 lrc: 4/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a378f0 expref: 33 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.534957:0:6937:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4782f expref: 2056 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.534966:0:6937:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095e5a880/0xdfc0fb148a37745 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4782f expref: 2056 pid: 10467 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.534975:0:6937:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096d79180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6937:1796714784448640:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.534996:0:6937:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e7fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.535066:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.535081:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882367552 00000100:00100000:3.0:1713481296.535084:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882367552 00000100:00100000:3.0:1713481296.535105:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98309 00000100:00100000:3.0:1713481296.535110:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:1957:x1796714882367552:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:3.0:1713481296.535117:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.535149:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008191a880/0xdfc0fb148a2ec64 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42b98 expref: 2793 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535174:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff8801237a3200) 00010000:00010000:3.0:1713481296.535177:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.535197:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:1957:x1796714882367552:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 86us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.535204:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98309 00000100:00100000:3.0:1713481296.535248:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.535266:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882367616 00000100:00100000:3.0:1713481296.535269:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882367616 00000100:00100000:3.0:1713481296.535287:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98310 00000100:00100000:3.0:1713481296.535291:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:1957:x1796714882367616:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:3.0:1713481296.535298:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.535307:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007da54fc0/0xdfc0fb148a377c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x51f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47860 expref: 2792 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535323:0:15497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f8:0x0].0x0 (ffff8801349f1b00) 00010000:00010000:3.0:1713481296.535326:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.535345:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2791:1957:x1796714882367616:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.535351:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98310 00000100:00100000:3.0:1713481296.535389:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.535435:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.535442:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784448704:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.535464:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.535516:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784447680 00000100:00100000:3.0:1713481296.535520:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784447680 00000100:00100000:3.0:1713481296.535545:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20386 00000100:00100000:3.0:1713481296.535550:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8640:x1796714784447680:12345-0@lo:104: 00010000:00010000:3.0:1713481296.535559:0:6917:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdfc0fb148a377e6 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535601:0:6917:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1713481296.535606:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8640:x1796714784447680:12345-0@lo:104: Request processed in 56us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.535613:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20386 00010000:00010000:3.0:1713481296.535635:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713481296.535641:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdfc0fb148a377e6 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535647:0:6921:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff88008af3f600 is referenced, will be cancelled later 00010000:00010000:3.0:1713481296.535649:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008af3f600/0xdfc0fb148a3778b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xdfc0fb148a377e6 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535656:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.535657:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.535658:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713481296.535683:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784448704 00000100:00100000:3.0:1713481296.535686:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784448704 00000100:00100000:3.0:1713481296.535699:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882368704 00000100:00100000:3.0:1713481296.535702:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882368704 00000100:00100000:3.0:1713481296.535714:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561887 00000100:00100000:3.0:1713481296.535718:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2613:3492:x1796714784448704:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.535729:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43169 count 1 00010000:00010000:3.0:1713481296.535742:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535758:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880079ad3840/0xdfc0fb1486883fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23ca expref: 26661 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.535765:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.535767:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.535770:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535787:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880079ad3840/0xdfc0fb1486883fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23ca expref: 26661 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.535796:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880079ad3840/0xdfc0fb1486883fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23ca expref: 26661 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.535805:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784448768:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.535824:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e7f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.535849:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561888 00000100:00100000:3.0:1713481296.535853:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16638:18844:x1796714882368704:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.535860:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.535870:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801347c6400/0xdfc0fb148a3794b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcba5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa478c9 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.535882:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcba5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.535891:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.535892:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.535897:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801347c6400/0xdfc0fb148a3794b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478c9 expref: 16639 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535907:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801347c6400/0xdfc0fb148a3794b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478c9 expref: 16638 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535913:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801347c6400, rc 0) 00000100:00100000:3.0:1713481296.535926:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16638:18844:x1796714882368704:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 73us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.535931:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561888 00000100:00100000:3.0:1713481296.535969:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2d1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784447552:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.535978:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.535983:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.535996:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882368576 00000100:00100000:3.0:1713481296.535997:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882368576 00000100:00100000:3.0:1713481296.536012:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125637 00000100:00100000:3.0:1713481296.536014:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18578:x1796714882368576:12345-192.168.202.24@tcp:37:rm.0 00000100:00100000:3.0:1713481296.536518:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784448832:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.536535:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.536558:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882368832 00000100:00100000:3.0:1713481296.536560:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882368832 00000100:00100000:3.0:1713481296.536571:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125638 00000100:00100000:3.0:1713481296.536574:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2791:18769:x1796714882368832:12345-192.168.202.24@tcp:35:dir_create.sh.0 00000100:00100000:3.0:1713481296.536662:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18769:x1796714882368832:12345-192.168.202.24@tcp:35:dir_create.sh.0 Request processed in 86us (291us total) trans 4295105872 rc 0/0 00000100:00100000:3.0:1713481296.536680:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125638 00000100:00100000:3.0:1713481296.536732:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784447104:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.536769:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb70d80/0xdfc0fb148a37848 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x696f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47898 expref: 16636 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.536777:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb70d80, rc 0) 00000100:00100000:3.0:1713481296.536795:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16636:11388:x1796714882366784:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5758us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.536800:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561879 00000100:00100000:3.0:1713481296.536831:0:15498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007861a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15498:1796714784447040:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.536856:0:15498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb733c0/0xdfc0fb148a37810 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4788a expref: 16635 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.536864:0:15498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb733c0, rc 0) 00000100:00100000:3.0:1713481296.536877:0:15498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16635:8499:x1796714882366656:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6297us (6348us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.536881:0:15498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561877 00000100:00100000:3.0:1713481296.536902:0:15498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882369472 00000100:00100000:3.0:1713481296.536904:0:15498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882369472 00000100:00100000:3.0:1713481296.536923:0:15498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561890 00000100:00100000:3.0:1713481296.536926:0:15498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16635:17935:x1796714882369472:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.536931:0:15498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.536942:0:15498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079999680/0xdfc0fb148a3797c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa478e5 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.536952:0:15498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.536959:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.536960:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.536963:0:15498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079999680/0xdfc0fb148a3797c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478e5 expref: 16636 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.536970:0:15498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079999680/0xdfc0fb148a3797c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478e5 expref: 16636 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.536974:0:15498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079999680, rc 0) 00000100:00100000:3.0:1713481296.536987:0:15498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16636:17935:x1796714882369472:12345-192.168.202.24@tcp:101:dd.0 Request processed in 61us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.536992:0:15498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561890 00000100:00100000:3.0:1713481296.537017:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882369536 00000100:00100000:3.0:1713481296.537019:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882369536 00000100:00100000:3.0:1713481296.537037:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485677 00000100:00100000:3.0:1713481296.537041:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800773d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2390:18729:x1796714882369536:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.537046:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.537051:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800799986c0/0xdfc0fb148a3798a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa478f3 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.537102:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.537108:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537116:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537141:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.537145:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537148:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537181:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079998900/0xdfc0fb148a379a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.537185:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079998900/0xdfc0fb148a379a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537188:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079998900/0xdfc0fb148a379a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00200000:3.0:1713481296.537203:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x347f:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.537204:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.537210:0:15475:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880079998900/0xdfc0fb148a379a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537215:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537219:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537222:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537228:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537231:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079998fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.537233:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537236:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537240:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.537242:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.537245:0:15475:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6f840/0xdfc0fb148a37905 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a378f0 expref: 33 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.537249:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537252:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079998fc0/0xdfc0fb148a37991 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537265:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537268:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537272:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537274:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007999a400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.537275:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537279:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537283:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff88009d207500) 00010000:00010000:3.0:1713481296.537284:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.537285:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537288:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007999a400/0xdfc0fb148a3799f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.537319:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800799986c0/0xdfc0fb148a3798a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478f3 expref: 2392 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.537330:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880079998900/0xdfc0fb148a379a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478f3 expref: 2391 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.537336:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:3.0:1713481296.537338:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.537339:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079998900, rc 0) 00000100:00100000:3.0:1713481296.537357:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800773d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2391:18729:x1796714882369536:12345-192.168.202.24@tcp:101:rm.0 Request processed in 315us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.537363:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485677 00000004:00080000:3.0:1713481296.537403:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078dd9880/2, rc 0, transno 993254 00000100:00100000:3.0:1713481296.537409:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784446208:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.537445:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007861a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784449024:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.537468:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.537522:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007726ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784446656:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.537542:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.537558:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+21702:1960:x1796714882364736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7855us (7911us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.537565:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819924 00000100:00100000:3.0:1713481296.537661:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882369024 00000100:00100000:3.0:1713481296.537678:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882369024 00010000:00010000:3.0:1713481296.537692:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121e33a80/0xdfc0fb148a15fa9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397d4 expref: 21702 pid: 16463 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.537709:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882369216 00000100:00100000:3.0:1713481296.537711:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882369216 00010000:00010000:3.0:1713481296.537720:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012368b840/0xdfc0fb148a13dcf lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc171:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f31 expref: 21703 pid: 16546 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.537735:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882368896 00000100:00100000:3.0:1713481296.537737:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882368896 00010000:00010000:3.0:1713481296.537746:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dd14b40/0xdfc0fb148916d83 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6522 expref: 21704 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.537766:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819936 00000100:00100000:3.0:1713481296.537771:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+21704:1960:x1796714882369216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.537778:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.537790:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012368b840/0xdfc0fb148a13dcf lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc171:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f31 expref: 21704 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.537799:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012368b840/0xdfc0fb148a13dcf lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc171:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f31 expref: 21704 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.537825:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012368b840/0xdfc0fb148a13dcf lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc171:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f31 expref: 21703 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.537841:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.537842:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.537847:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb73600/0xdfc0fb148a3784f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc171:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4789f expref: 21699 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.537855:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb73600/0xdfc0fb148a3784f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc171:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4789f expref: 21696 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.537875:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb73600/0xdfc0fb148a3784f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc171:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4789f expref: 21688 pid: 16537 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.537885:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784449216:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.537903:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089178840 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.537950:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784449344:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.537973:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.538005:0:15498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784449344 00000100:00100000:3.0:1713481296.538008:0:15498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784449344 00000100:00100000:3.0:1713481296.538026:0:15498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561893 00000100:00100000:3.0:1713481296.538031:0:15498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+2616:3492:x1796714784449344:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.538041:0:15498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43172 count 1 00010000:00010000:3.0:1713481296.538054:0:15498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538071:0:15498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134e3ad00/0xdfc0fb148688409 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23f4 expref: 26661 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.538078:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.538079:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.538082:0:15498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538099:0:15498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134e3ad00/0xdfc0fb148688409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23f4 expref: 26661 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.538108:0:15498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134e3ad00/0xdfc0fb148688409 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23f4 expref: 26661 pid: 16539 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.538137:0:15498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15498:1796714784449536:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.538158:0:15498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.538190:0:10467:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.202.24@tcp) returned -22 from blocking AST (req@ffff88009ee28a80 x1796714784447360) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 1/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478a6 expref: 2390 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.538201:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098543a80/0xdfc0fb148a37880 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478a6 expref: 2390 pid: 15483 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.538219:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ee28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:10467:1796714784447360:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.538240:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009285f800) 00010000:00010000:3.0:1713481296.538245:0:10467:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.538251:0:10467:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.538256:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.538269:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2caf:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.538276:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.538283:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.538342:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:10467:1796714784449728:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1713481296.538425:0:10467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.538444:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.538475:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009421b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784447936:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.538488:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.538502:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+21484:1959:x1796714882367488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4991us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.538510:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819930 00000100:00100000:3.0:1713481296.538562:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086b46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784448192:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.538594:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092adef40/0xdfc0fb148a378c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa89f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.538615:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370176 00000100:00100000:3.0:1713481296.538618:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370176 00010000:00010000:3.0:1713481296.538630:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009428a880/0xdfc0fb148a3313e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44b5e expref: 2792 pid: 15476 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.538646:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370304 00000100:00100000:3.0:1713481296.538649:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370304 00010000:00010000:3.0:1713481296.538659:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880079ad3600/0xdfc0fb1486883e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa89e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23a0 expref: 26663 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.538694:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819940 00000100:00100000:3.0:1713481296.538699:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:1960:x1796714882370176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.538707:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.538713:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009428a880/0xdfc0fb148a3313e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44b5e expref: 2792 pid: 15476 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.538722:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009428a880/0xdfc0fb148a3313e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44b5e expref: 2792 pid: 15476 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.538736:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009428a880/0xdfc0fb148a3313e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44b5e expref: 2792 pid: 15476 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.538753:0:6919:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00010000:00010000:3.0:1713481296.538758:0:6919:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092adf840/0xdfc0fb148a378b8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a378b1 expref: 17 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538767:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092adf840/0xdfc0fb148a378b8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a378b1 expref: 17 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538774:0:6919:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092adf840/0xdfc0fb148a378b8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a378b1 expref: 17 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538792:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092adf840/0xdfc0fb148a378b8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a378b1 expref: 16 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.538802:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086b46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6919:1796714784449792:0@lo:105: 00000100:00100000:3.0:1713481296.538824:0:6919:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.538843:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.538860:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784449792 00000100:00100000:3.0:1713481296.538863:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784449792 00000100:00100000:3.0:1713481296.538881:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20387 00000100:00100000:3.0:1713481296.538886:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009421b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6919:x1796714784449792:12345-0@lo:105: 00010000:00010000:3.0:1713481296.538892:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092add200/0xdfc0fb148a378b1 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378b8 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538900:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092add200/0xdfc0fb148a378b1 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378b8 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538908:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092add200/0xdfc0fb148a378b1 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a378b8 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538915:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092add200/0xdfc0fb148a378b1 lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a378b8 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538922:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092add200/0xdfc0fb148a378b1 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a378b8 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538930:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092add200/0xdfc0fb148a378b1 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a378b8 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.538968:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880092add200) 00000100:00100000:3.0:1713481296.539000:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009421b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6919:x1796714784449792:12345-0@lo:105: Request processed in 113us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.539007:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20387 00000100:00100000:3.0:1713481296.539036:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370368 00000100:00100000:3.0:1713481296.539040:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370368 00010000:00010000:3.0:1713481296.539051:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880079ad3cc0/0xdfc0fb1486883df lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa89d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2392 expref: 26660 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.539067:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370432 00000100:00100000:3.0:1713481296.539070:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370432 00010000:00010000:3.0:1713481296.539081:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a947180/0xdfc0fb1486883f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23bc expref: 26661 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.539098:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819943 00000100:00100000:3.0:1713481296.539103:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26661:1959:x1796714882370368:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.539111:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.539115:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880079ad3cc0/0xdfc0fb1486883df lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa89d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2392 expref: 26661 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.539145:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880079ad3cc0/0xdfc0fb1486883df lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa89d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2392 expref: 26661 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.539163:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079ad3cc0/0xdfc0fb1486883df lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa89d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2392 expref: 26661 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.539182:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.539184:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.539187:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b91dd40/0xdfc0fb148a378cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa89d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539194:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b91dd40/0xdfc0fb148a378cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa89d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539214:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.539230:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26659:1959:x1796714882370368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.539237:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819943 00000004:00080000:3.0:1713481296.539274:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e278a80/2, rc 0, transno 993256 00000100:00100000:3.0:1713481296.539281:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784448000:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.539317:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.539324:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784449984:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.539346:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.539386:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e2edc00/2, rc 0, transno 993257 00000100:00100000:3.0:1713481296.539393:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784448128:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.539422:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.539428:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784450112:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.539455:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.539489:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086b46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6919:1796714784449792:0@lo:105: 00010000:00010000:3.0:1713481296.539512:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.539525:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2791:1960:x1796714882370176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 825us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.539532:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819940 00000100:00100000:3.0:1713481296.539558:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784450112 00000100:00100000:3.0:1713481296.539561:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784450112 00000100:00100000:3.0:1713481296.539579:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561900 00000100:00100000:3.0:1713481296.539583:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2620:3491:x1796714784450112:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.539595:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43174 count 1 00010000:00010000:3.0:1713481296.539606:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539616:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083232ac0/0xdfc0fb148688417 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2410 expref: 26657 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.539623:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.539624:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.539626:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539642:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083232ac0/0xdfc0fb148688417 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2410 expref: 26657 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.539650:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083232ac0/0xdfc0fb148688417 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2410 expref: 26657 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.539660:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784450176:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.539694:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.539722:0:6937:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096d79180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6937:1796714784448640:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.539749:0:6937:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6f840/0xdfc0fb148a37905 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a378f0 expref: 33 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539754:0:6937:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.539756:0:6937:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.539759:0:6937:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6f840/0xdfc0fb148a37905 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a378f0 expref: 33 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539764:0:6937:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f6f840, rc 0) 00000100:00100000:3.0:1713481296.539785:0:6937:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+33:15576:x1796714784448576:12345-0@lo:101:mdt00_024.0 Request processed in 4885us (4936us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.539790:0:6937:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82821 00000100:00100000:3.0:1713481296.539814:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:15576:1796714784448576:0@lo:101:mdt00_024.0 00010000:00010000:3.0:1713481296.539822:0:15576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539827:0:15576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.539843:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009421aa00/2, rc 0, transno 993259 00000100:00100000:3.0:1713481296.539847:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009421aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784448256:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.539853:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078e5d880/2, rc 0, transno 993258 00000100:00100000:3.0:1713481296.539855:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784447872:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.539868:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784450240 00000100:00100000:3.0:1713481296.539870:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784450240 00000100:00100000:3.0:1713481296.539882:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20388 00000100:00100000:3.0:1713481296.539884:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16553:x1796714784450240:12345-0@lo:105: 00010000:00010000:3.0:1713481296.539889:0:6917:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 5/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539893:0:6917:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 5/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539898:0:6917:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 5/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539902:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 5/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539906:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 6/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539911:0:6917:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 6/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.539923:0:6917:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880096f6f180) 00000100:00100000:3.0:1713481296.539947:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16553:x1796714784450240:12345-0@lo:105: Request processed in 61us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.539950:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20388 00000100:00100000:3.0:1713481296.539970:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370624 00000100:00100000:3.0:1713481296.539974:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370624 00000100:00100000:3.0:1713481296.539988:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370560 00000100:00100000:3.0:1713481296.539990:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370560 00000100:00100000:3.0:1713481296.540005:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561901 00000100:00100000:3.0:1713481296.540009:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26659:11552:x1796714882370624:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.540017:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.540027:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800980ccfc0/0xdfc0fb148a37a24 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4792b expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540046:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880078c26880/0xdfc0fb148959adf lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb2f expref: 26659 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.540053:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.540054:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.540057:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800980ccfc0/0xdfc0fb148a37a24 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4792b expref: 26659 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540072:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880078c26880/0xdfc0fb148959adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb2f expref: 26659 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.540081:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880078c26880/0xdfc0fb148959adf lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb2f expref: 26659 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.540088:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078395500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784450304:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.540106:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a240 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.540169:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.540176:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784450368:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.540198:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.540222:0:15576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540230:0:15576:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880096f6f180/0xdfc0fb148a378f0 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37905 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.540249:0:15576:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:3.0:1713481296.540266:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c2e3cc0/0xdfc0fb148a37a2b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.540273:0:15576:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c2e3cc0/0xdfc0fb148a37a2b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.540280:0:15576:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c2e3cc0/0xdfc0fb148a37a2b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.540290:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:15576:1796714784450496:0@lo:101:mdt00_024.0 00000100:00100000:3.0:1713481296.540312:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.540331:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.540352:0:6937:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784450496 00000100:00100000:3.0:1713481296.540355:0:6937:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784450496 00000100:00100000:3.0:1713481296.540373:0:6937:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82824 00000100:00100000:3.0:1713481296.540378:0:6937:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+33:15576:x1796714784450496:12345-0@lo:101:mdt00_024.0 00010000:00010000:3.0:1713481296.540386:0:6937:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.540397:0:6937:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2400/0xdfc0fb148a37a32 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a37a2b expref: -99 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540412:0:6937:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2400/0xdfc0fb148a37a32 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a37a2b expref: 34 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540421:0:6937:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2400/0xdfc0fb148a37a32 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37a2b expref: 34 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540428:0:6937:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3031 (ffff8801354e0d00) 00010000:00010000:3.0:1713481296.540431:0:6937:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.540433:0:6937:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c2e2400, rc 0) 00000100:00100000:3.0:1713481296.540463:0:6937:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+34:15576:x1796714784450496:12345-0@lo:101:mdt00_024.0 Request processed in 84us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.540469:0:6937:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82824 00000100:00100000:3.0:1713481296.540511:0:15576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:15576:1796714784450496:0@lo:101:mdt00_024.0 00010000:00010000:3.0:1713481296.540523:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c2e3cc0/0xdfc0fb148a37a2b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37a32 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540531:0:15576:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c2e3cc0/0xdfc0fb148a37a2b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37a32 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.540550:0:15576:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:3.0:1713481296.540569:0:15576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086aa0700 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:15576:1796714784450752:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1713481296.540592:0:15576:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.540608:0:15576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.540638:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009421a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784448448:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.540653:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.540691:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16634:1959:x1796714882368128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6310us (6453us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.540699:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819932 00000100:00100000:3.0:1713481296.540793:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370752 00000100:00100000:3.0:1713481296.540797:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370752 00000100:00100000:3.0:1713481296.540814:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882370816 00000100:00100000:3.0:1713481296.540816:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882370816 00000100:00100000:3.0:1713481296.540829:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485679 00000100:00100000:3.0:1713481296.540834:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2059:18755:x1796714882370752:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.540842:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.540851:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1680/0xdfc0fb148a37a47 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47932 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.540910:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.540918:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.540925:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.540939:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.540945:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.540950:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.540983:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.540990:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.540997:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000004:00200000:3.0:1713481296.541013:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3474:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.541016:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.541025:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541033:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541039:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541044:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541050:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541055:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c2e1200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.541058:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541063:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541071:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.541073:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.541076:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541081:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1200/0xdfc0fb148a37a4e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541095:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541101:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541106:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541110:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c2e2640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.541113:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541137:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541145:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880083123400) 00010000:00010000:3.0:1713481296.541148:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.541150:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541156:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e2640/0xdfc0fb148a37a55 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.541199:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e1680/0xdfc0fb148a37a47 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2061 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.541211:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2060 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.541217:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:3.0:1713481296.541220:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713481296.541222:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c2e0d80, rc 0) 00000100:00100000:3.0:1713481296.541237:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2060:18755:x1796714882370752:12345-192.168.202.24@tcp:101:touch.0 Request processed in 402us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.541243:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485679 00000100:00100000:3.0:1713481296.541264:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485680 00000100:00100000:3.0:1713481296.541268:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2196:18580:x1796714882370816:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.541287:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713481296.541301:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079b27840/0xdfc0fb148a30fbf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x389b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa43776 expref: 2196 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.541329:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007345d8c0/0xdfc0fb148a2cbcc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x389b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa420e7 expref: 2195 pid: 15591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.541344:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x389b:0x0].0x0 (ffff880073576300) 00010000:00010000:3.0:1713481296.541362:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.541375:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541382:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541390:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541400:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x380a:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541406:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541413:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541453:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541460:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.541466:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000040:00080000:3.0:1713481296.542944:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13563, 64 off876224 00000040:00080000:3.0:1713481296.542968:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14428, 64 off931584 00000040:00080000:3.0:1713481296.542979:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13564, 64 off876288 00000040:00080000:3.0:1713481296.542987:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14429, 64 off931648 00000040:00080000:3.0:1713481296.542996:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13565, 64 off876352 00000040:00080000:3.0:1713481296.543005:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14430, 64 off931712 00000040:00080000:3.0:1713481296.543013:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13566, 64 off876416 00000040:00080000:3.0:1713481296.543022:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14431, 64 off931776 00000040:00080000:3.0:1713481296.543030:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13567, 64 off876480 00000040:00080000:3.0:1713481296.543039:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14432, 64 off931840 00000040:00080000:3.0:1713481296.543047:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13568, 64 off876544 00000040:00080000:3.0:1713481296.543057:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14433, 64 off931904 00000040:00080000:3.0:1713481296.543156:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13569, 64 off876608 00000040:00080000:3.0:1713481296.543170:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14434, 64 off931968 00000040:00080000:3.0:1713481296.543180:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13570, 64 off876672 00000040:00080000:3.0:1713481296.543188:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14435, 64 off932032 00000040:00080000:3.0:1713481296.543196:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13571, 64 off876736 00000040:00080000:3.0:1713481296.543204:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14436, 64 off932096 00000040:00080000:3.0:1713481296.543213:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13572, 64 off876800 00000040:00080000:3.0:1713481296.543221:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14437, 64 off932160 00000040:00080000:3.0:1713481296.543229:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13573, 64 off876864 00000040:00080000:3.0:1713481296.543237:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14438, 64 off932224 00000040:00080000:3.0:1713481296.543245:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13574, 64 off876928 00000040:00080000:3.0:1713481296.543254:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14439, 64 off932288 00000040:00080000:3.0:1713481296.543262:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13575, 64 off876992 00000040:00080000:3.0:1713481296.543270:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14440, 64 off932352 00000040:00080000:3.0:1713481296.543278:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13576, 64 off877056 00000040:00080000:3.0:1713481296.543287:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14441, 64 off932416 00000040:00080000:3.0:1713481296.543295:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13577, 64 off877120 00000040:00080000:3.0:1713481296.543303:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14442, 64 off932480 00000040:00080000:3.0:1713481296.543311:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13578, 64 off877184 00000040:00080000:3.0:1713481296.543319:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14443, 64 off932544 00000040:00080000:3.0:1713481296.543327:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13579, 64 off877248 00000040:00080000:3.0:1713481296.543336:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14444, 64 off932608 00000040:00080000:3.0:1713481296.543345:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13580, 64 off877312 00000040:00080000:3.0:1713481296.543354:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14445, 64 off932672 00000040:00080000:3.0:1713481296.543362:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13581, 64 off877376 00000040:00080000:3.0:1713481296.543370:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14446, 64 off932736 00000040:00080000:3.0:1713481296.543378:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13582, 64 off877440 00000040:00080000:3.0:1713481296.543386:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14447, 64 off932800 00000040:00080000:3.0:1713481296.543394:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13583, 64 off877504 00000040:00080000:3.0:1713481296.543402:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14448, 64 off932864 00000040:00080000:3.0:1713481296.543410:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13584, 64 off877568 00000040:00080000:3.0:1713481296.543418:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14449, 64 off932928 00000040:00080000:3.0:1713481296.543426:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13585, 64 off877632 00000040:00080000:3.0:1713481296.543434:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14450, 64 off932992 00000040:00080000:3.0:1713481296.543443:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13586, 64 off877696 00000040:00080000:3.0:1713481296.543451:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14451, 64 off933056 00000040:00080000:3.0:1713481296.543459:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13587, 64 off877760 00000040:00080000:3.0:1713481296.543468:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14452, 64 off933120 00000040:00080000:3.0:1713481296.543476:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13588, 64 off877824 00000040:00080000:3.0:1713481296.543485:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14453, 64 off933184 00000040:00080000:3.0:1713481296.543493:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13589, 64 off877888 00000040:00080000:3.0:1713481296.543501:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14454, 64 off933248 00000040:00080000:3.0:1713481296.543509:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13590, 64 off877952 00000040:00080000:3.0:1713481296.543517:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14455, 64 off933312 00000040:00080000:3.0:1713481296.543526:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13591, 64 off878016 00000040:00080000:3.0:1713481296.543534:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14456, 64 off933376 00000040:00080000:3.0:1713481296.543543:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13592, 64 off878080 00000040:00080000:3.0:1713481296.543551:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14457, 64 off933440 00000040:00080000:3.0:1713481296.543559:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13593, 64 off878144 00000040:00080000:3.0:1713481296.543567:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14458, 64 off933504 00000040:00080000:3.0:1713481296.543575:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13594, 64 off878208 00000040:00080000:3.0:1713481296.543584:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14459, 64 off933568 00000040:00080000:3.0:1713481296.543592:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13595, 64 off878272 00000040:00080000:3.0:1713481296.543601:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14460, 64 off933632 00000040:00080000:3.0:1713481296.543608:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13596, 64 off878336 00000040:00080000:3.0:1713481296.543616:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14461, 64 off933696 00000040:00080000:3.0:1713481296.543623:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13597, 64 off878400 00000040:00080000:3.0:1713481296.543631:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14462, 64 off933760 00000040:00080000:3.0:1713481296.543638:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13598, 64 off878464 00000040:00080000:3.0:1713481296.543646:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14463, 64 off933824 00000040:00080000:3.0:1713481296.543655:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13599, 64 off878528 00000040:00080000:3.0:1713481296.543663:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14464, 64 off933888 00000040:00080000:3.0:1713481296.543688:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13600, 64 off878592 00000040:00080000:3.0:1713481296.543735:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14465, 64 off933952 00000040:00080000:3.0:1713481296.543747:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13601, 64 off878656 00000040:00080000:3.0:1713481296.543755:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14466, 64 off934016 00000040:00080000:3.0:1713481296.543763:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13602, 64 off878720 00000040:00080000:3.0:1713481296.543772:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14467, 64 off934080 00000040:00080000:3.0:1713481296.543781:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13603, 64 off878784 00000040:00080000:3.0:1713481296.543789:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14468, 64 off934144 00000040:00080000:3.0:1713481296.543797:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13604, 64 off878848 00000040:00080000:3.0:1713481296.543806:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14469, 64 off934208 00000040:00080000:3.0:1713481296.543814:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13605, 64 off878912 00000040:00080000:3.0:1713481296.543822:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14470, 64 off934272 00000040:00080000:3.0:1713481296.543831:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13606, 64 off878976 00000040:00080000:3.0:1713481296.543839:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14471, 64 off934336 00000040:00080000:3.0:1713481296.543847:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13607, 64 off879040 00000040:00080000:3.0:1713481296.543855:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14472, 64 off934400 00000040:00080000:3.0:1713481296.543864:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13608, 64 off879104 00000040:00080000:3.0:1713481296.543872:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14473, 64 off934464 00000040:00080000:3.0:1713481296.543880:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13609, 64 off879168 00000040:00080000:3.0:1713481296.543888:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14474, 64 off934528 00000040:00080000:3.0:1713481296.543896:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13610, 64 off879232 00000040:00080000:3.0:1713481296.543905:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14475, 64 off934592 00000040:00080000:3.0:1713481296.543913:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13611, 64 off879296 00000040:00080000:3.0:1713481296.543921:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14476, 64 off934656 00000040:00080000:3.0:1713481296.543930:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13612, 64 off879360 00000040:00080000:3.0:1713481296.543939:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14477, 64 off934720 00000040:00080000:3.0:1713481296.543947:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13613, 64 off879424 00000040:00080000:3.0:1713481296.543955:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14478, 64 off934784 00000040:00080000:3.0:1713481296.543963:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13614, 64 off879488 00000040:00080000:3.0:1713481296.543972:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14479, 64 off934848 00000040:00080000:3.0:1713481296.543980:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13615, 64 off879552 00000040:00080000:3.0:1713481296.543988:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14480, 64 off934912 00000040:00080000:3.0:1713481296.543996:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13616, 64 off879616 00000040:00080000:3.0:1713481296.544003:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14481, 64 off934976 00000040:00080000:3.0:1713481296.544011:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13617, 64 off879680 00000040:00080000:3.0:1713481296.544019:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14482, 64 off935040 00000040:00080000:3.0:1713481296.544027:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13618, 64 off879744 00000040:00080000:3.0:1713481296.544035:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14483, 64 off935104 00000040:00080000:3.0:1713481296.544044:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13619, 64 off879808 00000040:00080000:3.0:1713481296.544052:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14484, 64 off935168 00000040:00080000:3.0:1713481296.544060:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13620, 64 off879872 00000040:00080000:3.0:1713481296.544068:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14485, 64 off935232 00000040:00080000:3.0:1713481296.544076:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13621, 64 off879936 00000040:00080000:3.0:1713481296.544085:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14486, 64 off935296 00000040:00080000:3.0:1713481296.544093:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13622, 64 off880000 00000040:00080000:3.0:1713481296.544101:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14487, 64 off935360 00000040:00080000:3.0:1713481296.544110:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13623, 64 off880064 00000040:00080000:3.0:1713481296.544138:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14488, 64 off935424 00000040:00080000:3.0:1713481296.544150:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13624, 64 off880128 00000040:00080000:3.0:1713481296.544159:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14489, 64 off935488 00000040:00080000:3.0:1713481296.544167:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13625, 64 off880192 00000040:00080000:3.0:1713481296.544175:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14490, 64 off935552 00000040:00080000:3.0:1713481296.544184:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13626, 64 off880256 00000040:00080000:3.0:1713481296.544192:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14491, 64 off935616 00000040:00080000:3.0:1713481296.544200:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13627, 64 off880320 00000040:00080000:3.0:1713481296.544208:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14492, 64 off935680 00000040:00080000:3.0:1713481296.544217:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13628, 64 off880384 00000040:00080000:3.0:1713481296.544225:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14493, 64 off935744 00000040:00080000:3.0:1713481296.544233:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13629, 64 off880448 00000040:00080000:3.0:1713481296.544242:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14494, 64 off935808 00000040:00080000:3.0:1713481296.544249:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13630, 64 off880512 00000040:00080000:3.0:1713481296.544257:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14495, 64 off935872 00000040:00080000:3.0:1713481296.544265:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13631, 64 off880576 00000040:00080000:3.0:1713481296.544273:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14496, 64 off935936 00000040:00080000:3.0:1713481296.544281:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13632, 64 off880640 00000040:00080000:3.0:1713481296.544289:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14497, 64 off936000 00000040:00080000:3.0:1713481296.544326:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13633, 64 off880704 00000040:00080000:3.0:1713481296.544339:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14498, 64 off936064 00000040:00080000:3.0:1713481296.544348:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13634, 64 off880768 00000040:00080000:3.0:1713481296.544356:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14499, 64 off936128 00000040:00080000:3.0:1713481296.544364:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13635, 64 off880832 00000040:00080000:3.0:1713481296.544373:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14500, 64 off936192 00000040:00080000:3.0:1713481296.544382:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13636, 64 off880896 00000040:00080000:3.0:1713481296.544390:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14501, 64 off936256 00000040:00080000:3.0:1713481296.544398:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13637, 64 off880960 00000040:00080000:3.0:1713481296.544406:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14502, 64 off936320 00000040:00080000:3.0:1713481296.544414:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13638, 64 off881024 00000040:00080000:3.0:1713481296.544423:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14503, 64 off936384 00000040:00080000:3.0:1713481296.544432:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13639, 64 off881088 00000040:00080000:3.0:1713481296.544441:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14504, 64 off936448 00000040:00080000:3.0:1713481296.544450:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13640, 64 off881152 00000040:00080000:3.0:1713481296.544459:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14505, 64 off936512 00000040:00080000:3.0:1713481296.544467:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13641, 64 off881216 00000040:00080000:3.0:1713481296.544476:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14506, 64 off936576 00000040:00080000:3.0:1713481296.544484:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13642, 64 off881280 00000040:00080000:3.0:1713481296.544492:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14507, 64 off936640 00000040:00080000:3.0:1713481296.544500:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13643, 64 off881344 00000040:00080000:3.0:1713481296.544509:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14508, 64 off936704 00000004:00080000:3.0:1713481296.544550:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a118700/2, rc 0, transno 993260 00000100:00100000:3.0:1713481296.544560:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784448832:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.544594:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.544601:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784451264:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.544624:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.544653:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.544659:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784451200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.544695:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.544720:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784451200 00000100:00100000:3.0:1713481296.544724:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784451200 00000100:00100000:3.0:1713481296.544746:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98311 00000100:00100000:3.0:1713481296.544751:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+35:3492:x1796714784451200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.544758:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.544767:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6f840/0xdfc0fb148a37905 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a378f0 expref: 35 pid: 6937 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.544784:0:6919:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.544787:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.544810:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+34:3492:x1796714784451200:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.544817:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98311 00000100:00100000:3.0:1713481296.544855:0:3491:0:(client.c:2953:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4296040669 gen 2 00000004:00080000:3.0:1713481296.544859:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097656d80, transno 4296030449 00000004:00080000:3.0:1713481296.544868:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097654700, transno 4296030450 00000004:00080000:3.0:1713481296.544870:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097654380, transno 4296030451 00000004:00080000:3.0:1713481296.544873:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097656680, transno 4296030452 00000004:00080000:3.0:1713481296.544875:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36c700, transno 4296030453 00000004:00080000:3.0:1713481296.544877:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5ce300, transno 4296030454 00000004:00080000:3.0:1713481296.544879:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36d500, transno 4296030455 00000004:00080000:3.0:1713481296.544880:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36fb80, transno 4296030456 00000004:00080000:3.0:1713481296.544882:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5cfb80, transno 4296030457 00000004:00080000:3.0:1713481296.544884:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5cdf80, transno 4296030461 00000004:00080000:3.0:1713481296.544886:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5ced80, transno 4296030462 00000004:00080000:3.0:1713481296.544887:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5cdc00, transno 4296030463 00000004:00080000:3.0:1713481296.544889:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013227ea00, transno 4296030464 00000004:00080000:3.0:1713481296.544890:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013227df80, transno 4296030467 00000004:00080000:3.0:1713481296.544892:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787c7480, transno 4296030468 00000004:00080000:3.0:1713481296.544893:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787c5f80, transno 4296030469 00000004:00080000:3.0:1713481296.544895:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a96300, transno 4296030470 00000004:00080000:3.0:1713481296.544897:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a94380, transno 4296030471 00000004:00080000:3.0:1713481296.544898:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787c5180, transno 4296030472 00000004:00080000:3.0:1713481296.544900:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a290700, transno 4296030474 00000004:00080000:3.0:1713481296.544902:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a94e00, transno 4296030475 00000004:00080000:3.0:1713481296.544903:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a95500, transno 4296030476 00000004:00080000:3.0:1713481296.544905:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a97b80, transno 4296030477 00000004:00080000:3.0:1713481296.544906:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a291500, transno 4296030478 00000004:00080000:3.0:1713481296.544908:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a923480, transno 4296030479 00000004:00080000:3.0:1713481296.544910:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe7b480, transno 4296030480 00000004:00080000:3.0:1713481296.544912:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33f100, transno 4296030481 00000004:00080000:3.0:1713481296.544913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe79880, transno 4296030482 00000004:00080000:3.0:1713481296.544915:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe7a300, transno 4296030483 00000004:00080000:3.0:1713481296.544917:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33ed80, transno 4296030484 00000004:00080000:3.0:1713481296.544918:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe7b800, transno 4296030485 00000004:00080000:3.0:1713481296.544919:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe78a80, transno 4296030486 00000004:00080000:3.0:1713481296.544921:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe78700, transno 4296030487 00000004:00080000:3.0:1713481296.544922:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe78380, transno 4296030488 00000004:00080000:3.0:1713481296.544924:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099199f80, transno 4296030489 00000004:00080000:3.0:1713481296.544926:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc8bb80, transno 4296030490 00000004:00080000:3.0:1713481296.544928:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009919b480, transno 4296030491 00000004:00080000:3.0:1713481296.544930:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc8b800, transno 4296030492 00000004:00080000:3.0:1713481296.544931:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc89500, transno 4296030493 00000004:00080000:3.0:1713481296.544934:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc88e00, transno 4296030494 00000004:00080000:3.0:1713481296.544935:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc8a300, transno 4296030495 00000004:00080000:3.0:1713481296.544937:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc8a680, transno 4296030496 00000004:00080000:3.0:1713481296.544938:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800816f6a00, transno 4296030497 00000004:00080000:3.0:1713481296.544940:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754f8e00, transno 4296030498 00000004:00080000:3.0:1713481296.544941:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754f9500, transno 4296030499 00000004:00080000:3.0:1713481296.544943:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754f8380, transno 4296030500 00000004:00080000:3.0:1713481296.544944:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754fa300, transno 4296030501 00000004:00080000:3.0:1713481296.544946:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094358e00, transno 4296030502 00000004:00080000:3.0:1713481296.544948:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094358380, transno 4296030503 00000004:00080000:3.0:1713481296.544949:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009435b800, transno 4296030504 00000004:00080000:3.0:1713481296.544951:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780daa00, transno 4296030505 00000004:00080000:3.0:1713481296.544952:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094358000, transno 4296030506 00000004:00080000:3.0:1713481296.544954:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009435a680, transno 4296030507 00000004:00080000:3.0:1713481296.544955:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780d9880, transno 4296030508 00000004:00080000:3.0:1713481296.544957:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780d8e00, transno 4296030509 00000004:00080000:3.0:1713481296.544959:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c896a00, transno 4296030510 00000004:00080000:3.0:1713481296.544960:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780dbb80, transno 4296030511 00000004:00080000:3.0:1713481296.544962:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c897480, transno 4296030512 00000004:00080000:3.0:1713481296.544963:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c896d80, transno 4296030513 00000004:00080000:3.0:1713481296.544965:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796dc00, transno 4296030514 00000004:00080000:3.0:1713481296.544966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796e680, transno 4296030515 00000004:00080000:3.0:1713481296.544968:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e0380, transno 4296030516 00000004:00080000:3.0:1713481296.544969:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796ed80, transno 4296030517 00000004:00080000:3.0:1713481296.544970:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796f480, transno 4296030518 00000004:00080000:3.0:1713481296.544972:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796c380, transno 4296030519 00000004:00080000:3.0:1713481296.544975:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e3480, transno 4296030520 00000004:00080000:3.0:1713481296.544976:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796ca80, transno 4296030521 00000004:00080000:3.0:1713481296.544979:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136457b80, transno 4296030522 00000004:00080000:3.0:1713481296.544981:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d287480, transno 4296030523 00000004:00080000:3.0:1713481296.544983:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9fd180, transno 4296030524 00000004:00080000:3.0:1713481296.544984:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136455c00, transno 4296030525 00000004:00080000:3.0:1713481296.544986:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121aea680, transno 4296030526 00000004:00080000:3.0:1713481296.544988:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796e300, transno 4296030527 00000004:00080000:3.0:1713481296.544989:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121aeb800, transno 4296030528 00000004:00080000:3.0:1713481296.544991:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121aead80, transno 4296030529 00000004:00080000:3.0:1713481296.544992:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae9f80, transno 4296030530 00000004:00080000:3.0:1713481296.544993:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013227d880, transno 4296030531 00000004:00080000:3.0:1713481296.544995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae8a80, transno 4296030532 00000004:00080000:3.0:1713481296.544996:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae8700, transno 4296030533 00000004:00080000:3.0:1713481296.544998:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013227e300, transno 4296030534 00000004:00080000:3.0:1713481296.544999:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae9500, transno 4296030543 00000004:00080000:3.0:1713481296.545001:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090406680, transno 4296030544 00000004:00080000:3.0:1713481296.545003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d287100, transno 4296030545 00000004:00080000:3.0:1713481296.545004:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33c000, transno 4296030546 00000004:00080000:3.0:1713481296.545006:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33ea00, transno 4296030547 00000004:00080000:3.0:1713481296.545007:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090405c00, transno 4296030548 00000004:00080000:3.0:1713481296.545009:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090407b80, transno 4296030549 00000004:00080000:3.0:1713481296.545011:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33ca80, transno 4296030550 00000004:00080000:3.0:1713481296.545012:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9fca80, transno 4296030551 00000004:00080000:3.0:1713481296.545014:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120698700, transno 4296030552 00000004:00080000:3.0:1713481296.545016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9ffb80, transno 4296030553 00000004:00080000:3.0:1713481296.545018:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012069ad80, transno 4296030554 00000004:00080000:3.0:1713481296.545020:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33f800, transno 4296030556 00000004:00080000:3.0:1713481296.545021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090406d80, transno 4296030557 00000004:00080000:3.0:1713481296.545022:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9fdf80, transno 4296030558 00000004:00080000:3.0:1713481296.545025:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120699500, transno 4296030559 00000004:00080000:3.0:1713481296.545027:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083838380, transno 4296030560 00000004:00080000:3.0:1713481296.545029:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008493b800, transno 4296030561 00000004:00080000:3.0:1713481296.545031:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084939880, transno 4296030562 00000004:00080000:3.0:1713481296.545033:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9ff800, transno 4296030563 00000004:00080000:3.0:1713481296.545034:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a292300, transno 4296030564 00000004:00080000:3.0:1713481296.545036:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a293b80, transno 4296030565 00000004:00080000:3.0:1713481296.545037:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a290a80, transno 4296030566 00000004:00080000:3.0:1713481296.545039:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f986300, transno 4296030567 00000004:00080000:3.0:1713481296.545040:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f986a00, transno 4296030568 00000004:00080000:3.0:1713481296.545042:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783c7b80, transno 4296030569 00000004:00080000:3.0:1713481296.545043:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f984e00, transno 4296030570 00000004:00080000:3.0:1713481296.545045:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783c6680, transno 4296030571 00000004:00080000:3.0:1713481296.545046:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783c5180, transno 4296030572 00000004:00080000:3.0:1713481296.545048:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed37480, transno 4296030573 00000004:00080000:3.0:1713481296.545049:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086e35c00, transno 4296030574 00000004:00080000:3.0:1713481296.545051:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783c4a80, transno 4296030575 00000004:00080000:3.0:1713481296.545053:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081565180, transno 4296030579 00000004:00080000:3.0:1713481296.545054:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1b7100, transno 4296030580 00000004:00080000:3.0:1713481296.545056:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086e35500, transno 4296030585 00000004:00080000:3.0:1713481296.545057:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081567480, transno 4296030586 00000004:00080000:3.0:1713481296.545058:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081566d80, transno 4296030587 00000004:00080000:3.0:1713481296.545060:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684ca80, transno 4296030588 00000004:00080000:3.0:1713481296.545061:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136455180, transno 4296030589 00000004:00080000:3.0:1713481296.545063:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136456680, transno 4296030590 00000004:00080000:3.0:1713481296.545065:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007992f800, transno 4296030591 00000004:00080000:3.0:1713481296.545066:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d285180, transno 4296030592 00000004:00080000:3.0:1713481296.545067:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d284380, transno 4296030593 00000004:00080000:3.0:1713481296.545069:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d285880, transno 4296030594 00000004:00080000:3.0:1713481296.545070:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d287b80, transno 4296030595 00000004:00080000:3.0:1713481296.545072:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d285c00, transno 4296030596 00000004:00080000:3.0:1713481296.545074:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1b4e00, transno 4296030597 00000004:00080000:3.0:1713481296.545076:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faea300, transno 4296030598 00000004:00080000:3.0:1713481296.545078:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fae8700, transno 4296030599 00000004:00080000:3.0:1713481296.545080:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076823b80, transno 4296030600 00000004:00080000:3.0:1713481296.545082:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076879180, transno 4296030601 00000004:00080000:3.0:1713481296.545083:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faebb80, transno 4296030602 00000004:00080000:3.0:1713481296.545085:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076878380, transno 4296030603 00000004:00080000:3.0:1713481296.545086:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fae9c00, transno 4296030604 00000004:00080000:3.0:1713481296.545088:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076879c00, transno 4296030605 00000004:00080000:3.0:1713481296.545089:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fae8a80, transno 4296030606 00000004:00080000:3.0:1713481296.545091:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007687aa00, transno 4296030607 00000004:00080000:3.0:1713481296.545092:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076879880, transno 4296030608 00000004:00080000:3.0:1713481296.545094:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076878700, transno 4296030609 00000004:00080000:3.0:1713481296.545095:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076878000, transno 4296030610 00000004:00080000:3.0:1713481296.545097:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845c700, transno 4296030611 00000004:00080000:3.0:1713481296.545099:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845d180, transno 4296030612 00000004:00080000:3.0:1713481296.545100:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845c000, transno 4296030613 00000004:00080000:3.0:1713481296.545102:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845fb80, transno 4296030614 00000004:00080000:3.0:1713481296.545103:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845ea00, transno 4296030615 00000004:00080000:3.0:1713481296.545105:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe68000, transno 4296030616 00000004:00080000:3.0:1713481296.545106:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe6a300, transno 4296030617 00000004:00080000:3.0:1713481296.545108:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec54e00, transno 4296030621 00000004:00080000:3.0:1713481296.545109:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b199c00, transno 4296030627 00000004:00080000:3.0:1713481296.545111:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078024700, transno 4296030628 00000004:00080000:3.0:1713481296.545113:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b19b100, transno 4296030629 00000004:00080000:3.0:1713481296.545114:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078027100, transno 4296030630 00000004:00080000:3.0:1713481296.545116:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec40a80, transno 4296030631 00000004:00080000:3.0:1713481296.545135:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e131500, transno 4296030632 00000004:00080000:3.0:1713481296.545137:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e133800, transno 4296030633 00000004:00080000:3.0:1713481296.545140:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e130700, transno 4296030634 00000004:00080000:3.0:1713481296.545142:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b199880, transno 4296030635 00000004:00080000:3.0:1713481296.545144:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec42300, transno 4296030636 00000004:00080000:3.0:1713481296.545146:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b19b800, transno 4296030637 00000004:00080000:3.0:1713481296.545148:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078026300, transno 4296030638 00000004:00080000:3.0:1713481296.545149:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e132d80, transno 4296030639 00000004:00080000:3.0:1713481296.545151:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec40e00, transno 4296030640 00000004:00080000:3.0:1713481296.545153:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077327b80, transno 4296030641 00000004:00080000:3.0:1713481296.545154:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e130000, transno 4296030642 00000004:00080000:3.0:1713481296.545156:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339d180, transno 4296030649 00000004:00080000:3.0:1713481296.545157:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339ea00, transno 4296030650 00000004:00080000:3.0:1713481296.545159:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339f800, transno 4296030651 00000004:00080000:3.0:1713481296.545160:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339dc00, transno 4296030652 00000004:00080000:3.0:1713481296.545162:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339c380, transno 4296030653 00000004:00080000:3.0:1713481296.545163:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339fb80, transno 4296030655 00000004:00080000:3.0:1713481296.545165:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe6aa00, transno 4296030656 00000004:00080000:3.0:1713481296.545166:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339ed80, transno 4296030657 00000004:00080000:3.0:1713481296.545168:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a95c00, transno 4296030658 00000004:00080000:3.0:1713481296.545169:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec57480, transno 4296030659 00000004:00080000:3.0:1713481296.545171:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe69c00, transno 4296030660 00000004:00080000:3.0:1713481296.545173:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078619180, transno 4296030661 00000004:00080000:3.0:1713481296.545174:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7e300, transno 4296030663 00000004:00080000:3.0:1713481296.545176:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7c000, transno 4296030664 00000004:00080000:3.0:1713481296.545178:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803c2300, transno 4296030665 00000004:00080000:3.0:1713481296.545179:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7d880, transno 4296030666 00000004:00080000:3.0:1713481296.545181:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7e680, transno 4296030667 00000004:00080000:3.0:1713481296.545182:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7f100, transno 4296030668 00000004:00080000:3.0:1713481296.545184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d254700, transno 4296030669 00000004:00080000:3.0:1713481296.545185:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7ea00, transno 4296030670 00000004:00080000:3.0:1713481296.545187:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d213b80, transno 4296030671 00000004:00080000:3.0:1713481296.545189:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d210700, transno 4296030672 00000004:00080000:3.0:1713481296.545191:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d213100, transno 4296030673 00000004:00080000:3.0:1713481296.545193:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d212a00, transno 4296030674 00000004:00080000:3.0:1713481296.545195:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d213480, transno 4296030675 00000004:00080000:3.0:1713481296.545196:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d211c00, transno 4296030676 00000004:00080000:3.0:1713481296.545198:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202cb480, transno 4296030679 00000004:00080000:3.0:1713481296.545200:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787fc000, transno 4296030682 00000004:00080000:3.0:1713481296.545201:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787fd180, transno 4296030683 00000004:00080000:3.0:1713481296.545203:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012002c700, transno 4296030684 00000004:00080000:3.0:1713481296.545204:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012002c000, transno 4296030685 00000004:00080000:3.0:1713481296.545206:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d210000, transno 4296030687 00000004:00080000:3.0:1713481296.545207:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed85f80, transno 4296030689 00000004:00080000:3.0:1713481296.545209:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed85c00, transno 4296030690 00000004:00080000:3.0:1713481296.545210:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed84e00, transno 4296030691 00000004:00080000:3.0:1713481296.545212:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed84000, transno 4296030692 00000004:00080000:3.0:1713481296.545213:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078764e00, transno 4296030694 00000004:00080000:3.0:1713481296.545216:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803c1180, transno 4296030695 00000004:00080000:3.0:1713481296.545217:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078767800, transno 4296030696 00000004:00080000:3.0:1713481296.545219:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609dc00, transno 4296030697 00000004:00080000:3.0:1713481296.545220:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609c700, transno 4296030698 00000004:00080000:3.0:1713481296.545222:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078765180, transno 4296030699 00000004:00080000:3.0:1713481296.545224:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078767480, transno 4296030700 00000004:00080000:3.0:1713481296.545225:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609e300, transno 4296030701 00000004:00080000:3.0:1713481296.545227:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072adf800, transno 4296030703 00000004:00080000:3.0:1713481296.545229:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072adea00, transno 4296030704 00000004:00080000:3.0:1713481296.545230:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072adca80, transno 4296030705 00000004:00080000:3.0:1713481296.545232:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072addf80, transno 4296030706 00000004:00080000:3.0:1713481296.545234:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5c700, transno 4296030714 00000004:00080000:3.0:1713481296.545236:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5e680, transno 4296030715 00000004:00080000:3.0:1713481296.545238:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5f100, transno 4296030716 00000004:00080000:3.0:1713481296.545241:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082307800, transno 4296030717 00000004:00080000:3.0:1713481296.545242:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5c000, transno 4296030718 00000004:00080000:3.0:1713481296.545244:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b4ed80, transno 4296030719 00000004:00080000:3.0:1713481296.545246:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b4e680, transno 4296030720 00000004:00080000:3.0:1713481296.545248:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082304000, transno 4296030721 00000004:00080000:3.0:1713481296.545249:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a231f80, transno 4296030722 00000004:00080000:3.0:1713481296.545251:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075506680, transno 4296030723 00000004:00080000:3.0:1713481296.545252:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075505c00, transno 4296030724 00000004:00080000:3.0:1713481296.545254:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075506d80, transno 4296030725 00000004:00080000:3.0:1713481296.545255:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5dc00, transno 4296030726 00000004:00080000:3.0:1713481296.545256:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a232a00, transno 4296030727 00000004:00080000:3.0:1713481296.545257:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a233800, transno 4296030728 00000004:00080000:3.0:1713481296.545259:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a232d80, transno 4296030729 00000004:00080000:3.0:1713481296.545260:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a233480, transno 4296030730 00000004:00080000:3.0:1713481296.545261:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5df80, transno 4296030731 00000004:00080000:3.0:1713481296.545263:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a233b80, transno 4296030732 00000004:00080000:3.0:1713481296.545264:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079564380, transno 4296030733 00000004:00080000:3.0:1713481296.545266:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079567100, transno 4296030734 00000004:00080000:3.0:1713481296.545267:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5f800, transno 4296030735 00000004:00080000:3.0:1713481296.545269:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798fb100, transno 4296030736 00000004:00080000:3.0:1713481296.545270:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798fb480, transno 4296030737 00000004:00080000:3.0:1713481296.545271:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845ed80, transno 4296030738 00000004:00080000:3.0:1713481296.545273:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798fad80, transno 4296030739 00000004:00080000:3.0:1713481296.545274:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845d880, transno 4296030740 00000004:00080000:3.0:1713481296.545275:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845ce00, transno 4296030741 00000004:00080000:3.0:1713481296.545277:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008318c000, transno 4296030742 00000004:00080000:3.0:1713481296.545279:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008318ce00, transno 4296030743 00000004:00080000:3.0:1713481296.545280:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008318c700, transno 4296030744 00000004:00080000:3.0:1713481296.545282:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5e300, transno 4296030745 00000004:00080000:3.0:1713481296.545283:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b42a00, transno 4296030746 00000004:00080000:3.0:1713481296.545286:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008318df80, transno 4296030747 00000004:00080000:3.0:1713481296.545288:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008318ed80, transno 4296030748 00000004:00080000:3.0:1713481296.545290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5fb80, transno 4296030749 00000004:00080000:3.0:1713481296.545292:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5ea00, transno 4296030750 00000004:00080000:3.0:1713481296.545294:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5f480, transno 4296030751 00000004:00080000:3.0:1713481296.545296:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5d180, transno 4296030752 00000004:00080000:3.0:1713481296.545297:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5ed80, transno 4296030753 00000004:00080000:3.0:1713481296.545299:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5df80, transno 4296030754 00000004:00080000:3.0:1713481296.545300:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5dc00, transno 4296030755 00000004:00080000:3.0:1713481296.545301:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5ca80, transno 4296030756 00000004:00080000:3.0:1713481296.545303:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5c700, transno 4296030757 00000004:00080000:3.0:1713481296.545305:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b40a80, transno 4296030758 00000004:00080000:3.0:1713481296.545306:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075544700, transno 4296030759 00000004:00080000:3.0:1713481296.545308:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007841e680, transno 4296030760 00000004:00080000:3.0:1713481296.545309:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d5e680, transno 4296030761 00000004:00080000:3.0:1713481296.545311:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0b8380, transno 4296030764 00000004:00080000:3.0:1713481296.545313:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c7480, transno 4296030768 00000004:00080000:3.0:1713481296.545314:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077937480, transno 4296030770 00000004:00080000:3.0:1713481296.545316:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2d1c00, transno 4296030772 00000004:00080000:3.0:1713481296.545318:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0ba300, transno 4296030773 00000004:00080000:3.0:1713481296.545319:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2d0e00, transno 4296030775 00000004:00080000:3.0:1713481296.545321:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012caf2680, transno 4296030777 00000004:00080000:3.0:1713481296.545323:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012caf1180, transno 4296030778 00000004:00080000:3.0:1713481296.545325:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075442680, transno 4296030779 00000004:00080000:3.0:1713481296.545326:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075507480, transno 4296030780 00000004:00080000:3.0:1713481296.545328:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007841fb80, transno 4296030781 00000004:00080000:3.0:1713481296.545329:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079564000, transno 4296030782 00000004:00080000:3.0:1713481296.545331:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0b9500, transno 4296030783 00000004:00080000:3.0:1713481296.545332:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133be0700, transno 4296030784 00000004:00080000:3.0:1713481296.545334:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077937800, transno 4296030785 00000004:00080000:3.0:1713481296.545336:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2d0700, transno 4296030787 00000004:00080000:3.0:1713481296.545338:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686ce00, transno 4296030788 00000004:00080000:3.0:1713481296.545340:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686d880, transno 4296030789 00000004:00080000:3.0:1713481296.545343:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da46300, transno 4296030790 00000004:00080000:3.0:1713481296.545345:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686e300, transno 4296030791 00000004:00080000:3.0:1713481296.545348:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077388700, transno 4296030792 00000004:00080000:3.0:1713481296.545351:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077389c00, transno 4296030793 00000004:00080000:3.0:1713481296.545353:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686ea00, transno 4296030794 00000004:00080000:3.0:1713481296.545356:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077389880, transno 4296030795 00000004:00080000:3.0:1713481296.545358:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077388380, transno 4296030796 00000004:00080000:3.0:1713481296.545361:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124d46d80, transno 4296030797 00000004:00080000:3.0:1713481296.545364:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b32a00, transno 4296030798 00000004:00080000:3.0:1713481296.545366:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076822680, transno 4296030799 00000004:00080000:3.0:1713481296.545369:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075505f80, transno 4296030800 00000004:00080000:3.0:1713481296.545372:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008318f100, transno 4296030807 00000004:00080000:3.0:1713481296.545374:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075440a80, transno 4296030808 00000004:00080000:3.0:1713481296.545376:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075443480, transno 4296030809 00000004:00080000:3.0:1713481296.545379:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120b49180, transno 4296030810 00000004:00080000:3.0:1713481296.545382:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120b48a80, transno 4296030811 00000004:00080000:3.0:1713481296.545385:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120b48380, transno 4296030812 00000004:00080000:3.0:1713481296.545388:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9f480, transno 4296030813 00000004:00080000:3.0:1713481296.545390:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be1180, transno 4296030814 00000004:00080000:3.0:1713481296.545393:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120b48e00, transno 4296030815 00000004:00080000:3.0:1713481296.545396:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120095500, transno 4296030816 00000004:00080000:3.0:1713481296.545398:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120097b80, transno 4296030817 00000004:00080000:3.0:1713481296.545401:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120094700, transno 4296030818 00000004:00080000:3.0:1713481296.545404:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120094380, transno 4296030819 00000004:00080000:3.0:1713481296.545406:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120096d80, transno 4296030820 00000004:00080000:3.0:1713481296.545408:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120097800, transno 4296030821 00000004:00080000:3.0:1713481296.545411:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089ae9500, transno 4296030822 00000004:00080000:3.0:1713481296.545415:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089aeb480, transno 4296030823 00000004:00080000:3.0:1713481296.545418:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089aead80, transno 4296030824 00000004:00080000:3.0:1713481296.545420:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089aea300, transno 4296030825 00000004:00080000:3.0:1713481296.545423:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec6dc00, transno 4296030827 00000004:00080000:3.0:1713481296.545425:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec6fb80, transno 4296030828 00000004:00080000:3.0:1713481296.545428:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec6e680, transno 4296030829 00000004:00080000:3.0:1713481296.545430:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086966a00, transno 4296030830 00000004:00080000:3.0:1713481296.545432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086966680, transno 4296030831 00000004:00080000:3.0:1713481296.545435:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec6d180, transno 4296030832 00000004:00080000:3.0:1713481296.545437:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086964700, transno 4296030833 00000004:00080000:3.0:1713481296.545439:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d158e00, transno 4296030834 00000004:00080000:3.0:1713481296.545441:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d158000, transno 4296030835 00000004:00080000:3.0:1713481296.545444:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf0380, transno 4296030836 00000004:00080000:3.0:1713481296.545446:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a43100, transno 4296030838 00000004:00080000:3.0:1713481296.545449:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a42680, transno 4296030839 00000004:00080000:3.0:1713481296.545451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a42d80, transno 4296030840 00000004:00080000:3.0:1713481296.545453:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a41180, transno 4296030841 00000004:00080000:3.0:1713481296.545456:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f07480, transno 4296030842 00000004:00080000:3.0:1713481296.545458:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a41880, transno 4296030843 00000004:00080000:3.0:1713481296.545460:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784d4700, transno 4296030844 00000004:00080000:3.0:1713481296.545463:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a41f80, transno 4296030845 00000004:00080000:3.0:1713481296.545466:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a40a80, transno 4296030846 00000004:00080000:3.0:1713481296.545468:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f07800, transno 4296030847 00000004:00080000:3.0:1713481296.545470:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784d5180, transno 4296030848 00000004:00080000:3.0:1713481296.545474:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f05180, transno 4296030849 00000004:00080000:3.0:1713481296.545476:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132248000, transno 4296030850 00000004:00080000:3.0:1713481296.545479:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098232d80, transno 4296030851 00000004:00080000:3.0:1713481296.545481:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132249180, transno 4296030852 00000004:00080000:3.0:1713481296.545484:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132248a80, transno 4296030853 00000004:00080000:3.0:1713481296.545486:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013224b800, transno 4296030854 00000004:00080000:3.0:1713481296.545490:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9d500, transno 4296030855 00000004:00080000:3.0:1713481296.545492:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784d5880, transno 4296030858 00000004:00080000:3.0:1713481296.545495:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302f4a80, transno 4296030860 00000004:00080000:3.0:1713481296.545498:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962b4e00, transno 4296030861 00000004:00080000:3.0:1713481296.545501:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008481ca80, transno 4296030862 00000004:00080000:3.0:1713481296.545503:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008481dc00, transno 4296030863 00000004:00080000:3.0:1713481296.545506:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e724000, transno 4296030864 00000004:00080000:3.0:1713481296.545508:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008481df80, transno 4296030865 00000004:00080000:3.0:1713481296.545511:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e724700, transno 4296030866 00000004:00080000:3.0:1713481296.545514:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e724e00, transno 4296030867 00000004:00080000:3.0:1713481296.545516:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e727800, transno 4296030868 00000004:00080000:3.0:1713481296.545519:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e725180, transno 4296030870 00000004:00080000:3.0:1713481296.545521:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e727480, transno 4296030871 00000004:00080000:3.0:1713481296.545524:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783ff800, transno 4296030873 00000004:00080000:3.0:1713481296.545526:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783fc380, transno 4296030874 00000004:00080000:3.0:1713481296.545529:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9d880, transno 4296030875 00000004:00080000:3.0:1713481296.545531:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783fd180, transno 4296030876 00000004:00080000:3.0:1713481296.545534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e726a00, transno 4296030877 00000004:00080000:3.0:1713481296.545536:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783ff100, transno 4296030878 00000004:00080000:3.0:1713481296.545539:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150df80, transno 4296030880 00000004:00080000:3.0:1713481296.545542:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150ca80, transno 4296030881 00000004:00080000:3.0:1713481296.545546:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150e300, transno 4296030882 00000004:00080000:3.0:1713481296.545549:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150e680, transno 4296030883 00000004:00080000:3.0:1713481296.545552:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a5500, transno 4296030884 00000004:00080000:3.0:1713481296.545554:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013584bb80, transno 4296030885 00000004:00080000:3.0:1713481296.545557:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008318ea00, transno 4296030886 00000004:00080000:3.0:1713481296.545560:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120b4aa00, transno 4296030887 00000004:00080000:3.0:1713481296.545562:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120648e00, transno 4296030888 00000004:00080000:3.0:1713481296.545565:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135849f80, transno 4296030889 00000004:00080000:3.0:1713481296.545568:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120648380, transno 4296030890 00000004:00080000:3.0:1713481296.545571:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302f5180, transno 4296030891 00000004:00080000:3.0:1713481296.545573:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302f4000, transno 4296030892 00000004:00080000:3.0:1713481296.545576:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302f5c00, transno 4296030893 00000004:00080000:3.0:1713481296.545579:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302f5f80, transno 4296030894 00000004:00080000:3.0:1713481296.545581:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9df80, transno 4296030895 00000004:00080000:3.0:1713481296.545584:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9c000, transno 4296030896 00000004:00080000:3.0:1713481296.545586:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9ce00, transno 4296030897 00000004:00080000:3.0:1713481296.545589:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9ea00, transno 4296030898 00000004:00080000:3.0:1713481296.545592:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a6d80, transno 4296030899 00000004:00080000:3.0:1713481296.545595:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a4380, transno 4296030900 00000004:00080000:3.0:1713481296.545598:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302f7100, transno 4296030901 00000004:00080000:3.0:1713481296.545600:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a7800, transno 4296030902 00000004:00080000:3.0:1713481296.545603:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a5880, transno 4296030903 00000004:00080000:3.0:1713481296.545606:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9f100, transno 4296030904 00000004:00080000:3.0:1713481296.545608:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008220b100, transno 4296030905 00000004:00080000:3.0:1713481296.545611:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008220b480, transno 4296030906 00000004:00080000:3.0:1713481296.545613:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082208700, transno 4296030907 00000004:00080000:3.0:1713481296.545616:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082208380, transno 4296030908 00000004:00080000:3.0:1713481296.545619:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008220aa00, transno 4296030909 00000004:00080000:3.0:1713481296.545622:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821d180, transno 4296030910 00000004:00080000:3.0:1713481296.545625:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082209880, transno 4296030911 00000004:00080000:3.0:1713481296.545628:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ada680, transno 4296030912 00000004:00080000:3.0:1713481296.545630:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c27df80, transno 4296030913 00000004:00080000:3.0:1713481296.545633:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c27e300, transno 4296030914 00000004:00080000:3.0:1713481296.545635:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c27d500, transno 4296030915 00000004:00080000:3.0:1713481296.545637:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c27f800, transno 4296030916 00000004:00080000:3.0:1713481296.545641:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c27dc00, transno 4296030917 00000004:00080000:3.0:1713481296.545643:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2fb80, transno 4296030918 00000004:00080000:3.0:1713481296.545646:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2d500, transno 4296030919 00000004:00080000:3.0:1713481296.545648:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2ca80, transno 4296030920 00000004:00080000:3.0:1713481296.545652:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2df80, transno 4296030921 00000004:00080000:3.0:1713481296.545654:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2c380, transno 4296030922 00000004:00080000:3.0:1713481296.545657:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2e680, transno 4296030923 00000004:00080000:3.0:1713481296.545659:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2d880, transno 4296030924 00000004:00080000:3.0:1713481296.545662:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2c000, transno 4296030925 00000004:00080000:3.0:1713481296.545677:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2ef800, transno 4296030926 00000004:00080000:3.0:1713481296.545680:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097e41880, transno 4296030927 00000004:00080000:3.0:1713481296.545683:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082305f80, transno 4296030928 00000004:00080000:3.0:1713481296.545686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008168d180, transno 4296030930 00000004:00080000:3.0:1713481296.545688:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082305c00, transno 4296030931 00000004:00080000:3.0:1713481296.545691:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086965500, transno 4296030932 00000004:00080000:3.0:1713481296.545694:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf2680, transno 4296030933 00000004:00080000:3.0:1713481296.545696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b40e00, transno 4296030934 00000004:00080000:3.0:1713481296.545699:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b42d80, transno 4296030935 00000004:00080000:3.0:1713481296.545702:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5ca80, transno 4296030939 00000004:00080000:3.0:1713481296.545704:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b43480, transno 4296030940 00000004:00080000:3.0:1713481296.545707:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5e300, transno 4296030941 00000004:00080000:3.0:1713481296.545709:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097e43480, transno 4296030944 00000004:00080000:3.0:1713481296.545712:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf3100, transno 4296030945 00000004:00080000:3.0:1713481296.545715:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5ed80, transno 4296030946 00000004:00080000:3.0:1713481296.545718:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b40700, transno 4296030947 00000004:00080000:3.0:1713481296.545721:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076af7b80, transno 4296030948 00000004:00080000:3.0:1713481296.545723:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076af5180, transno 4296030949 00000004:00080000:3.0:1713481296.545726:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a908380, transno 4296030950 00000004:00080000:3.0:1713481296.545729:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076af5880, transno 4296030951 00000004:00080000:3.0:1713481296.545731:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a90aa00, transno 4296030952 00000004:00080000:3.0:1713481296.545734:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a908e00, transno 4296030953 00000004:00080000:3.0:1713481296.545736:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4ed80, transno 4296030954 00000004:00080000:3.0:1713481296.545739:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4dc00, transno 4296030955 00000004:00080000:3.0:1713481296.545741:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a908700, transno 4296030956 00000004:00080000:3.0:1713481296.545744:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4f800, transno 4296030958 00000004:00080000:3.0:1713481296.545747:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4ea00, transno 4296030959 00000004:00080000:3.0:1713481296.545750:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4c700, transno 4296030961 00000004:00080000:3.0:1713481296.545753:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012003ad80, transno 4296030962 00000004:00080000:3.0:1713481296.545755:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012003bb80, transno 4296030963 00000004:00080000:3.0:1713481296.545758:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4c380, transno 4296030964 00000004:00080000:3.0:1713481296.545760:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120038700, transno 4296030965 00000004:00080000:3.0:1713481296.545762:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4d500, transno 4296030966 00000004:00080000:3.0:1713481296.545765:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af72a00, transno 4296030968 00000004:00080000:3.0:1713481296.545768:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af73b80, transno 4296030969 00000004:00080000:3.0:1713481296.545771:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf0e00, transno 4296030972 00000004:00080000:3.0:1713481296.545774:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686fb80, transno 4296030973 00000004:00080000:3.0:1713481296.545777:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a90b800, transno 4296030974 00000004:00080000:3.0:1713481296.545780:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9ad880, transno 4296030975 00000004:00080000:3.0:1713481296.545782:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120039180, transno 4296030976 00000004:00080000:3.0:1713481296.545785:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36b480, transno 4296030977 00000004:00080000:3.0:1713481296.545787:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36bb80, transno 4296030978 00000004:00080000:3.0:1713481296.545790:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9af800, transno 4296030979 00000004:00080000:3.0:1713481296.545792:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36a300, transno 4296030980 00000004:00080000:3.0:1713481296.545795:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36ad80, transno 4296030981 00000004:00080000:3.0:1713481296.545798:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132236a00, transno 4296030982 00000004:00080000:3.0:1713481296.545801:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132236680, transno 4296030983 00000004:00080000:3.0:1713481296.545804:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e368a80, transno 4296030984 00000004:00080000:3.0:1713481296.545806:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36a680, transno 4296030985 00000004:00080000:3.0:1713481296.545809:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132237100, transno 4296030986 00000004:00080000:3.0:1713481296.545811:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a4a80, transno 4296030987 00000004:00080000:3.0:1713481296.545814:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2f100, transno 4296030989 00000004:00080000:3.0:1713481296.545816:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a4700, transno 4296030990 00000004:00080000:3.0:1713481296.545818:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012064b100, transno 4296030991 00000004:00080000:3.0:1713481296.545821:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821d500, transno 4296030992 00000004:00080000:3.0:1713481296.545825:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089ae8380, transno 4296030993 00000004:00080000:3.0:1713481296.545827:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089aea680, transno 4296030994 00000004:00080000:3.0:1713481296.545830:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821c380, transno 4296030995 00000004:00080000:3.0:1713481296.545832:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089ae9880, transno 4296030996 00000004:00080000:3.0:1713481296.545835:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6bd500, transno 4296030998 00000004:00080000:3.0:1713481296.545838:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6bfb80, transno 4296030999 00000004:00080000:3.0:1713481296.545840:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6bc380, transno 4296031000 00000004:00080000:3.0:1713481296.545843:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6bf100, transno 4296031001 00000004:00080000:3.0:1713481296.545846:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af70a80, transno 4296031002 00000004:00080000:3.0:1713481296.545848:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2ed80, transno 4296031003 00000004:00080000:3.0:1713481296.545851:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e368000, transno 4296031004 00000004:00080000:3.0:1713481296.545854:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5c380, transno 4296031005 00000004:00080000:3.0:1713481296.545856:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6bd180, transno 4296031006 00000004:00080000:3.0:1713481296.545859:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5fb80, transno 4296031007 00000004:00080000:3.0:1713481296.545862:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf1880, transno 4296031008 00000004:00080000:3.0:1713481296.545865:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a909500, transno 4296031009 00000004:00080000:3.0:1713481296.545867:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a909180, transno 4296031010 00000004:00080000:3.0:1713481296.545869:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a908000, transno 4296031011 00000004:00080000:3.0:1713481296.545872:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a909c00, transno 4296031013 00000004:00080000:3.0:1713481296.545875:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a908a80, transno 4296031014 00000004:00080000:3.0:1713481296.545878:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a0d180, transno 4296031016 00000004:00080000:3.0:1713481296.545880:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332f100, transno 4296031017 00000004:00080000:3.0:1713481296.545883:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012252e680, transno 4296031018 00000004:00080000:3.0:1713481296.545886:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012252f480, transno 4296031019 00000004:00080000:3.0:1713481296.545888:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012252d880, transno 4296031020 00000004:00080000:3.0:1713481296.545891:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120483480, transno 4296031021 00000004:00080000:3.0:1713481296.545893:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a0f480, transno 4296031022 00000004:00080000:3.0:1713481296.545895:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9ae680, transno 4296031028 00000004:00080000:3.0:1713481296.545898:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9ace00, transno 4296031029 00000004:00080000:3.0:1713481296.545900:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794e3480, transno 4296031030 00000004:00080000:3.0:1713481296.545904:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120482300, transno 4296031031 00000004:00080000:3.0:1713481296.545906:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332c000, transno 4296031032 00000004:00080000:3.0:1713481296.545909:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120482d80, transno 4296031033 00000004:00080000:3.0:1713481296.545911:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120481880, transno 4296031034 00000004:00080000:3.0:1713481296.545914:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794e0e00, transno 4296031035 00000004:00080000:3.0:1713481296.545916:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a4e00, transno 4296031036 00000004:00080000:3.0:1713481296.545919:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132235c00, transno 4296031037 00000004:00080000:3.0:1713481296.545922:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a3480, transno 4296031038 00000004:00080000:3.0:1713481296.545925:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089aebb80, transno 4296031039 00000004:00080000:3.0:1713481296.545928:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ab3dc00, transno 4296031040 00000004:00080000:3.0:1713481296.545931:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6bc000, transno 4296031041 00000004:00080000:3.0:1713481296.545933:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6be300, transno 4296031042 00000004:00080000:3.0:1713481296.545936:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e369f80, transno 4296031043 00000004:00080000:3.0:1713481296.545939:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6bea00, transno 4296031044 00000004:00080000:3.0:1713481296.545942:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133ac9180, transno 4296031045 00000004:00080000:3.0:1713481296.545944:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a0c380, transno 4296031046 00000004:00080000:3.0:1713481296.545947:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a0ca80, transno 4296031047 00000004:00080000:3.0:1713481296.545949:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af73480, transno 4296031048 00000004:00080000:3.0:1713481296.545952:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af71c00, transno 4296031049 00000004:00080000:3.0:1713481296.545954:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120482a00, transno 4296031050 00000004:00080000:3.0:1713481296.545957:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008409d880, transno 4296031051 00000004:00080000:3.0:1713481296.545961:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120480e00, transno 4296031052 00000004:00080000:3.0:1713481296.545964:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0a9180, transno 4296031053 00000004:00080000:3.0:1713481296.545966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0a8e00, transno 4296031054 00000004:00080000:3.0:1713481296.545969:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0aa680, transno 4296031055 00000004:00080000:3.0:1713481296.545971:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0a9500, transno 4296031056 00000004:00080000:3.0:1713481296.545974:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0aad80, transno 4296031057 00000004:00080000:3.0:1713481296.545977:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081608380, transno 4296031058 00000004:00080000:3.0:1713481296.545979:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0abb80, transno 4296031059 00000004:00080000:3.0:1713481296.545981:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0a8a80, transno 4296031060 00000004:00080000:3.0:1713481296.545985:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf3b80, transno 4296031061 00000004:00080000:3.0:1713481296.545987:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686ca80, transno 4296031062 00000004:00080000:3.0:1713481296.545990:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e92680, transno 4296031063 00000004:00080000:3.0:1713481296.545993:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120481f80, transno 4296031064 00000004:00080000:3.0:1713481296.545995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0ab480, transno 4296031065 00000004:00080000:3.0:1713481296.545997:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120480a80, transno 4296031066 00000004:00080000:3.0:1713481296.546000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121dd5c00, transno 4296031070 00000004:00080000:3.0:1713481296.546003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121dd4e00, transno 4296031072 00000004:00080000:3.0:1713481296.546006:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133ac9f80, transno 4296031073 00000004:00080000:3.0:1713481296.546008:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad8e00, transno 4296031074 00000004:00080000:3.0:1713481296.546011:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133acad80, transno 4296031075 00000004:00080000:3.0:1713481296.546014:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084302300, transno 4296031077 00000004:00080000:3.0:1713481296.546016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e368700, transno 4296031079 00000004:00080000:3.0:1713481296.546019:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0ab100, transno 4296031080 00000004:00080000:3.0:1713481296.546021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121dd6680, transno 4296031081 00000004:00080000:3.0:1713481296.546024:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332d880, transno 4296031082 00000004:00080000:3.0:1713481296.546026:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332df80, transno 4296031083 00000004:00080000:3.0:1713481296.546028:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e368380, transno 4296031084 00000004:00080000:3.0:1713481296.546031:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332e680, transno 4296031086 00000004:00080000:3.0:1713481296.546034:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d98e00, transno 4296031087 00000004:00080000:3.0:1713481296.546036:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d99c00, transno 4296031088 00000004:00080000:3.0:1713481296.546038:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d9bb80, transno 4296031090 00000004:00080000:3.0:1713481296.546041:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d99880, transno 4296031091 00000004:00080000:3.0:1713481296.546043:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d9b800, transno 4296031092 00000004:00080000:3.0:1713481296.546046:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a17100, transno 4296031093 00000004:00080000:3.0:1713481296.546048:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a17480, transno 4296031094 00000004:00080000:3.0:1713481296.546050:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a16d80, transno 4296031095 00000004:00080000:3.0:1713481296.546052:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e6b480, transno 4296031096 00000004:00080000:3.0:1713481296.546055:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a14700, transno 4296031097 00000004:00080000:3.0:1713481296.546057:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d9b480, transno 4296031098 00000004:00080000:3.0:1713481296.546060:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a17800, transno 4296031099 00000004:00080000:3.0:1713481296.546063:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332f480, transno 4296031100 00000004:00080000:3.0:1713481296.546065:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a15180, transno 4296031101 00000004:00080000:3.0:1713481296.546068:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a15f80, transno 4296031102 00000004:00080000:3.0:1713481296.546071:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e69c00, transno 4296031103 00000004:00080000:3.0:1713481296.546074:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a88a80, transno 4296031104 00000004:00080000:3.0:1713481296.546076:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af70380, transno 4296031105 00000004:00080000:3.0:1713481296.546079:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c2fdc00, transno 4296031106 00000004:00080000:3.0:1713481296.546082:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a89880, transno 4296031107 00000004:00080000:3.0:1713481296.546085:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797fed80, transno 4296031108 00000004:00080000:3.0:1713481296.546088:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797fdf80, transno 4296031109 00000004:00080000:3.0:1713481296.546090:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797ffb80, transno 4296031110 00000004:00080000:3.0:1713481296.546093:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797fdc00, transno 4296031111 00000004:00080000:3.0:1713481296.546096:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a5a300, transno 4296031112 00000004:00080000:3.0:1713481296.546099:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072aca680, transno 4296031113 00000004:00080000:3.0:1713481296.546102:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a5bb80, transno 4296031114 00000004:00080000:3.0:1713481296.546104:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077198000, transno 4296031115 00000004:00080000:3.0:1713481296.546107:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077199880, transno 4296031116 00000004:00080000:3.0:1713481296.546109:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007719b480, transno 4296031117 00000004:00080000:3.0:1713481296.546112:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007719b100, transno 4296031118 00000004:00080000:3.0:1713481296.546114:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077198a80, transno 4296031119 00000004:00080000:3.0:1713481296.546135:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077198380, transno 4296031120 00000004:00080000:3.0:1713481296.546139:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007719ad80, transno 4296031121 00000004:00080000:3.0:1713481296.546142:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083281180, transno 4296031122 00000004:00080000:3.0:1713481296.546145:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083281880, transno 4296031123 00000004:00080000:3.0:1713481296.546147:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b5aa00, transno 4296031124 00000004:00080000:3.0:1713481296.546150:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b5b800, transno 4296031125 00000004:00080000:3.0:1713481296.546152:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083283100, transno 4296031126 00000004:00080000:3.0:1713481296.546155:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077198700, transno 4296031127 00000004:00080000:3.0:1713481296.546157:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17d880, transno 4296031128 00000004:00080000:3.0:1713481296.546160:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17c000, transno 4296031129 00000004:00080000:3.0:1713481296.546163:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5f100, transno 4296031130 00000004:00080000:3.0:1713481296.546166:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17fb80, transno 4296031131 00000004:00080000:3.0:1713481296.546168:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5c000, transno 4296031132 00000004:00080000:3.0:1713481296.546171:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17f100, transno 4296031133 00000004:00080000:3.0:1713481296.546174:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5fb80, transno 4296031134 00000004:00080000:3.0:1713481296.546176:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5d500, transno 4296031135 00000004:00080000:3.0:1713481296.546179:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784eaa00, transno 4296031136 00000004:00080000:3.0:1713481296.546182:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784e8700, transno 4296031137 00000004:00080000:3.0:1713481296.546184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5df80, transno 4296031138 00000004:00080000:3.0:1713481296.546187:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcd8a80, transno 4296031139 00000004:00080000:3.0:1713481296.546190:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcd8700, transno 4296031140 00000004:00080000:3.0:1713481296.546192:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcd9180, transno 4296031141 00000004:00080000:3.0:1713481296.546195:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcdb800, transno 4296031142 00000004:00080000:3.0:1713481296.546198:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcd9c00, transno 4296031143 00000004:00080000:3.0:1713481296.546200:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcdaa00, transno 4296031144 00000004:00080000:3.0:1713481296.546203:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205aca80, transno 4296031145 00000004:00080000:3.0:1713481296.546206:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205adf80, transno 4296031146 00000004:00080000:3.0:1713481296.546208:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcdb100, transno 4296031147 00000004:00080000:3.0:1713481296.546211:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205ace00, transno 4296031148 00000004:00080000:3.0:1713481296.546214:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205aed80, transno 4296031149 00000004:00080000:3.0:1713481296.546217:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcd8380, transno 4296031150 00000004:00080000:3.0:1713481296.546219:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205ad180, transno 4296031151 00000004:00080000:3.0:1713481296.546222:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad3800, transno 4296031152 00000004:00080000:3.0:1713481296.546225:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad0380, transno 4296031153 00000004:00080000:3.0:1713481296.546227:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad1180, transno 4296031154 00000004:00080000:3.0:1713481296.546230:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205af800, transno 4296031155 00000004:00080000:3.0:1713481296.546232:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205aea00, transno 4296031156 00000004:00080000:3.0:1713481296.546234:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad2a00, transno 4296031157 00000004:00080000:3.0:1713481296.546237:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad0700, transno 4296031158 00000004:00080000:3.0:1713481296.546240:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad3b80, transno 4296031159 00000004:00080000:3.0:1713481296.546243:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d96680, transno 4296031160 00000004:00080000:3.0:1713481296.546245:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ec6680, transno 4296031161 00000004:00080000:3.0:1713481296.546248:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d94a80, transno 4296031162 00000004:00080000:3.0:1713481296.546250:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ec7100, transno 4296031163 00000004:00080000:3.0:1713481296.546253:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad1500, transno 4296031164 00000004:00080000:3.0:1713481296.546255:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f4e00, transno 4296031165 00000004:00080000:3.0:1713481296.546258:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f5880, transno 4296031166 00000004:00080000:3.0:1713481296.546260:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f5c00, transno 4296031167 00000004:00080000:3.0:1713481296.546263:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad2300, transno 4296031168 00000004:00080000:3.0:1713481296.546266:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f7100, transno 4296031169 00000004:00080000:3.0:1713481296.546268:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f7480, transno 4296031170 00000004:00080000:3.0:1713481296.546271:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f7800, transno 4296031171 00000004:00080000:3.0:1713481296.546273:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa5500, transno 4296031172 00000004:00080000:3.0:1713481296.546277:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad0a80, transno 4296031173 00000004:00080000:3.0:1713481296.546279:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa5880, transno 4296031174 00000004:00080000:3.0:1713481296.546282:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17d180, transno 4296031175 00000004:00080000:3.0:1713481296.546284:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa4380, transno 4296031176 00000004:00080000:3.0:1713481296.546287:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa4000, transno 4296031177 00000004:00080000:3.0:1713481296.546290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f4700, transno 4296031178 00000004:00080000:3.0:1713481296.546292:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed0700, transno 4296031179 00000004:00080000:3.0:1713481296.546295:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed2a00, transno 4296031180 00000004:00080000:3.0:1713481296.546297:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed1f80, transno 4296031181 00000004:00080000:3.0:1713481296.546300:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed3100, transno 4296031182 00000004:00080000:3.0:1713481296.546303:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed1880, transno 4296031183 00000004:00080000:3.0:1713481296.546305:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891ea300, transno 4296031184 00000004:00080000:3.0:1713481296.546307:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed2d80, transno 4296031185 00000004:00080000:3.0:1713481296.546310:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891e9180, transno 4296031186 00000004:00080000:3.0:1713481296.546313:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891eb480, transno 4296031187 00000004:00080000:3.0:1713481296.546316:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed3480, transno 4296031188 00000004:00080000:3.0:1713481296.546319:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed1500, transno 4296031189 00000004:00080000:3.0:1713481296.546322:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891e8e00, transno 4296031190 00000004:00080000:3.0:1713481296.546325:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801af800, transno 4296031191 00000004:00080000:3.0:1713481296.546327:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801adf80, transno 4296031192 00000004:00080000:3.0:1713481296.546330:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faf4e00, transno 4296031193 00000004:00080000:3.0:1713481296.546333:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faf4000, transno 4296031194 00000004:00080000:3.0:1713481296.546335:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faf5180, transno 4296031195 00000004:00080000:3.0:1713481296.546337:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801ae300, transno 4296031196 00000004:00080000:3.0:1713481296.546340:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801aed80, transno 4296031197 00000004:00080000:3.0:1713481296.546342:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015df80, transno 4296031198 00000004:00080000:3.0:1713481296.546345:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015c000, transno 4296031199 00000004:00080000:3.0:1713481296.546348:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015c380, transno 4296031200 00000004:00080000:3.0:1713481296.546350:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015f800, transno 4296031201 00000004:00080000:3.0:1713481296.546353:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faf7800, transno 4296031202 00000004:00080000:3.0:1713481296.546356:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015f480, transno 4296031203 00000004:00080000:3.0:1713481296.546358:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faf5f80, transno 4296031204 00000004:00080000:3.0:1713481296.546361:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a73100, transno 4296031205 00000004:00080000:3.0:1713481296.546364:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a3800, transno 4296031206 00000004:00080000:3.0:1713481296.546366:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a71880, transno 4296031207 00000004:00080000:3.0:1713481296.546369:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a3b80, transno 4296031208 00000004:00080000:3.0:1713481296.546372:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faf7b80, transno 4296031209 00000004:00080000:3.0:1713481296.546374:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a2300, transno 4296031210 00000004:00080000:3.0:1713481296.546376:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea6d80, transno 4296031211 00000004:00080000:3.0:1713481296.546379:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea5880, transno 4296031212 00000004:00080000:3.0:1713481296.546381:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea4a80, transno 4296031213 00000004:00080000:3.0:1713481296.546384:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea7480, transno 4296031214 00000004:00080000:3.0:1713481296.546386:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea5500, transno 4296031215 00000004:00080000:3.0:1713481296.546389:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801af100, transno 4296031216 00000004:00080000:3.0:1713481296.546391:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a1500, transno 4296031217 00000004:00080000:3.0:1713481296.546393:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801ad880, transno 4296031218 00000004:00080000:3.0:1713481296.546397:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801adc00, transno 4296031219 00000004:00080000:3.0:1713481296.546399:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784eb100, transno 4296031220 00000004:00080000:3.0:1713481296.546401:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801ace00, transno 4296031221 00000004:00080000:3.0:1713481296.546404:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784e9180, transno 4296031222 00000004:00080000:3.0:1713481296.546406:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784ebb80, transno 4296031223 00000004:00080000:3.0:1713481296.546409:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5ed80, transno 4296031224 00000004:00080000:3.0:1713481296.546411:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5d180, transno 4296031225 00000004:00080000:3.0:1713481296.546414:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faf4380, transno 4296031226 00000004:00080000:3.0:1713481296.546417:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ec6d80, transno 4296031227 00000004:00080000:3.0:1713481296.546420:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136376d80, transno 4296031228 00000004:00080000:3.0:1713481296.546423:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af6d80, transno 4296031229 00000004:00080000:3.0:1713481296.546426:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082057100, transno 4296031230 00000004:00080000:3.0:1713481296.546429:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082057480, transno 4296031231 00000004:00080000:3.0:1713481296.546431:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082055500, transno 4296031232 00000004:00080000:3.0:1713481296.546434:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082055180, transno 4296031233 00000004:00080000:3.0:1713481296.546436:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794ab100, transno 4296031234 00000004:00080000:3.0:1713481296.546438:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082055c00, transno 4296031235 00000004:00080000:3.0:1713481296.546441:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794a9180, transno 4296031236 00000004:00080000:3.0:1713481296.546443:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794a9500, transno 4296031237 00000004:00080000:3.0:1713481296.546446:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794abb80, transno 4296031242 00000004:00080000:3.0:1713481296.546449:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e406a00, transno 4296031243 00000004:00080000:3.0:1713481296.546451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794a8a80, transno 4296031244 00000004:00080000:3.0:1713481296.546453:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794aa680, transno 4296031245 00000004:00080000:3.0:1713481296.546455:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e407100, transno 4296031246 00000004:00080000:3.0:1713481296.546458:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1c700, transno 4296031247 00000004:00080000:3.0:1713481296.546460:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1ed80, transno 4296031248 00000004:00080000:3.0:1713481296.546463:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1f100, transno 4296031249 00000004:00080000:3.0:1713481296.546466:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1ea00, transno 4296031250 00000004:00080000:3.0:1713481296.546468:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1fb80, transno 4296031251 00000004:00080000:3.0:1713481296.546471:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1d880, transno 4296031252 00000004:00080000:3.0:1713481296.546474:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bbfb80, transno 4296031253 00000004:00080000:3.0:1713481296.546476:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bbc700, transno 4296031254 00000004:00080000:3.0:1713481296.546480:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083281500, transno 4296031255 00000004:00080000:3.0:1713481296.546482:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083282300, transno 4296031256 00000004:00080000:3.0:1713481296.546484:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007719a300, transno 4296031258 00000004:00080000:3.0:1713481296.546487:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1ca80, transno 4296031259 00000004:00080000:3.0:1713481296.546490:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077199500, transno 4296031262 00000004:00080000:3.0:1713481296.546493:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec0f480, transno 4296031263 00000004:00080000:3.0:1713481296.546495:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec0dc00, transno 4296031264 00000004:00080000:3.0:1713481296.546498:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec0c380, transno 4296031265 00000004:00080000:3.0:1713481296.546501:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec0d880, transno 4296031266 00000004:00080000:3.0:1713481296.546504:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec0e300, transno 4296031267 00000004:00080000:3.0:1713481296.546507:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782ac000, transno 4296031268 00000004:00080000:3.0:1713481296.546509:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782adf80, transno 4296031269 00000004:00080000:3.0:1713481296.546512:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008223d500, transno 4296031270 00000004:00080000:3.0:1713481296.546514:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782af100, transno 4296031271 00000004:00080000:3.0:1713481296.546517:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007726a680, transno 4296031272 00000004:00080000:3.0:1713481296.546519:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782aea00, transno 4296031273 00000004:00080000:3.0:1713481296.546522:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782ad180, transno 4296031274 00000004:00080000:3.0:1713481296.546525:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782ac380, transno 4296031275 00000004:00080000:3.0:1713481296.546528:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec0fb80, transno 4296031276 00000004:00080000:3.0:1713481296.546531:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a3df80, transno 4296031277 00000004:00080000:3.0:1713481296.546533:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009faa6d80, transno 4296031278 00000004:00080000:3.0:1713481296.546536:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bff800, transno 4296031279 00000004:00080000:3.0:1713481296.546538:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a3e300, transno 4296031280 00000004:00080000:3.0:1713481296.546541:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bbf100, transno 4296031281 00000004:00080000:3.0:1713481296.546543:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009faa4e00, transno 4296031282 00000004:00080000:3.0:1713481296.546546:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136374000, transno 4296031283 00000004:00080000:3.0:1713481296.546549:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009faa6a00, transno 4296031284 00000004:00080000:3.0:1713481296.546551:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782ae680, transno 4296031285 00000004:00080000:3.0:1713481296.546554:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ec7b80, transno 4296031287 00000004:00080000:3.0:1713481296.546558:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009faa5880, transno 4296031289 00000004:00080000:3.0:1713481296.546561:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205ac000, transno 4296031290 00000004:00080000:3.0:1713481296.546564:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa6d80, transno 4296031293 00000004:00080000:3.0:1713481296.546566:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa7100, transno 4296031294 00000004:00080000:3.0:1713481296.546569:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b59180, transno 4296031295 00000004:00080000:3.0:1713481296.546572:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b59500, transno 4296031296 00000004:00080000:3.0:1713481296.546575:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120095880, transno 4296031297 00000004:00080000:3.0:1713481296.546577:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b5b100, transno 4296031300 00000004:00080000:3.0:1713481296.546580:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b59c00, transno 4296031301 00000004:00080000:3.0:1713481296.546583:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e69880, transno 4296031302 00000004:00080000:3.0:1713481296.546585:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009179c700, transno 4296031303 00000004:00080000:3.0:1713481296.546588:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d97480, transno 4296031304 00000004:00080000:3.0:1713481296.546591:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d94e00, transno 4296031305 00000004:00080000:3.0:1713481296.546594:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d95f80, transno 4296031308 00000004:00080000:3.0:1713481296.546596:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9aea00, transno 4296031309 00000004:00080000:3.0:1713481296.546598:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9adf80, transno 4296031310 00000004:00080000:3.0:1713481296.546601:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133acaa00, transno 4296031311 00000004:00080000:3.0:1713481296.546603:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132236d80, transno 4296031312 00000004:00080000:3.0:1713481296.546606:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794e3800, transno 4296031313 00000004:00080000:3.0:1713481296.546609:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9ad180, transno 4296031314 00000004:00080000:3.0:1713481296.546611:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794e1880, transno 4296031315 00000004:00080000:3.0:1713481296.546614:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782afb80, transno 4296031316 00000004:00080000:3.0:1713481296.546616:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec0d180, transno 4296031317 00000004:00080000:3.0:1713481296.546619:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008223dc00, transno 4296031318 00000004:00080000:3.0:1713481296.546622:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9aca80, transno 4296031319 00000004:00080000:3.0:1713481296.546624:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078417480, transno 4296031320 00000004:00080000:3.0:1713481296.546627:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007721d180, transno 4296031321 00000004:00080000:3.0:1713481296.546630:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007721f480, transno 4296031322 00000004:00080000:3.0:1713481296.546633:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5dc00, transno 4296031323 00000004:00080000:3.0:1713481296.546636:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007721e680, transno 4296031324 00000004:00080000:3.0:1713481296.546638:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007721f800, transno 4296031325 00000004:00080000:3.0:1713481296.546641:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801322a4700, transno 4296031326 00000004:00080000:3.0:1713481296.546644:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007731f100, transno 4296031327 00000004:00080000:3.0:1713481296.546646:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007731fb80, transno 4296031328 00000004:00080000:3.0:1713481296.546649:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007731d880, transno 4296031329 00000004:00080000:3.0:1713481296.546652:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007721fb80, transno 4296031330 00000004:00080000:3.0:1713481296.546655:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728edf80, transno 4296031331 00000004:00080000:3.0:1713481296.546658:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007731e300, transno 4296031332 00000004:00080000:3.0:1713481296.546660:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a8d7480, transno 4296031333 00000004:00080000:3.0:1713481296.546663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a8d4700, transno 4296031334 00000004:00080000:3.0:1713481296.546680:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ef100, transno 4296031335 00000004:00080000:3.0:1713481296.546683:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728efb80, transno 4296031336 00000004:00080000:3.0:1713481296.546686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ec380, transno 4296031337 00000004:00080000:3.0:1713481296.546688:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ee300, transno 4296031338 00000004:00080000:3.0:1713481296.546691:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ed180, transno 4296031339 00000004:00080000:3.0:1713481296.546693:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d9b100, transno 4296031340 00000004:00080000:3.0:1713481296.546696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d9a300, transno 4296031341 00000004:00080000:3.0:1713481296.546698:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a15880, transno 4296031342 00000004:00080000:3.0:1713481296.546701:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a14a80, transno 4296031343 00000004:00080000:3.0:1713481296.546703:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a14380, transno 4296031348 00000004:00080000:3.0:1713481296.546706:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e307480, transno 4296031353 00000004:00080000:3.0:1713481296.546709:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a15c00, transno 4296031354 00000004:00080000:3.0:1713481296.546711:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082054e00, transno 4296031355 00000004:00080000:3.0:1713481296.546713:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e68000, transno 4296031356 00000004:00080000:3.0:1713481296.546716:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120227800, transno 4296031357 00000004:00080000:3.0:1713481296.546719:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e68380, transno 4296031358 00000004:00080000:3.0:1713481296.546721:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796e1c00, transno 4296031359 00000004:00080000:3.0:1713481296.546724:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d69880, transno 4296031360 00000004:00080000:3.0:1713481296.546727:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aa1180, transno 4296031362 00000004:00080000:3.0:1713481296.546730:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0b9180, transno 4296031363 00000004:00080000:3.0:1713481296.546733:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078662680, transno 4296031364 00000004:00080000:3.0:1713481296.546735:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078661c00, transno 4296031365 00000004:00080000:3.0:1713481296.546738:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0b8700, transno 4296031366 00000004:00080000:3.0:1713481296.546740:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d69180, transno 4296031367 00000004:00080000:3.0:1713481296.546743:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078660700, transno 4296031368 00000004:00080000:3.0:1713481296.546746:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078662a00, transno 4296031369 00000004:00080000:3.0:1713481296.546748:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078661f80, transno 4296031370 00000004:00080000:3.0:1713481296.546751:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c2fe300, transno 4296031371 00000004:00080000:3.0:1713481296.546753:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d96d80, transno 4296031372 00000004:00080000:3.0:1713481296.546756:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d96a00, transno 4296031373 00000004:00080000:3.0:1713481296.546758:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078417800, transno 4296031374 00000004:00080000:3.0:1713481296.546761:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078417b80, transno 4296031375 00000004:00080000:3.0:1713481296.546763:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686b800, transno 4296031376 00000004:00080000:3.0:1713481296.546765:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078414000, transno 4296031377 00000004:00080000:3.0:1713481296.546768:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076869c00, transno 4296031378 00000004:00080000:3.0:1713481296.546770:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076869180, transno 4296031379 00000004:00080000:3.0:1713481296.546772:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078416a00, transno 4296031380 00000004:00080000:3.0:1713481296.546775:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b3ddc00, transno 4296031381 00000004:00080000:3.0:1713481296.546777:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797fd880, transno 4296031382 00000004:00080000:3.0:1713481296.546779:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009411b480, transno 4296031383 00000004:00080000:3.0:1713481296.546782:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1f800, transno 4296031385 00000004:00080000:3.0:1713481296.546785:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b9b480, transno 4296031386 00000004:00080000:3.0:1713481296.546787:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1f480, transno 4296031387 00000004:00080000:3.0:1713481296.546790:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009411a680, transno 4296031389 00000004:00080000:3.0:1713481296.546792:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e405880, transno 4296031390 00000004:00080000:3.0:1713481296.546795:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b99180, transno 4296031393 00000004:00080000:3.0:1713481296.546798:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800772f5880, transno 4296031394 00000004:00080000:3.0:1713481296.546800:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1c000, transno 4296031395 00000004:00080000:3.0:1713481296.546802:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad3100, transno 4296031396 00000004:00080000:3.0:1713481296.546806:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b99c00, transno 4296031397 00000004:00080000:3.0:1713481296.546808:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201e9f80, transno 4296031398 00000004:00080000:3.0:1713481296.546811:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e27100, transno 4296031399 00000004:00080000:3.0:1713481296.546814:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201e9c00, transno 4296031403 00000004:00080000:3.0:1713481296.546816:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e27b80, transno 4296031407 00000004:00080000:3.0:1713481296.546819:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5e680, transno 4296031408 00000004:00080000:3.0:1713481296.546821:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e24e00, transno 4296031409 00000004:00080000:3.0:1713481296.546824:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e24700, transno 4296031410 00000004:00080000:3.0:1713481296.546827:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e25180, transno 4296031411 00000004:00080000:3.0:1713481296.546829:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801350b5f80, transno 4296031412 00000004:00080000:3.0:1713481296.546833:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a4b480, transno 4296031413 00000004:00080000:3.0:1713481296.546836:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072af1880, transno 4296031414 00000004:00080000:3.0:1713481296.546838:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a4a680, transno 4296031415 00000004:00080000:3.0:1713481296.546841:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1e680, transno 4296031416 00000004:00080000:3.0:1713481296.546844:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072af1500, transno 4296031417 00000004:00080000:3.0:1713481296.546846:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1ce00, transno 4296031418 00000004:00080000:3.0:1713481296.546849:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1d180, transno 4296031419 00000004:00080000:3.0:1713481296.546851:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072af0a80, transno 4296031420 00000004:00080000:3.0:1713481296.546854:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201e8380, transno 4296031421 00000004:00080000:3.0:1713481296.546857:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201eb800, transno 4296031422 00000004:00080000:3.0:1713481296.546860:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b98380, transno 4296031423 00000004:00080000:3.0:1713481296.546863:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec31180, transno 4296031424 00000004:00080000:3.0:1713481296.546865:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b98700, transno 4296031425 00000004:00080000:3.0:1713481296.546868:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801350b7480, transno 4296031427 00000004:00080000:3.0:1713481296.546871:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e25c00, transno 4296031429 00000004:00080000:3.0:1713481296.546873:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0bb480, transno 4296031432 00000004:00080000:3.0:1713481296.546876:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094118380, transno 4296031433 00000004:00080000:3.0:1713481296.546879:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0ba300, transno 4296031438 00000004:00080000:3.0:1713481296.546881:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b9a680, transno 4296031442 00000004:00080000:3.0:1713481296.546884:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801200a4380, transno 4296031446 00000004:00080000:3.0:1713481296.546887:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801200a7b80, transno 4296031447 00000004:00080000:3.0:1713481296.546890:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801200a7100, transno 4296031448 00000004:00080000:3.0:1713481296.546892:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801200a5500, transno 4296031449 00000004:00080000:3.0:1713481296.546895:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec53b80, transno 4296031450 00000004:00080000:3.0:1713481296.546897:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec51500, transno 4296031451 00000004:00080000:3.0:1713481296.546900:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801200a6300, transno 4296031452 00000004:00080000:3.0:1713481296.546903:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b8dc00, transno 4296031453 00000004:00080000:3.0:1713481296.546905:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b8f100, transno 4296031454 00000004:00080000:3.0:1713481296.546908:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801200a6680, transno 4296031456 00000004:00080000:3.0:1713481296.546910:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b3dea00, transno 4296031457 00000004:00080000:3.0:1713481296.546913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b3ddf80, transno 4296031458 00000004:00080000:3.0:1713481296.546916:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b3dca80, transno 4296031459 00000004:00080000:3.0:1713481296.546919:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082355c00, transno 4296031460 00000004:00080000:3.0:1713481296.546921:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082356a00, transno 4296031461 00000004:00080000:3.0:1713481296.546924:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098f800, transno 4296031462 00000004:00080000:3.0:1713481296.546927:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098c380, transno 4296031463 00000004:00080000:3.0:1713481296.546930:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082356d80, transno 4296031464 00000004:00080000:3.0:1713481296.546932:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098df80, transno 4296031465 00000004:00080000:3.0:1713481296.546935:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098ea00, transno 4296031466 00000004:00080000:3.0:1713481296.546937:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092998e00, transno 4296031467 00000004:00080000:3.0:1713481296.546940:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009beda680, transno 4296031468 00000004:00080000:3.0:1713481296.546943:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bed8000, transno 4296031469 00000004:00080000:3.0:1713481296.546946:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bedb480, transno 4296031470 00000004:00080000:3.0:1713481296.546948:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299b800, transno 4296031471 00000004:00080000:3.0:1713481296.546950:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bedb800, transno 4296031472 00000004:00080000:3.0:1713481296.546952:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bed9500, transno 4296031474 00000004:00080000:3.0:1713481296.546955:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bed8380, transno 4296031475 00000004:00080000:3.0:1713481296.546957:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edcc380, transno 4296031478 00000004:00080000:3.0:1713481296.546960:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edcc000, transno 4296031479 00000004:00080000:3.0:1713481296.546962:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edcce00, transno 4296031480 00000004:00080000:3.0:1713481296.546965:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edcd500, transno 4296031481 00000004:00080000:3.0:1713481296.546968:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edcdc00, transno 4296031482 00000004:00080000:3.0:1713481296.546970:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edcf100, transno 4296031483 00000004:00080000:3.0:1713481296.546973:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edce300, transno 4296031484 00000004:00080000:3.0:1713481296.546976:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007737f100, transno 4296031485 00000004:00080000:3.0:1713481296.546978:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edce680, transno 4296031486 00000004:00080000:3.0:1713481296.546981:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e276680, transno 4296031488 00000004:00080000:3.0:1713481296.546984:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e277100, transno 4296031489 00000004:00080000:3.0:1713481296.546986:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bedb100, transno 4296031490 00000004:00080000:3.0:1713481296.546990:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a90700, transno 4296031491 00000004:00080000:3.0:1713481296.546993:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a91c00, transno 4296031492 00000004:00080000:3.0:1713481296.546995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120aa6a00, transno 4296031493 00000004:00080000:3.0:1713481296.546998:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120aa4e00, transno 4296031494 00000004:00080000:3.0:1713481296.547000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b7ad80, transno 4296031495 00000004:00080000:3.0:1713481296.547003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b78380, transno 4296031496 00000004:00080000:3.0:1713481296.547005:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b7a300, transno 4296031497 00000004:00080000:3.0:1713481296.547008:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099989880, transno 4296031498 00000004:00080000:3.0:1713481296.547011:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099989500, transno 4296031499 00000004:00080000:3.0:1713481296.547014:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099988a80, transno 4296031500 00000004:00080000:3.0:1713481296.547016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120aa4700, transno 4296031501 00000004:00080000:3.0:1713481296.547019:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099989c00, transno 4296031502 00000004:00080000:3.0:1713481296.547022:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009998b480, transno 4296031504 00000004:00080000:3.0:1713481296.547024:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099988000, transno 4296031505 00000004:00080000:3.0:1713481296.547027:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009998aa00, transno 4296031506 00000004:00080000:3.0:1713481296.547030:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961d500, transno 4296031507 00000004:00080000:3.0:1713481296.547032:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961f800, transno 4296031510 00000004:00080000:3.0:1713481296.547035:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961e300, transno 4296031511 00000004:00080000:3.0:1713481296.547038:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e35880, transno 4296031512 00000004:00080000:3.0:1713481296.547041:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e36a00, transno 4296031513 00000004:00080000:3.0:1713481296.547043:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961f480, transno 4296031514 00000004:00080000:3.0:1713481296.547046:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782b4000, transno 4296031516 00000004:00080000:3.0:1713481296.547049:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782b7100, transno 4296031517 00000004:00080000:3.0:1713481296.547052:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e37800, transno 4296031519 00000004:00080000:3.0:1713481296.547054:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782b4a80, transno 4296031520 00000004:00080000:3.0:1713481296.547056:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961d880, transno 4296031521 00000004:00080000:3.0:1713481296.547059:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b7b480, transno 4296031522 00000004:00080000:3.0:1713481296.547062:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e34380, transno 4296031523 00000004:00080000:3.0:1713481296.547065:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed1dc00, transno 4296031529 00000004:00080000:3.0:1713481296.547067:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed1c000, transno 4296031531 00000004:00080000:3.0:1713481296.547070:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed1df80, transno 4296031534 00000004:00080000:3.0:1713481296.547073:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed1ce00, transno 4296031535 00000004:00080000:3.0:1713481296.547075:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096763b80, transno 4296031536 00000004:00080000:3.0:1713481296.547078:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed1c700, transno 4296031537 00000004:00080000:3.0:1713481296.547080:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083b84a80, transno 4296031538 00000004:00080000:3.0:1713481296.547083:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096760000, transno 4296031539 00000004:00080000:3.0:1713481296.547086:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096761c00, transno 4296031540 00000004:00080000:3.0:1713481296.547089:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3e9c00, transno 4296031541 00000004:00080000:3.0:1713481296.547091:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3d8a80, transno 4296031542 00000004:00080000:3.0:1713481296.547094:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3eb800, transno 4296031543 00000004:00080000:3.0:1713481296.547097:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3ea300, transno 4296031544 00000004:00080000:3.0:1713481296.547101:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3eb100, transno 4296031545 00000004:00080000:3.0:1713481296.547104:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082350700, transno 4296031548 00000004:00080000:3.0:1713481296.547106:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3ebb80, transno 4296031549 00000004:00080000:3.0:1713481296.547109:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082353100, transno 4296031550 00000004:00080000:3.0:1713481296.547112:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082350000, transno 4296031551 00000004:00080000:3.0:1713481296.547115:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082351500, transno 4296031552 00000004:00080000:3.0:1713481296.547135:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3eb480, transno 4296031553 00000004:00080000:3.0:1713481296.547139:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009179e680, transno 4296031554 00000004:00080000:3.0:1713481296.547141:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082351880, transno 4296031555 00000004:00080000:3.0:1713481296.547144:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136347100, transno 4296031556 00000004:00080000:3.0:1713481296.547147:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082350380, transno 4296031557 00000004:00080000:3.0:1713481296.547150:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082352680, transno 4296031558 00000004:00080000:3.0:1713481296.547152:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec32d80, transno 4296031559 00000004:00080000:3.0:1713481296.547154:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094118000, transno 4296031560 00000004:00080000:3.0:1713481296.547157:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136344a80, transno 4296031561 00000004:00080000:3.0:1713481296.547160:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac4a80, transno 4296031562 00000004:00080000:3.0:1713481296.547162:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac6a00, transno 4296031563 00000004:00080000:3.0:1713481296.547165:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac7100, transno 4296031564 00000004:00080000:3.0:1713481296.547168:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136345c00, transno 4296031565 00000004:00080000:3.0:1713481296.547170:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac6d80, transno 4296031566 00000004:00080000:3.0:1713481296.547173:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136346680, transno 4296031567 00000004:00080000:3.0:1713481296.547175:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136346a00, transno 4296031568 00000004:00080000:3.0:1713481296.547178:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a3b480, transno 4296031569 00000004:00080000:3.0:1713481296.547181:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a39f80, transno 4296031570 00000004:00080000:3.0:1713481296.547184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779da680, transno 4296031571 00000004:00080000:3.0:1713481296.547186:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a3ad80, transno 4296031572 00000004:00080000:3.0:1713481296.547189:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779da300, transno 4296031573 00000004:00080000:3.0:1713481296.547191:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078756a00, transno 4296031574 00000004:00080000:3.0:1713481296.547194:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779d8e00, transno 4296031575 00000004:00080000:3.0:1713481296.547197:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e68380, transno 4296031576 00000004:00080000:3.0:1713481296.547200:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e6ad80, transno 4296031577 00000004:00080000:3.0:1713481296.547203:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881a7b80, transno 4296031578 00000004:00080000:3.0:1713481296.547205:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e6b800, transno 4296031579 00000004:00080000:3.0:1713481296.547208:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e6aa00, transno 4296031580 00000004:00080000:3.0:1713481296.547210:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881a5500, transno 4296031581 00000004:00080000:3.0:1713481296.547213:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881a7800, transno 4296031582 00000004:00080000:3.0:1713481296.547216:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e69f80, transno 4296031583 00000004:00080000:3.0:1713481296.547219:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083148700, transno 4296031584 00000004:00080000:3.0:1713481296.547221:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083149c00, transno 4296031585 00000004:00080000:3.0:1713481296.547224:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008314aa00, transno 4296031586 00000004:00080000:3.0:1713481296.547227:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c5180, transno 4296031587 00000004:00080000:3.0:1713481296.547229:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b73480, transno 4296031588 00000004:00080000:3.0:1713481296.547232:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b73800, transno 4296031589 00000004:00080000:3.0:1713481296.547234:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c4000, transno 4296031590 00000004:00080000:3.0:1713481296.547237:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c4380, transno 4296031591 00000004:00080000:3.0:1713481296.547239:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e2680, transno 4296031592 00000004:00080000:3.0:1713481296.547242:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c6680, transno 4296031593 00000004:00080000:3.0:1713481296.547245:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e1c00, transno 4296031594 00000004:00080000:3.0:1713481296.547248:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008022c700, transno 4296031597 00000004:00080000:3.0:1713481296.547251:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e0a80, transno 4296031599 00000004:00080000:3.0:1713481296.547254:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083149500, transno 4296031601 00000004:00080000:3.0:1713481296.547256:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c7b80, transno 4296031602 00000004:00080000:3.0:1713481296.547259:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c6d80, transno 4296031603 00000004:00080000:3.0:1713481296.547262:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eaa300, transno 4296031604 00000004:00080000:3.0:1713481296.547264:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e3800, transno 4296031605 00000004:00080000:3.0:1713481296.547267:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008022d180, transno 4296031609 00000004:00080000:3.0:1713481296.547270:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ea8a80, transno 4296031610 00000004:00080000:3.0:1713481296.547273:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ab5880, transno 4296031611 00000004:00080000:3.0:1713481296.547276:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eaaa00, transno 4296031612 00000004:00080000:3.0:1713481296.547278:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ea9f80, transno 4296031616 00000004:00080000:3.0:1713481296.547281:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ea8700, transno 4296031617 00000004:00080000:3.0:1713481296.547284:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ea9c00, transno 4296031618 00000004:00080000:3.0:1713481296.547287:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781a7b80, transno 4296031619 00000004:00080000:3.0:1713481296.547290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781a5c00, transno 4296031623 00000004:00080000:3.0:1713481296.547293:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dd18a80, transno 4296031625 00000004:00080000:3.0:1713481296.547296:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085e05880, transno 4296031626 00000004:00080000:3.0:1713481296.547298:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ab5f80, transno 4296031627 00000004:00080000:3.0:1713481296.547301:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781a5500, transno 4296031628 00000004:00080000:3.0:1713481296.547303:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a922a00, transno 4296031629 00000004:00080000:3.0:1713481296.547306:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781a6d80, transno 4296031630 00000004:00080000:3.0:1713481296.547308:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a922680, transno 4296031631 00000004:00080000:3.0:1713481296.547311:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a920e00, transno 4296031632 00000004:00080000:3.0:1713481296.547314:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a922300, transno 4296031633 00000004:00080000:3.0:1713481296.547316:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a923480, transno 4296031634 00000004:00080000:3.0:1713481296.547319:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1d8a80, transno 4296031635 00000004:00080000:3.0:1713481296.547322:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1d8380, transno 4296031636 00000004:00080000:3.0:1713481296.547324:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1da680, transno 4296031637 00000004:00080000:3.0:1713481296.547327:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a861880, transno 4296031638 00000004:00080000:3.0:1713481296.547329:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a863b80, transno 4296031646 00000004:00080000:3.0:1713481296.547332:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a863800, transno 4296031647 00000004:00080000:3.0:1713481296.547334:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1d9c00, transno 4296031648 00000004:00080000:3.0:1713481296.547337:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079943800, transno 4296031649 00000004:00080000:3.0:1713481296.547340:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a861500, transno 4296031650 00000004:00080000:3.0:1713481296.547342:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a861180, transno 4296031651 00000004:00080000:3.0:1713481296.547344:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079940000, transno 4296031652 00000004:00080000:3.0:1713481296.547346:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079942a00, transno 4296031653 00000004:00080000:3.0:1713481296.547348:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079943480, transno 4296031654 00000004:00080000:3.0:1713481296.547350:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819f480, transno 4296031655 00000004:00080000:3.0:1713481296.547353:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079942d80, transno 4296031657 00000004:00080000:3.0:1713481296.547355:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079941880, transno 4296031658 00000004:00080000:3.0:1713481296.547357:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079940e00, transno 4296031659 00000004:00080000:3.0:1713481296.547360:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819ed80, transno 4296031664 00000004:00080000:3.0:1713481296.547362:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819d180, transno 4296031665 00000004:00080000:3.0:1713481296.547364:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819f800, transno 4296031668 00000004:00080000:3.0:1713481296.547367:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819e680, transno 4296031669 00000004:00080000:3.0:1713481296.547370:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fe3f480, transno 4296031670 00000004:00080000:3.0:1713481296.547373:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b131f80, transno 4296031671 00000004:00080000:3.0:1713481296.547375:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620c700, transno 4296031672 00000004:00080000:3.0:1713481296.547378:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620ce00, transno 4296031673 00000004:00080000:3.0:1713481296.547381:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fe3fb80, transno 4296031674 00000004:00080000:3.0:1713481296.547384:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620c000, transno 4296031675 00000004:00080000:3.0:1713481296.547387:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bfb80, transno 4296031679 00000004:00080000:3.0:1713481296.547390:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620d880, transno 4296031680 00000004:00080000:3.0:1713481296.547393:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bdc00, transno 4296031681 00000004:00080000:3.0:1713481296.547395:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837af800, transno 4296031682 00000004:00080000:3.0:1713481296.547398:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bdf80, transno 4296031689 00000004:00080000:3.0:1713481296.547400:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837aed80, transno 4296031691 00000004:00080000:3.0:1713481296.547403:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bc000, transno 4296031692 00000004:00080000:3.0:1713481296.547405:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620d500, transno 4296031693 00000004:00080000:3.0:1713481296.547408:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202a9180, transno 4296031694 00000004:00080000:3.0:1713481296.547411:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008817b800, transno 4296031695 00000004:00080000:3.0:1713481296.547414:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088178000, transno 4296031696 00000004:00080000:3.0:1713481296.547417:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d0e0700, transno 4296031697 00000004:00080000:3.0:1713481296.547420:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d0e1880, transno 4296031698 00000004:00080000:3.0:1713481296.547423:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df48000, transno 4296031701 00000004:00080000:3.0:1713481296.547425:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df4aa00, transno 4296031702 00000004:00080000:3.0:1713481296.547428:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5df80, transno 4296031703 00000004:00080000:3.0:1713481296.547430:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a90b480, transno 4296031704 00000004:00080000:3.0:1713481296.547432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080300000, transno 4296031705 00000004:00080000:3.0:1713481296.547434:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339c000, transno 4296031706 00000004:00080000:3.0:1713481296.547436:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b130a80, transno 4296031707 00000004:00080000:3.0:1713481296.547438:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b133b80, transno 4296031708 00000004:00080000:3.0:1713481296.547441:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b133100, transno 4296031709 00000004:00080000:3.0:1713481296.547442:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b130380, transno 4296031710 00000004:00080000:3.0:1713481296.547444:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b132a00, transno 4296031711 00000004:00080000:3.0:1713481296.547446:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b131500, transno 4296031712 00000004:00080000:3.0:1713481296.547448:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620e680, transno 4296031713 00000004:00080000:3.0:1713481296.547451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bc380, transno 4296031714 00000004:00080000:3.0:1713481296.547453:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819ce00, transno 4296031715 00000004:00080000:3.0:1713481296.547455:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898be680, transno 4296031716 00000004:00080000:3.0:1713481296.547458:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bea00, transno 4296031717 00000004:00080000:3.0:1713481296.547460:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bf100, transno 4296031718 00000004:00080000:3.0:1713481296.547463:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837ac700, transno 4296031719 00000004:00080000:3.0:1713481296.547465:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837ac380, transno 4296031721 00000004:00080000:3.0:1713481296.547467:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bca80, transno 4296031723 00000004:00080000:3.0:1713481296.547470:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094068380, transno 4296031724 00000004:00080000:3.0:1713481296.547473:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c3100, transno 4296031725 00000004:00080000:3.0:1713481296.547475:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898bf480, transno 4296031726 00000004:00080000:3.0:1713481296.547477:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008817ad80, transno 4296031727 00000004:00080000:3.0:1713481296.547480:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088178e00, transno 4296031728 00000004:00080000:3.0:1713481296.547483:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de9a680, transno 4296031729 00000004:00080000:3.0:1713481296.547486:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de98380, transno 4296031730 00000004:00080000:3.0:1713481296.547488:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083451500, transno 4296031731 00000004:00080000:3.0:1713481296.547490:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083451f80, transno 4296031737 00000004:00080000:3.0:1713481296.547492:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098d500, transno 4296031738 00000004:00080000:3.0:1713481296.547494:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098ce00, transno 4296031740 00000004:00080000:3.0:1713481296.547495:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083453b80, transno 4296031745 00000004:00080000:3.0:1713481296.547497:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083451880, transno 4296031746 00000004:00080000:3.0:1713481296.547499:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083452300, transno 4296031747 00000004:00080000:3.0:1713481296.547500:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829ea00, transno 4296031748 00000004:00080000:3.0:1713481296.547501:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829f100, transno 4296031755 00000004:00080000:3.0:1713481296.547503:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083453800, transno 4296031756 00000004:00080000:3.0:1713481296.547505:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec52300, transno 4296031757 00000004:00080000:3.0:1713481296.547507:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829f480, transno 4296031758 00000004:00080000:3.0:1713481296.547508:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec53100, transno 4296031759 00000004:00080000:3.0:1713481296.547509:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007810c700, transno 4296031760 00000004:00080000:3.0:1713481296.547511:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007810f100, transno 4296031761 00000004:00080000:3.0:1713481296.547513:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e013800, transno 4296031762 00000004:00080000:3.0:1713481296.547515:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e012680, transno 4296031763 00000004:00080000:3.0:1713481296.547516:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007810f480, transno 4296031764 00000004:00080000:3.0:1713481296.547518:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e013b80, transno 4296031765 00000004:00080000:3.0:1713481296.547520:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e010e00, transno 4296031766 00000004:00080000:3.0:1713481296.547521:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007810fb80, transno 4296031767 00000004:00080000:3.0:1713481296.547523:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120244a80, transno 4296031768 00000004:00080000:3.0:1713481296.547525:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb6300, transno 4296031769 00000004:00080000:3.0:1713481296.547527:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb4e00, transno 4296031770 00000004:00080000:3.0:1713481296.547528:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb5180, transno 4296031771 00000004:00080000:3.0:1713481296.547530:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bd180, transno 4296031772 00000004:00080000:3.0:1713481296.547532:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb4700, transno 4296031773 00000004:00080000:3.0:1713481296.547533:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bd500, transno 4296031774 00000004:00080000:3.0:1713481296.547534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bce00, transno 4296031775 00000004:00080000:3.0:1713481296.547536:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3c380, transno 4296031776 00000004:00080000:3.0:1713481296.547538:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078611880, transno 4296031777 00000004:00080000:3.0:1713481296.547539:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124058a80, transno 4296031778 00000004:00080000:3.0:1713481296.547541:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078613480, transno 4296031779 00000004:00080000:3.0:1713481296.547543:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3fb80, transno 4296031780 00000004:00080000:3.0:1713481296.547545:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132f5ca80, transno 4296031781 00000004:00080000:3.0:1713481296.547546:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078613b80, transno 4296031782 00000004:00080000:3.0:1713481296.547548:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132f5fb80, transno 4296031783 00000004:00080000:3.0:1713481296.547549:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132f5c380, transno 4296031784 00000004:00080000:3.0:1713481296.547550:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd68380, transno 4296031785 00000004:00080000:3.0:1713481296.547552:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132f5c000, transno 4296031786 00000004:00080000:3.0:1713481296.547553:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd68e00, transno 4296031787 00000004:00080000:3.0:1713481296.547554:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd69180, transno 4296031788 00000004:00080000:3.0:1713481296.547556:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd6a300, transno 4296031789 00000004:00080000:3.0:1713481296.547558:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc79c00, transno 4296031790 00000004:00080000:3.0:1713481296.547560:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd69f80, transno 4296031791 00000004:00080000:3.0:1713481296.547561:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd68a80, transno 4296031792 00000004:00080000:3.0:1713481296.547563:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd6b100, transno 4296031793 00000004:00080000:3.0:1713481296.547564:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083450a80, transno 4296031794 00000004:00080000:3.0:1713481296.547566:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc78700, transno 4296031795 00000004:00080000:3.0:1713481296.547568:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb5500, transno 4296031796 00000004:00080000:3.0:1713481296.547570:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829e680, transno 4296031797 00000004:00080000:3.0:1713481296.547572:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bed80, transno 4296031798 00000004:00080000:3.0:1713481296.547574:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736d180, transno 4296031799 00000004:00080000:3.0:1713481296.547576:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bdc00, transno 4296031800 00000004:00080000:3.0:1713481296.547577:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c2a00, transno 4296031801 00000004:00080000:3.0:1713481296.547579:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c1c00, transno 4296031802 00000004:00080000:3.0:1713481296.547580:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c0e00, transno 4296031803 00000004:00080000:3.0:1713481296.547582:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c0000, transno 4296031804 00000004:00080000:3.0:1713481296.547584:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c1500, transno 4296031805 00000004:00080000:3.0:1713481296.547585:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c3480, transno 4296031806 00000004:00080000:3.0:1713481296.547587:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c1f80, transno 4296031807 00000004:00080000:3.0:1713481296.547589:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868ce300, transno 4296031808 00000004:00080000:3.0:1713481296.547590:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620ed80, transno 4296031809 00000004:00080000:3.0:1713481296.547592:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620ea00, transno 4296031810 00000004:00080000:3.0:1713481296.547594:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094069880, transno 4296031811 00000004:00080000:3.0:1713481296.547596:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092328380, transno 4296031812 00000004:00080000:3.0:1713481296.547597:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094068700, transno 4296031813 00000004:00080000:3.0:1713481296.547599:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078610000, transno 4296031814 00000004:00080000:3.0:1713481296.547600:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb7800, transno 4296031815 00000004:00080000:3.0:1713481296.547602:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb6680, transno 4296031816 00000004:00080000:3.0:1713481296.547604:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd69880, transno 4296031817 00000004:00080000:3.0:1713481296.547606:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008234f480, transno 4296031819 00000004:00080000:3.0:1713481296.547607:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008234ce00, transno 4296031820 00000004:00080000:3.0:1713481296.547609:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008234f100, transno 4296031821 00000004:00080000:3.0:1713481296.547610:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078612300, transno 4296031822 00000004:00080000:3.0:1713481296.547612:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc79180, transno 4296031825 00000004:00080000:3.0:1713481296.547613:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc78a80, transno 4296031830 00000004:00080000:3.0:1713481296.547615:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc79f80, transno 4296031831 00000004:00080000:3.0:1713481296.547617:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc79880, transno 4296031832 00000004:00080000:3.0:1713481296.547619:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3d180, transno 4296031833 00000004:00080000:3.0:1713481296.547621:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc7b480, transno 4296031834 00000004:00080000:3.0:1713481296.547623:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008234ed80, transno 4296031835 00000004:00080000:3.0:1713481296.547625:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3dc00, transno 4296031839 00000004:00080000:3.0:1713481296.547626:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3ed80, transno 4296031847 00000004:00080000:3.0:1713481296.547628:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124059880, transno 4296031855 00000004:00080000:3.0:1713481296.547629:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc7bb80, transno 4296031856 00000004:00080000:3.0:1713481296.547631:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3e680, transno 4296031857 00000004:00080000:3.0:1713481296.547632:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3f100, transno 4296031863 00000004:00080000:3.0:1713481296.547634:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095f6fb80, transno 4296031877 00000004:00080000:3.0:1713481296.547635:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008234c000, transno 4296031880 00000004:00080000:3.0:1713481296.547637:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008234dc00, transno 4296031881 00000004:00080000:3.0:1713481296.547639:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095f6d500, transno 4296031882 00000004:00080000:3.0:1713481296.547640:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095f6ed80, transno 4296031883 00000004:00080000:3.0:1713481296.547642:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095f6c700, transno 4296031884 00000004:00080000:3.0:1713481296.547643:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095f6ce00, transno 4296031885 00000004:00080000:3.0:1713481296.547645:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095f6ca80, transno 4296031886 00000004:00080000:3.0:1713481296.547647:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e55e300, transno 4296031887 00000004:00080000:3.0:1713481296.547648:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e55d500, transno 4296031888 00000004:00080000:3.0:1713481296.547650:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e55d880, transno 4296031889 00000004:00080000:3.0:1713481296.547652:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e55df80, transno 4296031891 00000004:00080000:3.0:1713481296.547654:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc78000, transno 4296031892 00000004:00080000:3.0:1713481296.547656:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e55f100, transno 4296031893 00000004:00080000:3.0:1713481296.547659:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d87800, transno 4296031906 00000004:00080000:3.0:1713481296.547661:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d86d80, transno 4296031907 00000004:00080000:3.0:1713481296.547663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d85f80, transno 4296031909 00000004:00080000:3.0:1713481296.547675:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d86a00, transno 4296031910 00000004:00080000:3.0:1713481296.547678:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d85c00, transno 4296031914 00000004:00080000:3.0:1713481296.547681:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330a8a80, transno 4296031915 00000004:00080000:3.0:1713481296.547683:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d85880, transno 4296031916 00000004:00080000:3.0:1713481296.547686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d84e00, transno 4296031917 00000004:00080000:3.0:1713481296.547689:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330ab100, transno 4296031918 00000004:00080000:3.0:1713481296.547691:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330aa680, transno 4296031919 00000004:00080000:3.0:1713481296.547693:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330aaa00, transno 4296031920 00000004:00080000:3.0:1713481296.547696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330ab800, transno 4296031921 00000004:00080000:3.0:1713481296.547698:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330a8000, transno 4296031922 00000004:00080000:3.0:1713481296.547701:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330a9180, transno 4296031926 00000004:00080000:3.0:1713481296.547704:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330a8380, transno 4296031927 00000004:00080000:3.0:1713481296.547706:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330a9f80, transno 4296031930 00000004:00080000:3.0:1713481296.547709:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800771e9c00, transno 4296032156 00000004:00080000:3.0:1713481296.547712:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6211180, transno 4296032157 00000004:00080000:3.0:1713481296.547714:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6210a80, transno 4296032158 00000004:00080000:3.0:1713481296.547717:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800771e8a80, transno 4296032159 00000004:00080000:3.0:1713481296.547720:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6211880, transno 4296032160 00000004:00080000:3.0:1713481296.547723:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007decc700, transno 4296032161 00000004:00080000:3.0:1713481296.547725:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330a9c00, transno 4296032162 00000004:00080000:3.0:1713481296.547728:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801330aa300, transno 4296032165 00000004:00080000:3.0:1713481296.547730:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013225bb80, transno 4296032172 00000004:00080000:3.0:1713481296.547733:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132259c00, transno 4296032174 00000004:00080000:3.0:1713481296.547735:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781cc000, transno 4296032175 00000004:00080000:3.0:1713481296.547738:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1f800, transno 4296032176 00000004:00080000:3.0:1713481296.547741:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e111180, transno 4296032178 00000004:00080000:3.0:1713481296.547744:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1fb80, transno 4296032179 00000004:00080000:3.0:1713481296.547746:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6213b80, transno 4296032180 00000004:00080000:3.0:1713481296.547749:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e3dc00, transno 4296032182 00000004:00080000:3.0:1713481296.547752:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a04c000, transno 4296032188 00000004:00080000:3.0:1713481296.547755:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009dd96a00, transno 4296032189 00000004:00080000:3.0:1713481296.547758:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009dd94700, transno 4296032190 00000004:00080000:3.0:1713481296.547760:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009dd94a80, transno 4296032191 00000004:00080000:3.0:1713481296.547763:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078118e00, transno 4296032196 00000004:00080000:3.0:1713481296.547766:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086ec2d80, transno 4296032197 00000004:00080000:3.0:1713481296.547768:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780ec380, transno 4296032199 00000004:00080000:3.0:1713481296.547771:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078118000, transno 4296032200 00000004:00080000:3.0:1713481296.547773:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086ec1180, transno 4296032203 00000004:00080000:3.0:1713481296.547776:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9d500, transno 4296032205 00000004:00080000:3.0:1713481296.547778:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9e300, transno 4296032206 00000004:00080000:3.0:1713481296.547781:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961e680, transno 4296032207 00000004:00080000:3.0:1713481296.547783:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092999180, transno 4296032209 00000004:00080000:3.0:1713481296.547785:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077329180, transno 4296032215 00000004:00080000:3.0:1713481296.547789:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a38000, transno 4296032216 00000004:00080000:3.0:1713481296.547791:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120bebb80, transno 4296032218 00000004:00080000:3.0:1713481296.547793:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e113100, transno 4296032219 00000004:00080000:3.0:1713481296.547795:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780ed500, transno 4296032221 00000004:00080000:3.0:1713481296.547798:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780ef800, transno 4296032222 00000004:00080000:3.0:1713481296.547800:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754ffb80, transno 4296032223 00000004:00080000:3.0:1713481296.547802:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780eed80, transno 4296032225 00000004:00080000:3.0:1713481296.547805:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132b42a00, transno 4296032229 00000004:00080000:3.0:1713481296.547807:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d878380, transno 4296032232 00000004:00080000:3.0:1713481296.547810:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084973b80, transno 4296032234 00000004:00080000:3.0:1713481296.547813:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084973800, transno 4296032235 00000004:00080000:3.0:1713481296.547816:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfac380, transno 4296032237 00000004:00080000:3.0:1713481296.547818:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780ed180, transno 4296032238 00000004:00080000:3.0:1713481296.547820:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfae680, transno 4296032239 00000004:00080000:3.0:1713481296.547823:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfafb80, transno 4296032240 00000004:00080000:3.0:1713481296.547825:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012246c700, transno 4296032243 00000004:00080000:3.0:1713481296.547828:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868eb100, transno 4296032249 00000004:00080000:3.0:1713481296.547830:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868e9180, transno 4296032250 00000004:00080000:3.0:1713481296.547833:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072aa0380, transno 4296032251 00000004:00080000:3.0:1713481296.547835:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132b40a80, transno 4296032253 00000004:00080000:3.0:1713481296.547838:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868e9f80, transno 4296032254 00000004:00080000:3.0:1713481296.547840:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084971880, transno 4296032255 00000004:00080000:3.0:1713481296.547843:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868e8000, transno 4296032256 00000004:00080000:3.0:1713481296.547845:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f051c00, transno 4296032259 00000004:00080000:3.0:1713481296.547848:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd7f480, transno 4296032265 00000004:00080000:3.0:1713481296.547850:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009298b100, transno 4296032266 00000004:00080000:3.0:1713481296.547852:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092988e00, transno 4296032268 00000004:00080000:3.0:1713481296.547855:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb1c00, transno 4296032269 00000004:00080000:3.0:1713481296.547858:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb0380, transno 4296032270 00000004:00080000:3.0:1713481296.547860:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb1880, transno 4296032271 00000004:00080000:3.0:1713481296.547863:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e55880, transno 4296032274 00000004:00080000:3.0:1713481296.547866:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e54e00, transno 4296032276 00000004:00080000:3.0:1713481296.547868:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af0a80, transno 4296032279 00000004:00080000:3.0:1713481296.547870:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af0380, transno 4296032280 00000004:00080000:3.0:1713481296.547872:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de97b80, transno 4296032282 00000004:00080000:3.0:1713481296.547874:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092989880, transno 4296032283 00000004:00080000:3.0:1713481296.547877:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881b3800, transno 4296032284 00000004:00080000:3.0:1713481296.547879:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4b0000, transno 4296032289 00000004:00080000:3.0:1713481296.547882:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c01ce00, transno 4296032290 00000004:00080000:3.0:1713481296.547884:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4b1500, transno 4296032292 00000004:00080000:3.0:1713481296.547887:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798cbb80, transno 4296032295 00000004:00080000:3.0:1713481296.547890:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085cac700, transno 4296032296 00000004:00080000:3.0:1713481296.547892:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798ca680, transno 4296032298 00000004:00080000:3.0:1713481296.547894:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c01c380, transno 4296032299 00000004:00080000:3.0:1713481296.547897:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008022fb80, transno 4296032302 00000004:00080000:3.0:1713481296.547899:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a33ed80, transno 4296032303 00000004:00080000:3.0:1713481296.547902:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a33d500, transno 4296032304 00000004:00080000:3.0:1713481296.547904:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cfb800, transno 4296032309 00000004:00080000:3.0:1713481296.547907:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a831500, transno 4296032311 00000004:00080000:3.0:1713481296.547909:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a830a80, transno 4296032312 00000004:00080000:3.0:1713481296.547913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798ca300, transno 4296032313 00000004:00080000:3.0:1713481296.547915:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798c8380, transno 4296032315 00000004:00080000:3.0:1713481296.547918:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fd9880, transno 4296032317 00000004:00080000:3.0:1713481296.547920:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fdaa00, transno 4296032318 00000004:00080000:3.0:1713481296.547922:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a33f100, transno 4296032320 00000004:00080000:3.0:1713481296.547925:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed39c00, transno 4296032322 00000004:00080000:3.0:1713481296.547927:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb3b80, transno 4296032324 00000004:00080000:3.0:1713481296.547930:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3b480, transno 4296032325 00000004:00080000:3.0:1713481296.547932:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb2d80, transno 4296032326 00000004:00080000:3.0:1713481296.547934:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800961c4000, transno 4296032329 00000004:00080000:3.0:1713481296.547937:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed91880, transno 4296032333 00000004:00080000:3.0:1713481296.547940:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120134e00, transno 4296032335 00000004:00080000:3.0:1713481296.547942:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120a1ea00, transno 4296032337 00000004:00080000:3.0:1713481296.547945:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801b5180, transno 4296032339 00000004:00080000:3.0:1713481296.547947:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120136a00, transno 4296032340 00000004:00080000:3.0:1713481296.547950:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078022d80, transno 4296032343 00000004:00080000:3.0:1713481296.547953:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773c3800, transno 4296032344 00000004:00080000:3.0:1713481296.547955:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800961c7100, transno 4296032346 00000004:00080000:3.0:1713481296.547958:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed91f80, transno 4296032352 00000004:00080000:3.0:1713481296.547960:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800961c4a80, transno 4296032353 00000004:00080000:3.0:1713481296.547963:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794fdc00, transno 4296032355 00000004:00080000:3.0:1713481296.547966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076874a80, transno 4296032356 00000004:00080000:3.0:1713481296.547968:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801204da300, transno 4296032359 00000004:00080000:3.0:1713481296.547971:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800993ea680, transno 4296032360 00000004:00080000:3.0:1713481296.547974:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2aa680, transno 4296032361 00000004:00080000:3.0:1713481296.547976:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801204d9180, transno 4296032366 00000004:00080000:3.0:1713481296.547979:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881ae680, transno 4296032367 00000004:00080000:3.0:1713481296.547981:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881ad500, transno 4296032369 00000004:00080000:3.0:1713481296.547984:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801358baa00, transno 4296032371 00000004:00080000:3.0:1713481296.547986:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091c1fb80, transno 4296032373 00000004:00080000:3.0:1713481296.547989:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881ac700, transno 4296032374 00000004:00080000:3.0:1713481296.547992:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad86300, transno 4296032375 00000004:00080000:3.0:1713481296.547995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad84a80, transno 4296032376 00000004:00080000:3.0:1713481296.547997:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad87480, transno 4296032378 00000004:00080000:3.0:1713481296.548000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ffd6300, transno 4296032386 00000004:00080000:3.0:1713481296.548001:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fd8380, transno 4296032387 00000004:00080000:3.0:1713481296.548003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fd8700, transno 4296032388 00000004:00080000:3.0:1713481296.548005:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ffd5500, transno 4296032389 00000004:00080000:3.0:1713481296.548008:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b330380, transno 4296032390 00000004:00080000:3.0:1713481296.548010:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080265880, transno 4296032391 00000004:00080000:3.0:1713481296.548013:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e26c700, transno 4296032392 00000004:00080000:3.0:1713481296.548016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080264a80, transno 4296032395 00000004:00080000:3.0:1713481296.548018:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd7480, transno 4296032401 00000004:00080000:3.0:1713481296.548021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796de300, transno 4296032402 00000004:00080000:3.0:1713481296.548023:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd6680, transno 4296032403 00000004:00080000:3.0:1713481296.548025:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd7800, transno 4296032404 00000004:00080000:3.0:1713481296.548027:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd7b80, transno 4296032406 00000004:00080000:3.0:1713481296.548029:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c00700, transno 4296032407 00000004:00080000:3.0:1713481296.548032:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c01f80, transno 4296032410 00000004:00080000:3.0:1713481296.548035:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072afdc00, transno 4296032412 00000004:00080000:3.0:1713481296.548037:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072afd500, transno 4296032415 00000004:00080000:3.0:1713481296.548040:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120147800, transno 4296032419 00000004:00080000:3.0:1713481296.548043:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072afdf80, transno 4296032420 00000004:00080000:3.0:1713481296.548045:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009caca680, transno 4296032421 00000004:00080000:3.0:1713481296.548048:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088365c00, transno 4296032422 00000004:00080000:3.0:1713481296.548050:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088367480, transno 4296032423 00000004:00080000:3.0:1713481296.548053:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a4a680, transno 4296032424 00000004:00080000:3.0:1713481296.548055:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a4b480, transno 4296032425 00000004:00080000:3.0:1713481296.548058:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b20380, transno 4296032428 00000004:00080000:3.0:1713481296.548061:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800928bb480, transno 4296032429 00000004:00080000:3.0:1713481296.548064:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078190000, transno 4296032433 00000004:00080000:3.0:1713481296.548066:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773c8000, transno 4296032436 00000004:00080000:3.0:1713481296.548069:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007836ea00, transno 4296032437 00000004:00080000:3.0:1713481296.548072:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773c9f80, transno 4296032438 00000004:00080000:3.0:1713481296.548075:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078191180, transno 4296032440 00000004:00080000:3.0:1713481296.548077:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008685c700, transno 4296032441 00000004:00080000:3.0:1713481296.548079:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120253800, transno 4296032444 00000004:00080000:3.0:1713481296.548082:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007836f480, transno 4296032447 00000004:00080000:3.0:1713481296.548084:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de11180, transno 4296032449 00000004:00080000:3.0:1713481296.548087:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de10a80, transno 4296032450 00000004:00080000:3.0:1713481296.548090:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b839180, transno 4296032452 00000004:00080000:3.0:1713481296.548092:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b838e00, transno 4296032453 00000004:00080000:3.0:1713481296.548094:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de12680, transno 4296032454 00000004:00080000:3.0:1713481296.548097:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800820bbb80, transno 4296032459 00000004:00080000:3.0:1713481296.548099:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120253b80, transno 4296032462 00000004:00080000:3.0:1713481296.548101:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075754a80, transno 4296032464 00000004:00080000:3.0:1713481296.548103:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008da72a00, transno 4296032466 00000004:00080000:3.0:1713481296.548106:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135baed80, transno 4296032467 00000004:00080000:3.0:1713481296.548108:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008da70700, transno 4296032468 00000004:00080000:3.0:1713481296.548111:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a81500, transno 4296032469 00000004:00080000:3.0:1713481296.548114:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cd2a00, transno 4296032471 00000004:00080000:3.0:1713481296.548116:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cd2300, transno 4296032474 00000004:00080000:3.0:1713481296.548137:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cd0700, transno 4296032475 00000004:00080000:3.0:1713481296.548139:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086b44700, transno 4296032479 00000004:00080000:3.0:1713481296.548141:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086b44a80, transno 4296032482 00000004:00080000:3.0:1713481296.548143:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a266b800, transno 4296032484 00000004:00080000:3.0:1713481296.548146:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a2669c00, transno 4296032485 00000004:00080000:3.0:1713481296.548148:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077960380, transno 4296032486 00000004:00080000:3.0:1713481296.548151:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c35ad80, transno 4296032488 00000004:00080000:3.0:1713481296.548153:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008685f100, transno 4296032489 00000004:00080000:3.0:1713481296.548157:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e05f80, transno 4296032491 00000004:00080000:3.0:1713481296.548159:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a003100, transno 4296032497 00000004:00080000:3.0:1713481296.548162:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1d880, transno 4296032498 00000004:00080000:3.0:1713481296.548164:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007809c000, transno 4296032500 00000004:00080000:3.0:1713481296.548167:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007836dc00, transno 4296032501 00000004:00080000:3.0:1713481296.548170:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d098380, transno 4296032502 00000004:00080000:3.0:1713481296.548172:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d098a80, transno 4296032503 00000004:00080000:3.0:1713481296.548174:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007836ce00, transno 4296032504 00000004:00080000:3.0:1713481296.548177:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ef3480, transno 4296032509 00000004:00080000:3.0:1713481296.548179:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de13480, transno 4296032513 00000004:00080000:3.0:1713481296.548181:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079614e00, transno 4296032514 00000004:00080000:3.0:1713481296.548184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009182a300, transno 4296032515 00000004:00080000:3.0:1713481296.548186:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c04000, transno 4296032516 00000004:00080000:3.0:1713481296.548189:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075755c00, transno 4296032517 00000004:00080000:3.0:1713481296.548191:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007836df80, transno 4296032518 00000004:00080000:3.0:1713481296.548194:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007286ed80, transno 4296032521 00000004:00080000:3.0:1713481296.548197:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085ec9500, transno 4296032526 00000004:00080000:3.0:1713481296.548199:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299f800, transno 4296032527 00000004:00080000:3.0:1713481296.548202:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299d880, transno 4296032528 00000004:00080000:3.0:1713481296.548204:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085ec9880, transno 4296032530 00000004:00080000:3.0:1713481296.548207:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085c6a680, transno 4296032532 00000004:00080000:3.0:1713481296.548210:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072aea680, transno 4296032533 00000004:00080000:3.0:1713481296.548212:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299f100, transno 4296032535 00000004:00080000:3.0:1713481296.548215:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c50ed80, transno 4296032540 00000004:00080000:3.0:1713481296.548217:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e34b100, transno 4296032541 00000004:00080000:3.0:1713481296.548220:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007286f480, transno 4296032542 00000004:00080000:3.0:1713481296.548222:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130430380, transno 4296032543 00000004:00080000:3.0:1713481296.548224:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a000380, transno 4296032546 00000004:00080000:3.0:1713481296.548227:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a96a00, transno 4296032548 00000004:00080000:3.0:1713481296.548229:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e065880, transno 4296032551 00000004:00080000:3.0:1713481296.548232:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ae8700, transno 4296032553 00000004:00080000:3.0:1713481296.548235:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009182a680, transno 4296032554 00000004:00080000:3.0:1713481296.548237:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883baa00, transno 4296032555 00000004:00080000:3.0:1713481296.548240:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883b8000, transno 4296032556 00000004:00080000:3.0:1713481296.548242:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883ba680, transno 4296032559 00000004:00080000:3.0:1713481296.548245:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092217480, transno 4296032560 00000004:00080000:3.0:1713481296.548247:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e34ad80, transno 4296032562 00000004:00080000:3.0:1713481296.548250:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007809f100, transno 4296032566 00000004:00080000:3.0:1713481296.548252:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883b8e00, transno 4296032568 00000004:00080000:3.0:1713481296.548254:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085c69500, transno 4296032570 00000004:00080000:3.0:1713481296.548257:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783c9f80, transno 4296032573 00000004:00080000:3.0:1713481296.548260:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085ec8700, transno 4296032574 00000004:00080000:3.0:1713481296.548262:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081eced80, transno 4296032577 00000004:00080000:3.0:1713481296.548265:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e06300, transno 4296032578 00000004:00080000:3.0:1713481296.548268:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5e680, transno 4296032580 00000004:00080000:3.0:1713481296.548270:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0fad80, transno 4296032581 00000004:00080000:3.0:1713481296.548273:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fb1d180, transno 4296032584 00000004:00080000:3.0:1713481296.548276:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120759c00, transno 4296032589 00000004:00080000:3.0:1713481296.548278:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120759500, transno 4296032591 00000004:00080000:3.0:1713481296.548280:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120759f80, transno 4296032592 00000004:00080000:3.0:1713481296.548283:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e68e00, transno 4296032593 00000004:00080000:3.0:1713481296.548286:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075757b80, transno 4296032594 00000004:00080000:3.0:1713481296.548288:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013584ca80, transno 4296032596 00000004:00080000:3.0:1713481296.548291:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075755180, transno 4296032601 00000004:00080000:3.0:1713481296.548293:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931e300, transno 4296032604 00000004:00080000:3.0:1713481296.548295:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956ed80, transno 4296032605 00000004:00080000:3.0:1713481296.548298:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077379f80, transno 4296032607 00000004:00080000:3.0:1713481296.548300:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c01c700, transno 4296032608 00000004:00080000:3.0:1713481296.548303:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077379500, transno 4296032609 00000004:00080000:3.0:1713481296.548305:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121c6c700, transno 4296032610 00000004:00080000:3.0:1713481296.548308:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a378a80, transno 4296032613 00000004:00080000:3.0:1713481296.548311:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a37a300, transno 4296032614 00000004:00080000:3.0:1713481296.548313:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007286e300, transno 4296032620 00000004:00080000:3.0:1713481296.548316:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bd88380, transno 4296032621 00000004:00080000:3.0:1713481296.548318:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082115c00, transno 4296032622 00000004:00080000:3.0:1713481296.548320:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ae8000, transno 4296032623 00000004:00080000:3.0:1713481296.548322:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e51500, transno 4296032625 00000004:00080000:3.0:1713481296.548325:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a37b100, transno 4296032626 00000004:00080000:3.0:1713481296.548328:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077afdf80, transno 4296032627 00000004:00080000:3.0:1713481296.548330:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ae0380, transno 4296032631 00000004:00080000:3.0:1713481296.548333:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013617a300, transno 4296032636 00000004:00080000:3.0:1713481296.548336:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078699500, transno 4296032637 00000004:00080000:3.0:1713481296.548338:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782fb100, transno 4296032638 00000004:00080000:3.0:1713481296.548341:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121c6df80, transno 4296032640 00000004:00080000:3.0:1713481296.548343:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a90ad80, transno 4296032641 00000004:00080000:3.0:1713481296.548346:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ddc7480, transno 4296032642 00000004:00080000:3.0:1713481296.548348:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120bedc00, transno 4296032644 00000004:00080000:3.0:1713481296.548350:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083331c00, transno 4296032648 00000004:00080000:3.0:1713481296.548353:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082283800, transno 4296032652 00000004:00080000:3.0:1713481296.548356:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082283100, transno 4296032653 00000004:00080000:3.0:1713481296.548358:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083333480, transno 4296032655 00000004:00080000:3.0:1713481296.548361:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075755f80, transno 4296032658 00000004:00080000:3.0:1713481296.548364:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e1ed80, transno 4296032660 00000004:00080000:3.0:1713481296.548367:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e22b480, transno 4296032662 00000004:00080000:3.0:1713481296.548369:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e229500, transno 4296032663 00000004:00080000:3.0:1713481296.548371:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083330a80, transno 4296032665 00000004:00080000:3.0:1713481296.548374:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a9f80, transno 4296032668 00000004:00080000:3.0:1713481296.548377:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135904e00, transno 4296032673 00000004:00080000:3.0:1713481296.548379:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007727e680, transno 4296032674 00000004:00080000:3.0:1713481296.548382:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136178e00, transno 4296032675 00000004:00080000:3.0:1713481296.548386:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787e9f80, transno 4296032676 00000004:00080000:3.0:1713481296.548389:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787eb480, transno 4296032678 00000004:00080000:3.0:1713481296.548392:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781c3100, transno 4296032680 00000004:00080000:3.0:1713481296.548394:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99a300, transno 4296032681 00000004:00080000:3.0:1713481296.548397:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f998380, transno 4296032684 00000004:00080000:3.0:1713481296.548400:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f999f80, transno 4296032688 00000004:00080000:3.0:1713481296.548402:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015b480, transno 4296032689 00000004:00080000:3.0:1713481296.548404:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99bb80, transno 4296032691 00000004:00080000:3.0:1713481296.548407:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120158e00, transno 4296032693 00000004:00080000:3.0:1713481296.548409:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99a680, transno 4296032697 00000004:00080000:3.0:1713481296.548412:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135907b80, transno 4296032698 00000004:00080000:3.0:1713481296.548415:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083332d80, transno 4296032702 00000004:00080000:3.0:1713481296.548418:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783fa680, transno 4296032703 00000004:00080000:3.0:1713481296.548420:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783f9500, transno 4296032704 00000004:00080000:3.0:1713481296.548422:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17b800, transno 4296032705 00000004:00080000:3.0:1713481296.548425:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803d7100, transno 4296032707 00000004:00080000:3.0:1713481296.548427:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013227f800, transno 4296032709 00000004:00080000:3.0:1713481296.548429:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084877480, transno 4296032710 00000004:00080000:3.0:1713481296.548432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803d7b80, transno 4296032711 00000004:00080000:3.0:1713481296.548434:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780dad80, transno 4296032718 00000004:00080000:3.0:1713481296.548437:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe7a680, transno 4296032719 00000004:00080000:3.0:1713481296.548440:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009615ce00, transno 4296032720 00000004:00080000:3.0:1713481296.548442:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754fbb80, transno 4296032721 00000004:00080000:3.0:1713481296.548445:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081564e00, transno 4296032723 00000004:00080000:3.0:1713481296.548448:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007992ed80, transno 4296032724 00000004:00080000:3.0:1713481296.548450:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796f800, transno 4296032726 00000004:00080000:3.0:1713481296.548453:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084877800, transno 4296032727 00000004:00080000:3.0:1713481296.548455:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af43b80, transno 4296032733 00000004:00080000:3.0:1713481296.548457:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801207b0a80, transno 4296032735 00000004:00080000:3.0:1713481296.548460:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009615f100, transno 4296032738 00000004:00080000:3.0:1713481296.548463:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883eb480, transno 4296032739 00000004:00080000:3.0:1713481296.548466:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091955c00, transno 4296032740 00000004:00080000:3.0:1713481296.548469:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783faa00, transno 4296032742 00000004:00080000:3.0:1713481296.548471:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099198000, transno 4296032746 00000004:00080000:3.0:1713481296.548474:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783f9c00, transno 4296032749 00000004:00080000:3.0:1713481296.548476:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097655880, transno 4296032751 00000004:00080000:3.0:1713481296.548479:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007812c000, transno 4296032752 00000004:00080000:3.0:1713481296.548482:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086e36300, transno 4296032753 00000004:00080000:3.0:1713481296.548484:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a291c00, transno 4296032755 00000004:00080000:3.0:1713481296.548488:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099844a80, transno 4296032756 00000004:00080000:3.0:1713481296.548490:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5cc700, transno 4296032762 00000004:00080000:3.0:1713481296.548493:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783fbb80, transno 4296032763 00000004:00080000:3.0:1713481296.548495:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9fc700, transno 4296032764 00000004:00080000:3.0:1713481296.548497:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a291880, transno 4296032767 00000004:00080000:3.0:1713481296.548500:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f985c00, transno 4296032768 00000004:00080000:3.0:1713481296.548502:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d71180, transno 4296032772 00000004:00080000:3.0:1713481296.548505:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801207b3100, transno 4296032773 00000004:00080000:3.0:1713481296.548507:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f984a80, transno 4296032774 00000004:00080000:3.0:1713481296.548510:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e89f80, transno 4296032775 00000004:00080000:3.0:1713481296.548512:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202c9f80, transno 4296032777 00000004:00080000:3.0:1713481296.548514:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783f8e00, transno 4296032781 00000004:00080000:3.0:1713481296.548517:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202c9180, transno 4296032782 00000004:00080000:3.0:1713481296.548519:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803c1880, transno 4296032784 00000004:00080000:3.0:1713481296.548522:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc88a80, transno 4296032787 00000004:00080000:3.0:1713481296.548525:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc8b480, transno 4296032788 00000004:00080000:3.0:1713481296.548527:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae9180, transno 4296032789 00000004:00080000:3.0:1713481296.548529:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc88700, transno 4296032791 00000004:00080000:3.0:1713481296.548532:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078764700, transno 4296032793 00000004:00080000:3.0:1713481296.548534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078198380, transno 4296032794 00000004:00080000:3.0:1713481296.548536:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120404e00, transno 4296032796 00000004:00080000:3.0:1713481296.548540:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076afdf80, transno 4296032802 00000004:00080000:3.0:1713481296.548542:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec56680, transno 4296032803 00000004:00080000:3.0:1713481296.548545:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007841c000, transno 4296032804 00000004:00080000:3.0:1713481296.548547:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0b9880, transno 4296032806 00000004:00080000:3.0:1713481296.548550:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801209b4700, transno 4296032808 00000004:00080000:3.0:1713481296.548553:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007841df80, transno 4296032810 00000004:00080000:3.0:1713481296.548555:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0b9f80, transno 4296032812 00000004:00080000:3.0:1713481296.548557:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078766a00, transno 4296032813 00000004:00080000:3.0:1713481296.548560:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33c700, transno 4296032815 00000004:00080000:3.0:1713481296.548562:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e131180, transno 4296032820 00000004:00080000:3.0:1713481296.548566:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3e300, transno 4296032823 00000004:00080000:3.0:1713481296.548568:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077935c00, transno 4296032824 00000004:00080000:3.0:1713481296.548571:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e133100, transno 4296032825 00000004:00080000:3.0:1713481296.548573:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077937100, transno 4296032826 00000004:00080000:3.0:1713481296.548575:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962b4000, transno 4296032827 00000004:00080000:3.0:1713481296.548578:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302f5500, transno 4296032830 00000004:00080000:3.0:1713481296.548580:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077935500, transno 4296032831 00000004:00080000:3.0:1713481296.548582:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3c380, transno 4296032832 00000004:00080000:3.0:1713481296.548585:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1ead80, transno 4296032835 00000004:00080000:3.0:1713481296.548588:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008481f100, transno 4296032837 00000004:00080000:3.0:1713481296.548590:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed86d80, transno 4296032839 00000004:00080000:3.0:1713481296.548593:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bed180, transno 4296032843 00000004:00080000:3.0:1713481296.548597:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077326d80, transno 4296032844 00000004:00080000:3.0:1713481296.548599:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077324e00, transno 4296032845 00000004:00080000:3.0:1713481296.548602:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a41aa00, transno 4296032848 00000004:00080000:3.0:1713481296.548604:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076af4700, transno 4296032849 00000004:00080000:3.0:1713481296.548607:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609df80, transno 4296032851 00000004:00080000:3.0:1713481296.548610:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a2a00, transno 4296032854 00000004:00080000:3.0:1713481296.548613:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012003a680, transno 4296032857 00000004:00080000:3.0:1713481296.548615:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5f480, transno 4296032859 00000004:00080000:3.0:1713481296.548619:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120481c00, transno 4296032860 00000004:00080000:3.0:1713481296.548621:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120480380, transno 4296032863 00000004:00080000:3.0:1713481296.548624:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d35f80, transno 4296032865 00000004:00080000:3.0:1713481296.548627:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c5180, transno 4296032866 00000004:00080000:3.0:1713481296.548629:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012252f100, transno 4296032867 00000004:00080000:3.0:1713481296.548632:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce7800, transno 4296032868 00000004:00080000:3.0:1713481296.548634:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17f800, transno 4296032872 00000004:00080000:3.0:1713481296.548638:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a8a300, transno 4296032873 00000004:00080000:3.0:1713481296.548641:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a0d880, transno 4296032874 00000004:00080000:3.0:1713481296.548643:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5cd180, transno 4296032878 00000004:00080000:3.0:1713481296.548646:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3f800, transno 4296032881 00000004:00080000:3.0:1713481296.548649:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3d180, transno 4296032882 00000004:00080000:3.0:1713481296.548651:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fec700, transno 4296032883 00000004:00080000:3.0:1713481296.548654:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121dd5500, transno 4296032884 00000004:00080000:3.0:1713481296.548657:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084303480, transno 4296032888 00000004:00080000:3.0:1713481296.548660:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084300000, transno 4296032889 00000004:00080000:3.0:1713481296.548662:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3ea00, transno 4296032890 00000004:00080000:3.0:1713481296.548677:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bfea00, transno 4296032891 00000004:00080000:3.0:1713481296.548681:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012064a680, transno 4296032895 00000004:00080000:3.0:1713481296.548684:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bfe300, transno 4296032898 00000004:00080000:3.0:1713481296.548686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e32d500, transno 4296032900 00000004:00080000:3.0:1713481296.548690:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077129880, transno 4296032901 00000004:00080000:3.0:1713481296.548693:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bfdf80, transno 4296032903 00000004:00080000:3.0:1713481296.548696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e32e300, transno 4296032904 00000004:00080000:3.0:1713481296.548698:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794a9880, transno 4296032907 00000004:00080000:3.0:1713481296.548700:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794e1500, transno 4296032908 00000004:00080000:3.0:1713481296.548703:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa7800, transno 4296032910 00000004:00080000:3.0:1713481296.548706:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e407480, transno 4296032912 00000004:00080000:3.0:1713481296.548709:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082105c00, transno 4296032914 00000004:00080000:3.0:1713481296.548711:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e406300, transno 4296032915 00000004:00080000:3.0:1713481296.548715:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089b22a00, transno 4296032917 00000004:00080000:3.0:1713481296.548717:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089b23480, transno 4296032920 00000004:00080000:3.0:1713481296.548720:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b42300, transno 4296032922 00000004:00080000:3.0:1713481296.548723:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079659180, transno 4296032923 00000004:00080000:3.0:1713481296.548726:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078415880, transno 4296032925 00000004:00080000:3.0:1713481296.548729:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120227100, transno 4296032927 00000004:00080000:3.0:1713481296.548731:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120225180, transno 4296032928 00000004:00080000:3.0:1713481296.548734:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b8d500, transno 4296032929 00000004:00080000:3.0:1713481296.548737:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079ac6a00, transno 4296032931 00000004:00080000:3.0:1713481296.548739:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079ac4000, transno 4296032932 00000004:00080000:3.0:1713481296.548742:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078414a80, transno 4296032933 00000004:00080000:3.0:1713481296.548745:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120225f80, transno 4296032938 00000004:00080000:3.0:1713481296.548747:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3e9180, transno 4296032942 00000004:00080000:3.0:1713481296.548750:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062ed80, transno 4296032944 00000004:00080000:3.0:1713481296.548753:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3e8380, transno 4296032946 00000004:00080000:3.0:1713481296.548756:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007712bb80, transno 4296032947 00000004:00080000:3.0:1713481296.548758:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086d65f80, transno 4296032949 00000004:00080000:3.0:1713481296.548760:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086d65500, transno 4296032952 00000004:00080000:3.0:1713481296.548763:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e8c000, transno 4296032953 00000004:00080000:3.0:1713481296.548766:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015d880, transno 4296032957 00000004:00080000:3.0:1713481296.548769:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122baf800, transno 4296032958 00000004:00080000:3.0:1713481296.548771:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078416300, transno 4296032959 00000004:00080000:3.0:1713481296.548774:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205afb80, transno 4296032961 00000004:00080000:3.0:1713481296.548777:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122badf80, transno 4296032963 00000004:00080000:3.0:1713481296.548779:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122bad880, transno 4296032964 00000004:00080000:3.0:1713481296.548782:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3e8700, transno 4296032967 00000004:00080000:3.0:1713481296.548784:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3e8a80, transno 4296032970 00000004:00080000:3.0:1713481296.548787:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b9bb80, transno 4296032971 00000004:00080000:3.0:1713481296.548789:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b9b800, transno 4296032973 00000004:00080000:3.0:1713481296.548791:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b9aa00, transno 4296032976 00000004:00080000:3.0:1713481296.548795:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b98e00, transno 4296032977 00000004:00080000:3.0:1713481296.548797:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122baf100, transno 4296032979 00000004:00080000:3.0:1713481296.548800:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090751500, transno 4296032981 00000004:00080000:3.0:1713481296.548803:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062e300, transno 4296032982 00000004:00080000:3.0:1713481296.548806:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a5c000, transno 4296032989 00000004:00080000:3.0:1713481296.548809:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a51880, transno 4296032990 00000004:00080000:3.0:1713481296.548811:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec31f80, transno 4296032991 00000004:00080000:3.0:1713481296.548814:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079ac7480, transno 4296032992 00000004:00080000:3.0:1713481296.548816:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122bad180, transno 4296032994 00000004:00080000:3.0:1713481296.548819:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095f6d180, transno 4296032995 00000004:00080000:3.0:1713481296.548822:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d81880, transno 4296032998 00000004:00080000:3.0:1713481296.548825:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007719aa00, transno 4296032999 00000004:00080000:3.0:1713481296.548827:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d80a80, transno 4296033004 00000004:00080000:3.0:1713481296.548831:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082081880, transno 4296033005 00000004:00080000:3.0:1713481296.548833:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941d3b80, transno 4296033007 00000004:00080000:3.0:1713481296.548836:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785d5f80, transno 4296033008 00000004:00080000:3.0:1713481296.548838:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785d4000, transno 4296033009 00000004:00080000:3.0:1713481296.548841:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736c700, transno 4296033011 00000004:00080000:3.0:1713481296.548843:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c0e00, transno 4296033014 00000004:00080000:3.0:1713481296.548846:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794e2d80, transno 4296033016 00000004:00080000:3.0:1713481296.548849:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736f480, transno 4296033018 00000004:00080000:3.0:1713481296.548851:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736df80, transno 4296033020 00000004:00080000:3.0:1713481296.548854:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736ca80, transno 4296033022 00000004:00080000:3.0:1713481296.548856:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941d2300, transno 4296033023 00000004:00080000:3.0:1713481296.548859:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736dc00, transno 4296033027 00000004:00080000:3.0:1713481296.548861:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c1c00, transno 4296033029 00000004:00080000:3.0:1713481296.548864:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078612d80, transno 4296033031 00000004:00080000:3.0:1713481296.548866:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c2300, transno 4296033032 00000004:00080000:3.0:1713481296.548869:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083796300, transno 4296033034 00000004:00080000:3.0:1713481296.548871:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800967cdc00, transno 4296033035 00000004:00080000:3.0:1713481296.548875:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201fea00, transno 4296033038 00000004:00080000:3.0:1713481296.548878:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201fca80, transno 4296033041 00000004:00080000:3.0:1713481296.548880:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008314bb80, transno 4296033042 00000004:00080000:3.0:1713481296.548883:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829c000, transno 4296033045 00000004:00080000:3.0:1713481296.548885:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bedbb80, transno 4296033048 00000004:00080000:3.0:1713481296.548888:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007737ce00, transno 4296033049 00000004:00080000:3.0:1713481296.548891:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007737c000, transno 4296033050 00000004:00080000:3.0:1713481296.548893:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868cdc00, transno 4296033051 00000004:00080000:3.0:1713481296.548896:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e67480, transno 4296033055 00000004:00080000:3.0:1713481296.548899:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e6b100, transno 4296033056 00000004:00080000:3.0:1713481296.548902:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801350b4700, transno 4296033058 00000004:00080000:3.0:1713481296.548905:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120247800, transno 4296033059 00000004:00080000:3.0:1713481296.548908:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829c700, transno 4296033064 00000004:00080000:3.0:1713481296.548911:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801350b4e00, transno 4296033065 00000004:00080000:3.0:1713481296.548913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec53480, transno 4296033066 00000004:00080000:3.0:1713481296.548916:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b29c00, transno 4296033069 00000004:00080000:3.0:1713481296.548919:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868ce680, transno 4296033070 00000004:00080000:3.0:1713481296.548921:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aeb100, transno 4296033073 00000004:00080000:3.0:1713481296.548924:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921d4000, transno 4296033074 00000004:00080000:3.0:1713481296.548927:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e158380, transno 4296033076 00000004:00080000:3.0:1713481296.548930:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136345f80, transno 4296033078 00000004:00080000:3.0:1713481296.548933:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1daa00, transno 4296033081 00000004:00080000:3.0:1713481296.548936:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921d6a00, transno 4296033083 00000004:00080000:3.0:1713481296.548938:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edc1c00, transno 4296033084 00000004:00080000:3.0:1713481296.548941:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bd0e00, transno 4296033086 00000004:00080000:3.0:1713481296.548943:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bd3480, transno 4296033090 00000004:00080000:3.0:1713481296.548946:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0bce00, transno 4296033091 00000004:00080000:3.0:1713481296.548948:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0bc000, transno 4296033093 00000004:00080000:3.0:1713481296.548951:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084821f80, transno 4296033094 00000004:00080000:3.0:1713481296.548954:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007287c700, transno 4296033095 00000004:00080000:3.0:1713481296.548957:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a18380, transno 4296033096 00000004:00080000:3.0:1713481296.548960:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db8aa00, transno 4296033098 00000004:00080000:3.0:1713481296.548963:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e69c00, transno 4296033102 00000004:00080000:3.0:1713481296.548966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b77480, transno 4296033191 00000004:00080000:3.0:1713481296.548968:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072865f80, transno 4296033192 00000004:00080000:3.0:1713481296.548971:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b76680, transno 4296033194 00000004:00080000:3.0:1713481296.548974:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db89500, transno 4296033209 00000004:00080000:3.0:1713481296.548977:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e011880, transno 4296033210 00000004:00080000:3.0:1713481296.548979:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1f100, transno 4296033212 00000004:00080000:3.0:1713481296.548981:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db88000, transno 4296033213 00000004:00080000:3.0:1713481296.548984:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781a4a80, transno 4296033218 00000004:00080000:3.0:1713481296.548987:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009998a680, transno 4296033736 00000004:00080000:3.0:1713481296.548990:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133ac8a80, transno 4296033739 00000004:00080000:3.0:1713481296.548992:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133ac8e00, transno 4296033741 00000004:00080000:3.0:1713481296.548995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db88700, transno 4296033744 00000004:00080000:3.0:1713481296.548997:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db88380, transno 4296033746 00000004:00080000:3.0:1713481296.549000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db89c00, transno 4296033794 00000004:00080000:3.0:1713481296.549002:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007811a680, transno 4296033797 00000004:00080000:3.0:1713481296.549005:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099989f80, transno 4296033948 00000004:00080000:3.0:1713481296.549008:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b79880, transno 4296033962 00000004:00080000:3.0:1713481296.549010:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b79c00, transno 4296033964 00000004:00080000:3.0:1713481296.549013:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e90000, transno 4296033966 00000004:00080000:3.0:1713481296.549016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd2aa00, transno 4296033969 00000004:00080000:3.0:1713481296.549018:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008da73b80, transno 4296033970 00000004:00080000:3.0:1713481296.549021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008da70a80, transno 4296033972 00000004:00080000:3.0:1713481296.549024:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008da72300, transno 4296033973 00000004:00080000:3.0:1713481296.549026:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130430000, transno 4296033977 00000004:00080000:3.0:1713481296.549029:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b03480, transno 4296033978 00000004:00080000:3.0:1713481296.549032:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ebea00, transno 4296033979 00000004:00080000:3.0:1713481296.549034:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b00380, transno 4296033981 00000004:00080000:3.0:1713481296.549038:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823c4e00, transno 4296033984 00000004:00080000:3.0:1713481296.549040:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c98a80, transno 4296033985 00000004:00080000:3.0:1713481296.549043:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ee1180, transno 4296033987 00000004:00080000:3.0:1713481296.549046:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092915180, transno 4296033989 00000004:00080000:3.0:1713481296.549049:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c99880, transno 4296033990 00000004:00080000:3.0:1713481296.549051:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ee0380, transno 4296033994 00000004:00080000:3.0:1713481296.549053:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9b100, transno 4296033995 00000004:00080000:3.0:1713481296.549056:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c06680, transno 4296033997 00000004:00080000:3.0:1713481296.549058:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c04380, transno 4296033998 00000004:00080000:3.0:1713481296.549061:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c07100, transno 4296034001 00000004:00080000:3.0:1713481296.549064:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e797100, transno 4296034002 00000004:00080000:3.0:1713481296.549067:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e795f80, transno 4296034003 00000004:00080000:3.0:1713481296.549070:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de12d80, transno 4296034004 00000004:00080000:3.0:1713481296.549073:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077972300, transno 4296034010 00000004:00080000:3.0:1713481296.549075:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086b45c00, transno 4296034012 00000004:00080000:3.0:1713481296.549077:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086b44e00, transno 4296034013 00000004:00080000:3.0:1713481296.549080:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086b44000, transno 4296034015 00000004:00080000:3.0:1713481296.549082:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e794e00, transno 4296034016 00000004:00080000:3.0:1713481296.549084:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b01180, transno 4296034017 00000004:00080000:3.0:1713481296.549087:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e796300, transno 4296034018 00000004:00080000:3.0:1713481296.549089:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008da73800, transno 4296034022 00000004:00080000:3.0:1713481296.549092:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c07480, transno 4296034026 00000004:00080000:3.0:1713481296.549095:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0fb480, transno 4296034041 00000004:00080000:3.0:1713481296.549098:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c06300, transno 4296034264 00000004:00080000:3.0:1713481296.549101:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c04e00, transno 4296034266 00000004:00080000:3.0:1713481296.549104:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0f9c00, transno 4296034267 00000004:00080000:3.0:1713481296.549106:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077971f80, transno 4296034269 00000004:00080000:3.0:1713481296.549109:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077973100, transno 4296034272 00000004:00080000:3.0:1713481296.549111:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0faa00, transno 4296034276 00000004:00080000:3.0:1713481296.549114:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bad500, transno 4296035339 00000004:00080000:3.0:1713481296.549135:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de10380, transno 4296035340 00000004:00080000:3.0:1713481296.549138:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e50380, transno 4296036004 00000004:00080000:3.0:1713481296.549141:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e51c00, transno 4296036111 00000004:00080000:3.0:1713481296.549143:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e53800, transno 4296036116 00000004:00080000:3.0:1713481296.549146:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8dce00, transno 4296036153 00000004:00080000:3.0:1713481296.549148:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921d2300, transno 4296036156 00000004:00080000:3.0:1713481296.549151:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007287df80, transno 4296036157 00000004:00080000:3.0:1713481296.549154:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077016d80, transno 4296036163 00000004:00080000:3.0:1713481296.549157:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077014e00, transno 4296036164 00000004:00080000:3.0:1713481296.549159:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e132680, transno 4296036166 00000004:00080000:3.0:1713481296.549162:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085eca300, transno 4296036169 00000004:00080000:3.0:1713481296.549165:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e133480, transno 4296036170 00000004:00080000:3.0:1713481296.549168:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ee2b100, transno 4296036171 00000004:00080000:3.0:1713481296.549171:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a4a300, transno 4296036172 00000004:00080000:3.0:1713481296.549173:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135849500, transno 4296036177 00000004:00080000:3.0:1713481296.549176:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062e680, transno 4296036181 00000004:00080000:3.0:1713481296.549178:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062d180, transno 4296036182 00000004:00080000:3.0:1713481296.549181:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803c2680, transno 4296036183 00000004:00080000:3.0:1713481296.549184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d35c00, transno 4296036184 00000004:00080000:3.0:1713481296.549186:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787c7800, transno 4296036186 00000004:00080000:3.0:1713481296.549189:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803c1f80, transno 4296036189 00000004:00080000:3.0:1713481296.549192:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800771ea680, transno 4296036193 00000004:00080000:3.0:1713481296.549194:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072add180, transno 4296036194 00000004:00080000:3.0:1713481296.549197:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a119f80, transno 4296036195 00000004:00080000:3.0:1713481296.549199:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a119180, transno 4296036196 00000004:00080000:3.0:1713481296.549202:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af70000, transno 4296036197 00000004:00080000:3.0:1713481296.549204:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783ded80, transno 4296036199 00000004:00080000:3.0:1713481296.549207:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f984000, transno 4296036201 00000004:00080000:3.0:1713481296.549209:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083b84380, transno 4296036205 00000004:00080000:3.0:1713481296.549212:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083b86300, transno 4296036206 00000004:00080000:3.0:1713481296.549215:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e305f80, transno 4296036208 00000004:00080000:3.0:1713481296.549218:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819df80, transno 4296036209 00000004:00080000:3.0:1713481296.549221:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803c1c00, transno 4296036211 00000004:00080000:3.0:1713481296.549223:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150c000, transno 4296036212 00000004:00080000:3.0:1713481296.549226:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091c1ce00, transno 4296036216 00000004:00080000:3.0:1713481296.549228:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133c53b80, transno 4296036217 00000004:00080000:3.0:1713481296.549231:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007987d880, transno 4296036222 00000004:00080000:3.0:1713481296.549233:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091c1ca80, transno 4296036224 00000004:00080000:3.0:1713481296.549236:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007987f100, transno 4296036225 00000004:00080000:3.0:1713481296.549239:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a8d5880, transno 4296036227 00000004:00080000:3.0:1713481296.549242:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a16300, transno 4296036230 00000004:00080000:3.0:1713481296.549244:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2ab800, transno 4296036233 00000004:00080000:3.0:1713481296.549247:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124058700, transno 4296036235 00000004:00080000:3.0:1713481296.549249:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e66a00, transno 4296036237 00000004:00080000:3.0:1713481296.549252:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a5a680, transno 4296036239 00000004:00080000:3.0:1713481296.549255:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b83b800, transno 4296036240 00000004:00080000:3.0:1713481296.549257:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b839880, transno 4296036241 00000004:00080000:3.0:1713481296.549260:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b838700, transno 4296036243 00000004:00080000:3.0:1713481296.549262:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083839c00, transno 4296036246 00000004:00080000:3.0:1713481296.549265:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e6b100, transno 4296036249 00000004:00080000:3.0:1713481296.549267:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013225a680, transno 4296036251 00000004:00080000:3.0:1713481296.549270:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099807480, transno 4296036253 00000004:00080000:3.0:1713481296.549273:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080303800, transno 4296036258 00000004:00080000:3.0:1713481296.549276:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080301500, transno 4296036260 00000004:00080000:3.0:1713481296.549278:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e6b800, transno 4296036263 00000004:00080000:3.0:1713481296.549282:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800770a4000, transno 4296036264 00000004:00080000:3.0:1713481296.549285:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e304e00, transno 4296036265 00000004:00080000:3.0:1713481296.549288:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080300a80, transno 4296036266 00000004:00080000:3.0:1713481296.549290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e307100, transno 4296036268 00000004:00080000:3.0:1713481296.549292:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099805f80, transno 4296036270 00000004:00080000:3.0:1713481296.549295:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf0a80, transno 4296036275 00000004:00080000:3.0:1713481296.549298:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb1f80, transno 4296036277 00000004:00080000:3.0:1713481296.549301:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb0000, transno 4296036279 00000004:00080000:3.0:1713481296.549303:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb0380, transno 4296036280 00000004:00080000:3.0:1713481296.549306:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a118e00, transno 4296036281 00000004:00080000:3.0:1713481296.549308:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a97b80, transno 4296036282 00000004:00080000:3.0:1713481296.549311:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c5ce680, transno 4296036284 00000004:00080000:3.0:1713481296.549313:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ec6a00, transno 4296036285 00000004:00080000:3.0:1713481296.549316:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe2dc00, transno 4296036288 00000004:00080000:3.0:1713481296.549319:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe2c380, transno 4296036292 00000004:00080000:3.0:1713481296.549322:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796f6680, transno 4296036294 00000004:00080000:3.0:1713481296.549324:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796f4e00, transno 4296036295 00000004:00080000:3.0:1713481296.549327:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078614a80, transno 4296036296 00000004:00080000:3.0:1713481296.549329:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d37b80, transno 4296036298 00000004:00080000:3.0:1713481296.549332:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a59500, transno 4296036299 00000004:00080000:3.0:1713481296.549335:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819f100, transno 4296036301 00000004:00080000:3.0:1713481296.549337:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b360000, transno 4296036304 00000004:00080000:3.0:1713481296.549340:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801209a5500, transno 4296036306 00000004:00080000:3.0:1713481296.549343:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a94a80, transno 4296036308 00000004:00080000:3.0:1713481296.549347:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a96d80, transno 4296036310 00000004:00080000:3.0:1713481296.549350:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da45500, transno 4296036312 00000004:00080000:3.0:1713481296.549352:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b363800, transno 4296036314 00000004:00080000:3.0:1713481296.549355:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078eb7480, transno 4296036316 00000004:00080000:3.0:1713481296.549358:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cddc00, transno 4296036317 00000004:00080000:3.0:1713481296.549360:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801209a6680, transno 4296036320 00000004:00080000:3.0:1713481296.549363:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120246a00, transno 4296036322 00000004:00080000:3.0:1713481296.549365:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc79500, transno 4296036323 00000004:00080000:3.0:1713481296.549368:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a920a80, transno 4296036325 00000004:00080000:3.0:1713481296.549370:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800833aad80, transno 4296036327 00000004:00080000:3.0:1713481296.549373:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800833ab100, transno 4296036330 00000004:00080000:3.0:1713481296.549377:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136347480, transno 4296036331 00000004:00080000:3.0:1713481296.549380:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a868a80, transno 4296036334 00000004:00080000:3.0:1713481296.549382:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007737ca80, transno 4296036335 00000004:00080000:3.0:1713481296.549385:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a23ad80, transno 4296036338 00000004:00080000:3.0:1713481296.549387:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a23aa00, transno 4296036340 00000004:00080000:3.0:1713481296.549390:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a238000, transno 4296036341 00000004:00080000:3.0:1713481296.549392:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe2ce00, transno 4296036344 00000004:00080000:3.0:1713481296.549395:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a8d6300, transno 4296036346 00000004:00080000:3.0:1713481296.549398:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800821d2300, transno 4296036347 00000004:00080000:3.0:1713481296.549401:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120af2680, transno 4296036350 00000004:00080000:3.0:1713481296.549403:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881b1180, transno 4296036352 00000004:00080000:3.0:1713481296.549406:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800821d1180, transno 4296036354 00000004:00080000:3.0:1713481296.549409:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6213800, transno 4296036355 00000004:00080000:3.0:1713481296.549412:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881b2300, transno 4296036356 00000004:00080000:3.0:1713481296.549414:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012003b100, transno 4296036359 00000004:00080000:3.0:1713481296.549417:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b0c700, transno 4296036361 00000004:00080000:3.0:1713481296.549419:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783ce300, transno 4296036364 00000004:00080000:3.0:1713481296.549422:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783cfb80, transno 4296036366 00000004:00080000:3.0:1713481296.549424:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783cd500, transno 4296036368 00000004:00080000:3.0:1713481296.549427:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784e8a80, transno 4296036370 00000004:00080000:3.0:1713481296.549430:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782ae300, transno 4296036372 00000004:00080000:3.0:1713481296.549433:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782ad880, transno 4296036373 00000004:00080000:3.0:1713481296.549435:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aea680, transno 4296036378 00000004:00080000:3.0:1713481296.549438:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077310700, transno 4296036379 00000004:00080000:3.0:1713481296.549440:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782aca80, transno 4296036381 00000004:00080000:3.0:1713481296.549443:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc7a300, transno 4296036382 00000004:00080000:3.0:1713481296.549445:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086ae8380, transno 4296036383 00000004:00080000:3.0:1713481296.549448:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009232a300, transno 4296036385 00000004:00080000:3.0:1713481296.549451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009232b480, transno 4296036389 00000004:00080000:3.0:1713481296.549454:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081cf6300, transno 4296036391 00000004:00080000:3.0:1713481296.549457:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2be680, transno 4296036393 00000004:00080000:3.0:1713481296.549459:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd6aa00, transno 4296036395 00000004:00080000:3.0:1713481296.549461:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a50700, transno 4296036397 00000004:00080000:3.0:1713481296.549464:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a50e00, transno 4296036398 00000004:00080000:3.0:1713481296.549466:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202ab480, transno 4296036401 00000004:00080000:3.0:1713481296.549469:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ec5f80, transno 4296036403 00000004:00080000:3.0:1713481296.549471:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e15bb80, transno 4296036405 00000004:00080000:3.0:1713481296.549474:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed84a80, transno 4296036407 00000004:00080000:3.0:1713481296.549477:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773d2300, transno 4296036410 00000004:00080000:3.0:1713481296.549480:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af7100, transno 4296036411 00000004:00080000:3.0:1713481296.549483:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af5880, transno 4296036413 00000004:00080000:3.0:1713481296.549485:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d84000, transno 4296036414 00000004:00080000:3.0:1713481296.549488:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be3800, transno 4296036416 00000004:00080000:3.0:1713481296.549491:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a07ad80, transno 4296036419 00000004:00080000:3.0:1713481296.549493:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a51c00, transno 4296036421 00000004:00080000:3.0:1713481296.549496:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768d1f80, transno 4296036424 00000004:00080000:3.0:1713481296.549499:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768d2d80, transno 4296036425 00000004:00080000:3.0:1713481296.549502:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f941880, transno 4296036426 00000004:00080000:3.0:1713481296.549504:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af5180, transno 4296036428 00000004:00080000:3.0:1713481296.549507:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f940000, transno 4296036432 00000004:00080000:3.0:1713481296.549510:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f943800, transno 4296036434 00000004:00080000:3.0:1713481296.549513:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f943100, transno 4296036436 00000004:00080000:3.0:1713481296.549516:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768d0700, transno 4296036437 00000004:00080000:3.0:1713481296.549518:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768d3480, transno 4296036438 00000004:00080000:3.0:1713481296.549521:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e15aa00, transno 4296036440 00000004:00080000:3.0:1713481296.549523:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773d1c00, transno 4296036442 00000004:00080000:3.0:1713481296.549526:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b2ad80, transno 4296036443 00000004:00080000:3.0:1713481296.549528:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078613100, transno 4296036446 00000004:00080000:3.0:1713481296.549531:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df4a680, transno 4296036447 00000004:00080000:3.0:1713481296.549534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df4b480, transno 4296036449 00000004:00080000:3.0:1713481296.549537:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a04df80, transno 4296036450 00000004:00080000:3.0:1713481296.549540:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e159180, transno 4296036451 00000004:00080000:3.0:1713481296.549543:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b28e00, transno 4296036455 00000004:00080000:3.0:1713481296.549545:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078078000, transno 4296036457 00000004:00080000:3.0:1713481296.549548:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007807bb80, transno 4296036458 00000004:00080000:3.0:1713481296.549551:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be1500, transno 4296036462 00000004:00080000:3.0:1713481296.549553:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be0a80, transno 4296036463 00000004:00080000:3.0:1713481296.549556:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a18a80, transno 4296036465 00000004:00080000:3.0:1713481296.549559:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d3dc00, transno 4296036466 00000004:00080000:3.0:1713481296.549561:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a19180, transno 4296036467 00000004:00080000:3.0:1713481296.549563:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a1b100, transno 4296036472 00000004:00080000:3.0:1713481296.549566:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096768a80, transno 4296036473 00000004:00080000:3.0:1713481296.549568:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120095f80, transno 4296036476 00000004:00080000:3.0:1713481296.549570:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e012300, transno 4296036477 00000004:00080000:3.0:1713481296.549573:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089aeaa00, transno 4296036478 00000004:00080000:3.0:1713481296.549575:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e0380, transno 4296036480 00000004:00080000:3.0:1713481296.549578:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e1880, transno 4296036483 00000004:00080000:3.0:1713481296.549580:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009676a680, transno 4296036485 00000004:00080000:3.0:1713481296.549583:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781a5880, transno 4296036489 00000004:00080000:3.0:1713481296.549586:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072867800, transno 4296036491 00000004:00080000:3.0:1713481296.549589:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132237b80, transno 4296036492 00000004:00080000:3.0:1713481296.549592:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072867b80, transno 4296036493 00000004:00080000:3.0:1713481296.549595:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072865880, transno 4296036495 00000004:00080000:3.0:1713481296.549597:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b74700, transno 4296036497 00000004:00080000:3.0:1713481296.549600:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201fdf80, transno 4296036502 00000004:00080000:3.0:1713481296.549602:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d0e0a80, transno 4296036503 00000004:00080000:3.0:1713481296.549605:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781cea00, transno 4296036504 00000004:00080000:3.0:1713481296.549607:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781ced80, transno 4296036507 00000004:00080000:3.0:1713481296.549609:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781cc700, transno 4296036508 00000004:00080000:3.0:1713481296.549612:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085cadf80, transno 4296036509 00000004:00080000:3.0:1713481296.549615:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085caed80, transno 4296036510 00000004:00080000:3.0:1713481296.549618:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d0e1c00, transno 4296036513 00000004:00080000:3.0:1713481296.549621:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008808b480, transno 4296036518 00000004:00080000:3.0:1713481296.549623:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088088380, transno 4296036519 00000004:00080000:3.0:1713481296.549626:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098d880, transno 4296036521 00000004:00080000:3.0:1713481296.549629:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078543800, transno 4296036523 00000004:00080000:3.0:1713481296.549632:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007550ca80, transno 4296036524 00000004:00080000:3.0:1713481296.549634:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961ed80, transno 4296036525 00000004:00080000:3.0:1713481296.549637:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007961df80, transno 4296036526 00000004:00080000:3.0:1713481296.549640:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082025180, transno 4296036529 00000004:00080000:3.0:1713481296.549642:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0f1500, transno 4296036533 00000004:00080000:3.0:1713481296.549645:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c2fc000, transno 4296036535 00000004:00080000:3.0:1713481296.549648:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c37100, transno 4296036536 00000004:00080000:3.0:1713481296.549651:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801350b6d80, transno 4296036537 00000004:00080000:3.0:1713481296.549653:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c37b80, transno 4296036538 00000004:00080000:3.0:1713481296.549655:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c35180, transno 4296036541 00000004:00080000:3.0:1713481296.549657:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c37800, transno 4296036542 00000004:00080000:3.0:1713481296.549660:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e35f80, transno 4296036548 00000004:00080000:3.0:1713481296.549663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e9ea00, transno 4296036549 00000004:00080000:3.0:1713481296.549678:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120986680, transno 4296036550 00000004:00080000:3.0:1713481296.549681:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b76a00, transno 4296036551 00000004:00080000:3.0:1713481296.549683:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007550c000, transno 4296036552 00000004:00080000:3.0:1713481296.549686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082024700, transno 4296036555 00000004:00080000:3.0:1713481296.549688:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078541500, transno 4296036556 00000004:00080000:3.0:1713481296.549691:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120986300, transno 4296036558 00000004:00080000:3.0:1713481296.549693:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d87b800, transno 4296036560 00000004:00080000:3.0:1713481296.549696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac8a80, transno 4296036561 00000004:00080000:3.0:1713481296.549698:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d878700, transno 4296036562 00000004:00080000:3.0:1713481296.549701:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078411180, transno 4296036564 00000004:00080000:3.0:1713481296.549704:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c34380, transno 4296036565 00000004:00080000:3.0:1713481296.549707:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781cdc00, transno 4296036567 00000004:00080000:3.0:1713481296.549710:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c36680, transno 4296036568 00000004:00080000:3.0:1713481296.549712:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076876680, transno 4296036575 00000004:00080000:3.0:1713481296.549715:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076875500, transno 4296036576 00000004:00080000:3.0:1713481296.549718:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac9f80, transno 4296036579 00000004:00080000:3.0:1713481296.549720:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797fea00, transno 4296036580 00000004:00080000:3.0:1713481296.549722:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797fc380, transno 4296036581 00000004:00080000:3.0:1713481296.549725:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773c0a80, transno 4296036584 00000004:00080000:3.0:1713481296.549727:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077328000, transno 4296036589 00000004:00080000:3.0:1713481296.549730:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007732b800, transno 4296036590 00000004:00080000:3.0:1713481296.549733:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077328700, transno 4296036591 00000004:00080000:3.0:1713481296.549735:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077329880, transno 4296036593 00000004:00080000:3.0:1713481296.549738:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801350b6300, transno 4296036594 00000004:00080000:3.0:1713481296.549741:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078592a00, transno 4296036595 00000004:00080000:3.0:1713481296.549743:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012246f100, transno 4296036598 00000004:00080000:3.0:1713481296.549746:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078592d80, transno 4296036600 00000004:00080000:3.0:1713481296.549749:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b75c00, transno 4296036605 00000004:00080000:3.0:1713481296.549751:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c1880, transno 4296036606 00000004:00080000:3.0:1713481296.549753:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007852fb80, transno 4296036607 00000004:00080000:3.0:1713481296.549756:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e26a00, transno 4296036609 00000004:00080000:3.0:1713481296.549759:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754fdc00, transno 4296036610 00000004:00080000:3.0:1713481296.549762:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133aca680, transno 4296036611 00000004:00080000:3.0:1713481296.549764:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e55c00, transno 4296036613 00000004:00080000:3.0:1713481296.549767:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad0e00, transno 4296036614 00000004:00080000:3.0:1713481296.549769:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728c2680, transno 4296036621 00000004:00080000:3.0:1713481296.549772:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801b6d80, transno 4296036622 00000004:00080000:3.0:1713481296.549775:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801b6680, transno 4296036623 00000004:00080000:3.0:1713481296.549777:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e56300, transno 4296036625 00000004:00080000:3.0:1713481296.549780:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfac700, transno 4296036626 00000004:00080000:3.0:1713481296.549782:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfae300, transno 4296036627 00000004:00080000:3.0:1713481296.549785:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb3800, transno 4296036628 00000004:00080000:3.0:1713481296.549788:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb0e00, transno 4296036633 00000004:00080000:3.0:1713481296.549791:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120248a80, transno 4296036637 00000004:00080000:3.0:1713481296.549794:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881ae300, transno 4296036638 00000004:00080000:3.0:1713481296.549796:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800961c7480, transno 4296036639 00000004:00080000:3.0:1713481296.549799:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db88a80, transno 4296036641 00000004:00080000:3.0:1713481296.549801:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089882d80, transno 4296036642 00000004:00080000:3.0:1713481296.549804:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012246df80, transno 4296036643 00000004:00080000:3.0:1713481296.549806:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089880e00, transno 4296036645 00000004:00080000:3.0:1713481296.549809:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007720e300, transno 4296036648 00000004:00080000:3.0:1713481296.549812:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089462d80, transno 4296036653 00000004:00080000:3.0:1713481296.549815:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c9500, transno 4296036654 00000004:00080000:3.0:1713481296.549817:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be70380, transno 4296036655 00000004:00080000:3.0:1713481296.549820:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084971c00, transno 4296036658 00000004:00080000:3.0:1713481296.549823:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089881f80, transno 4296036660 00000004:00080000:3.0:1713481296.549825:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed90700, transno 4296036661 00000004:00080000:3.0:1713481296.549828:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fdbb80, transno 4296036663 00000004:00080000:3.0:1713481296.549830:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084971500, transno 4296036665 00000004:00080000:3.0:1713481296.549833:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089883800, transno 4296036667 00000004:00080000:3.0:1713481296.549835:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012246d180, transno 4296036669 00000004:00080000:3.0:1713481296.549838:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b2b480, transno 4296036671 00000004:00080000:3.0:1713481296.549841:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed39f80, transno 4296036674 00000004:00080000:3.0:1713481296.549843:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b7bb80, transno 4296036678 00000004:00080000:3.0:1713481296.549846:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773c2680, transno 4296036680 00000004:00080000:3.0:1713481296.549848:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078757480, transno 4296036681 00000004:00080000:3.0:1713481296.549851:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084823b80, transno 4296036683 00000004:00080000:3.0:1713481296.549854:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e3fb80, transno 4296036684 00000004:00080000:3.0:1713481296.549856:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007deb1f80, transno 4296036685 00000004:00080000:3.0:1713481296.549858:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d1c380, transno 4296036689 00000004:00080000:3.0:1713481296.549861:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ef87800, transno 4296036692 00000004:00080000:3.0:1713481296.549864:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009cac8a80, transno 4296036696 00000004:00080000:3.0:1713481296.549867:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009cacb100, transno 4296036697 00000004:00080000:3.0:1713481296.549869:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794fdf80, transno 4296036698 00000004:00080000:3.0:1713481296.549872:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009cacbb80, transno 4296036699 00000004:00080000:3.0:1713481296.549875:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f84e680, transno 4296036700 00000004:00080000:3.0:1713481296.549877:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009cacaa00, transno 4296036702 00000004:00080000:3.0:1713481296.549880:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078020000, transno 4296036706 00000004:00080000:3.0:1713481296.549882:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfad180, transno 4296036709 00000004:00080000:3.0:1713481296.549885:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f84c380, transno 4296036712 00000004:00080000:3.0:1713481296.549887:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801204db480, transno 4296036714 00000004:00080000:3.0:1713481296.549890:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088365880, transno 4296036715 00000004:00080000:3.0:1713481296.549892:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088364e00, transno 4296036717 00000004:00080000:3.0:1713481296.549895:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088367800, transno 4296036718 00000004:00080000:3.0:1713481296.549898:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b79180, transno 4296036720 00000004:00080000:3.0:1713481296.549900:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780edf80, transno 4296036724 00000004:00080000:3.0:1713481296.549902:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008022ed80, transno 4296036726 00000004:00080000:3.0:1713481296.549905:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b7b800, transno 4296036727 00000004:00080000:3.0:1713481296.549908:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081691f80, transno 4296036728 00000004:00080000:3.0:1713481296.549910:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081692d80, transno 4296036731 00000004:00080000:3.0:1713481296.549913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9df80, transno 4296036734 00000004:00080000:3.0:1713481296.549916:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007556f100, transno 4296036735 00000004:00080000:3.0:1713481296.549918:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9f800, transno 4296036736 00000004:00080000:3.0:1713481296.549921:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120a1d500, transno 4296036743 00000004:00080000:3.0:1713481296.549924:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008022df80, transno 4296036744 00000004:00080000:3.0:1713481296.549926:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ef85c00, transno 4296036745 00000004:00080000:3.0:1713481296.549929:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120a1ce00, transno 4296036747 00000004:00080000:3.0:1713481296.549931:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ef87100, transno 4296036748 00000004:00080000:3.0:1713481296.549934:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086943100, transno 4296036751 00000004:00080000:3.0:1713481296.549936:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299a680, transno 4296036752 00000004:00080000:3.0:1713481296.549939:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086941180, transno 4296036753 00000004:00080000:3.0:1713481296.549942:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de96d80, transno 4296036756 00000004:00080000:3.0:1713481296.549944:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098358e00, transno 4296036761 00000004:00080000:3.0:1713481296.549947:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007710b800, transno 4296036762 00000004:00080000:3.0:1713481296.549950:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9e680, transno 4296036763 00000004:00080000:3.0:1713481296.549953:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132018700, transno 4296036766 00000004:00080000:3.0:1713481296.549955:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008022ce00, transno 4296036767 00000004:00080000:3.0:1713481296.549958:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de96680, transno 4296036768 00000004:00080000:3.0:1713481296.549960:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9fb80, transno 4296036769 00000004:00080000:3.0:1713481296.549963:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120251500, transno 4296036773 00000004:00080000:3.0:1713481296.549966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5c700, transno 4296036776 00000004:00080000:3.0:1713481296.549969:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800928b8a80, transno 4296036781 00000004:00080000:3.0:1713481296.549972:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800928ba680, transno 4296036782 00000004:00080000:3.0:1713481296.549974:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfac000, transno 4296036783 00000004:00080000:3.0:1713481296.549977:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077962680, transno 4296036784 00000004:00080000:3.0:1713481296.549979:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092999c00, transno 4296036785 00000004:00080000:3.0:1713481296.549982:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120553100, transno 4296036786 00000004:00080000:3.0:1713481296.549984:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120553480, transno 4296036790 00000004:00080000:3.0:1713481296.549987:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd29880, transno 4296036792 00000004:00080000:3.0:1713481296.549989:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096d78000, transno 4296036797 00000004:00080000:3.0:1713481296.549992:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800802d8000, transno 4296036798 00000004:00080000:3.0:1713481296.549994:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800802db480, transno 4296036799 00000004:00080000:3.0:1713481296.549997:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800802d9c00, transno 4296036800 00000004:00080000:3.0:1713481296.550000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009782ce00, transno 4296036801 00000004:00080000:3.0:1713481296.550003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d099180, transno 4296036803 00000004:00080000:3.0:1713481296.550005:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d09a680, transno 4296036806 00000004:00080000:3.0:1713481296.550008:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779eb100, transno 4296036812 00000004:00080000:3.0:1713481296.550010:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779e8700, transno 4296036813 00000004:00080000:3.0:1713481296.550013:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779e8000, transno 4296036815 00000004:00080000:3.0:1713481296.550015:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d09a300, transno 4296036816 00000004:00080000:3.0:1713481296.550018:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096d7bb80, transno 4296036817 00000004:00080000:3.0:1713481296.550021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800993e8380, transno 4296036818 00000004:00080000:3.0:1713481296.550024:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078148a80, transno 4296036820 00000004:00080000:3.0:1713481296.550027:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132019c00, transno 4296036821 00000004:00080000:3.0:1713481296.550029:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a81f80, transno 4296036828 00000004:00080000:3.0:1713481296.550032:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800802d9500, transno 4296036830 00000004:00080000:3.0:1713481296.550034:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a82a00, transno 4296036831 00000004:00080000:3.0:1713481296.550037:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120135f80, transno 4296036832 00000004:00080000:3.0:1713481296.550039:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078149880, transno 4296036834 00000004:00080000:3.0:1713481296.550042:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cd1180, transno 4296036835 00000004:00080000:3.0:1713481296.550045:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121d8bb80, transno 4296036836 00000004:00080000:3.0:1713481296.550047:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009782f100, transno 4296036837 00000004:00080000:3.0:1713481296.550050:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768e9f80, transno 4296036842 00000004:00080000:3.0:1713481296.550052:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7e300, transno 4296036845 00000004:00080000:3.0:1713481296.550056:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077981180, transno 4296036846 00000004:00080000:3.0:1713481296.550058:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007abb9f80, transno 4296036847 00000004:00080000:3.0:1713481296.550061:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007abb8e00, transno 4296036848 00000004:00080000:3.0:1713481296.550064:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7df80, transno 4296036849 00000004:00080000:3.0:1713481296.550067:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768ea300, transno 4296036850 00000004:00080000:3.0:1713481296.550070:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768e8e00, transno 4296036851 00000004:00080000:3.0:1713481296.550072:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800802db800, transno 4296036857 00000004:00080000:3.0:1713481296.550076:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd4380, transno 4296036859 00000004:00080000:3.0:1713481296.550079:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dafc380, transno 4296036862 00000004:00080000:3.0:1713481296.550082:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cf8e00, transno 4296036863 00000004:00080000:3.0:1713481296.550085:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dafea00, transno 4296036864 00000004:00080000:3.0:1713481296.550087:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dafc700, transno 4296036865 00000004:00080000:3.0:1713481296.550090:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dafd180, transno 4296036866 00000004:00080000:3.0:1713481296.550092:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121d8a680, transno 4296036867 00000004:00080000:3.0:1713481296.550095:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e26df80, transno 4296036874 00000004:00080000:3.0:1713481296.550097:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800906d3800, transno 4296036876 00000004:00080000:3.0:1713481296.550100:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800906d0a80, transno 4296036878 00000004:00080000:3.0:1713481296.550103:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080267800, transno 4296036879 00000004:00080000:3.0:1713481296.550106:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b331c00, transno 4296036880 00000004:00080000:3.0:1713481296.550109:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800906d1880, transno 4296036881 00000004:00080000:3.0:1713481296.550111:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121d8aa00, transno 4296036882 00000004:00080000:3.0:1713481296.550114:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a82a00, transno 4296036883 00000004:00080000:3.0:1713481296.550117:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782fa680, transno 4296036884 00000004:00080000:3.0:1713481296.550138:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b2d880, transno 4296036893 00000004:00080000:3.0:1713481296.550141:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c02a00, transno 4296036894 00000004:00080000:3.0:1713481296.550144:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098c40a80, transno 4296036895 00000004:00080000:3.0:1713481296.550146:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd7e300, transno 4296036897 00000004:00080000:3.0:1713481296.550150:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782f9180, transno 4296036898 00000004:00080000:3.0:1713481296.550152:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098c42300, transno 4296036899 00000004:00080000:3.0:1713481296.550155:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768e8380, transno 4296036900 00000004:00080000:3.0:1713481296.550157:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ddc6a00, transno 4296036901 00000004:00080000:3.0:1713481296.550160:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b2e300, transno 4296036905 00000004:00080000:3.0:1713481296.550163:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e067800, transno 4296036909 00000004:00080000:3.0:1713481296.550165:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd4700, transno 4296036910 00000004:00080000:3.0:1713481296.550168:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072afe680, transno 4296036912 00000004:00080000:3.0:1713481296.550171:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072aeb100, transno 4296036914 00000004:00080000:3.0:1713481296.550173:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098c41c00, transno 4296036915 00000004:00080000:3.0:1713481296.550176:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823c4700, transno 4296036916 00000004:00080000:3.0:1713481296.550179:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c02680, transno 4296036917 00000004:00080000:3.0:1713481296.550181:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e065f80, transno 4296036920 00000004:00080000:3.0:1713481296.550184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800820b9f80, transno 4296036921 00000004:00080000:3.0:1713481296.550187:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a5180, transno 4296036927 00000004:00080000:3.0:1713481296.550189:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072aeaa00, transno 4296036928 00000004:00080000:3.0:1713481296.550192:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ae9880, transno 4296036930 00000004:00080000:3.0:1713481296.550195:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ae8380, transno 4296036931 00000004:00080000:3.0:1713481296.550197:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078192300, transno 4296036932 00000004:00080000:3.0:1713481296.550200:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a8c700, transno 4296036935 00000004:00080000:3.0:1713481296.550204:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092916a00, transno 4296036936 00000004:00080000:3.0:1713481296.550207:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ab4380, transno 4296036937 00000004:00080000:3.0:1713481296.550209:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd5180, transno 4296036939 00000004:00080000:3.0:1713481296.550212:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e348a80, transno 4296036940 00000004:00080000:3.0:1713481296.550215:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120471180, transno 4296036945 00000004:00080000:3.0:1713481296.550217:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b23480, transno 4296036948 00000004:00080000:3.0:1713481296.550219:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b22680, transno 4296036949 00000004:00080000:3.0:1713481296.550222:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d09b480, transno 4296036951 00000004:00080000:3.0:1713481296.550224:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c9ad80, transno 4296036952 00000004:00080000:3.0:1713481296.550227:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c05500, transno 4296036953 00000004:00080000:3.0:1713481296.550229:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c06d80, transno 4296036954 00000004:00080000:3.0:1713481296.550232:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092214e00, transno 4296036955 00000004:00080000:3.0:1713481296.550234:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d099880, transno 4296036956 00000004:00080000:3.0:1713481296.550237:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fb1dc00, transno 4296036963 00000004:00080000:3.0:1713481296.550239:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076bd5c00, transno 4296036964 00000004:00080000:3.0:1713481296.550242:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c50dc00, transno 4296036966 00000004:00080000:3.0:1713481296.550244:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c50ce00, transno 4296036967 00000004:00080000:3.0:1713481296.550247:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c99180, transno 4296036968 00000004:00080000:3.0:1713481296.550250:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092915500, transno 4296036969 00000004:00080000:3.0:1713481296.550252:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082115f80, transno 4296036971 00000004:00080000:3.0:1713481296.550255:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082117800, transno 4296036973 00000004:00080000:3.0:1713481296.550258:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079709500, transno 4296036976 00000004:00080000:3.0:1713481296.550261:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079709f80, transno 4296036981 00000004:00080000:3.0:1713481296.550263:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c50e300, transno 4296036982 00000004:00080000:3.0:1713481296.550266:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c50df80, transno 4296036983 00000004:00080000:3.0:1713481296.550268:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079708e00, transno 4296036984 00000004:00080000:3.0:1713481296.550271:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079708000, transno 4296036986 00000004:00080000:3.0:1713481296.550273:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a4a80, transno 4296036988 00000004:00080000:3.0:1713481296.550276:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d1be300, transno 4296036991 00000004:00080000:3.0:1713481296.550278:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a4e00, transno 4296036993 00000004:00080000:3.0:1713481296.550281:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b332a00, transno 4296036996 00000004:00080000:3.0:1713481296.550283:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085c69c00, transno 4296036997 00000004:00080000:3.0:1713481296.550286:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b330a80, transno 4296037000 00000004:00080000:3.0:1713481296.550288:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080265180, transno 4296037002 00000004:00080000:3.0:1713481296.550291:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b46d80, transno 4296037004 00000004:00080000:3.0:1713481296.550293:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a5500, transno 4296037005 00000004:00080000:3.0:1713481296.550295:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cd1f80, transno 4296037006 00000004:00080000:3.0:1713481296.550298:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077982680, transno 4296037012 00000004:00080000:3.0:1713481296.550301:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090455180, transno 4296037015 00000004:00080000:3.0:1713481296.550303:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080266d80, transno 4296037018 00000004:00080000:3.0:1713481296.550306:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090455f80, transno 4296037020 00000004:00080000:3.0:1713481296.550309:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783c9180, transno 4296037027 00000004:00080000:3.0:1713481296.550311:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007970aa00, transno 4296037030 00000004:00080000:3.0:1713481296.550314:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007970a680, transno 4296037032 00000004:00080000:3.0:1713481296.550317:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077980700, transno 4296037034 00000004:00080000:3.0:1713481296.550319:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120472680, transno 4296037035 00000004:00080000:3.0:1713481296.550321:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090454380, transno 4296037036 00000004:00080000:3.0:1713481296.550323:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780d9180, transno 4296037038 00000004:00080000:3.0:1713481296.550326:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085c69f80, transno 4296037044 00000004:00080000:3.0:1713481296.550329:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754f8000, transno 4296037046 00000004:00080000:3.0:1713481296.550332:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fb1f800, transno 4296037047 00000004:00080000:3.0:1713481296.550334:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d285f80, transno 4296037049 00000004:00080000:3.0:1713481296.550337:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135906680, transno 4296037050 00000004:00080000:3.0:1713481296.550340:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b333480, transno 4296037051 00000004:00080000:3.0:1713481296.550342:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d286a00, transno 4296037053 00000004:00080000:3.0:1713481296.550344:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084875c00, transno 4296037067 00000004:00080000:3.0:1713481296.550347:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084876a00, transno 4296037068 00000004:00080000:3.0:1713481296.550349:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e93100, transno 4296037070 00000004:00080000:3.0:1713481296.550352:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fb1c380, transno 4296037071 00000004:00080000:3.0:1713481296.550355:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99b800, transno 4296037078 00000004:00080000:3.0:1713481296.550358:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99ad80, transno 4296037081 00000004:00080000:3.0:1713481296.550361:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f998a80, transno 4296037086 00000004:00080000:3.0:1713481296.550363:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130433480, transno 4296037105 00000004:00080000:3.0:1713481296.550366:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780d8700, transno 4296037127 00000004:00080000:3.0:1713481296.550369:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c895c00, transno 4296037130 00000004:00080000:3.0:1713481296.550371:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007809f800, transno 4296037132 00000004:00080000:3.0:1713481296.550374:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077afdc00, transno 4296037139 00000004:00080000:3.0:1713481296.550377:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728d6d80, transno 4296037142 00000004:00080000:3.0:1713481296.550380:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728d6680, transno 4296037143 00000004:00080000:3.0:1713481296.550382:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130432680, transno 4296037151 00000004:00080000:3.0:1713481296.550385:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072845c00, transno 4296037152 00000004:00080000:3.0:1713481296.550388:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130432a00, transno 4296037181 00000004:00080000:3.0:1713481296.550390:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078699f80, transno 4296037187 00000004:00080000:3.0:1713481296.550393:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ae1180, transno 4296037188 00000004:00080000:3.0:1713481296.550396:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083332a00, transno 4296037219 00000004:00080000:3.0:1713481296.550399:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781c2a00, transno 4296037226 00000004:00080000:3.0:1713481296.550401:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781c3800, transno 4296037232 00000004:00080000:3.0:1713481296.550403:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083330e00, transno 4296037238 00000004:00080000:3.0:1713481296.550406:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083333b80, transno 4296037244 00000004:00080000:3.0:1713481296.550409:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a66300, transno 4296037252 00000004:00080000:3.0:1713481296.550412:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921d3100, transno 4296037253 00000004:00080000:3.0:1713481296.550414:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921b9880, transno 4296037254 00000004:00080000:3.0:1713481296.550417:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008da73480, transno 4296037292 00000004:00080000:3.0:1713481296.550420:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c894a80, transno 4296037293 00000004:00080000:3.0:1713481296.550423:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008158c700, transno 4296037294 00000004:00080000:3.0:1713481296.550425:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008158d880, transno 4296037296 00000004:00080000:3.0:1713481296.550427:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008158f480, transno 4296037301 00000004:00080000:3.0:1713481296.550430:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079976300, transno 4296037311 00000004:00080000:3.0:1713481296.550432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079974380, transno 4296037316 00000004:00080000:3.0:1713481296.550435:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077ab4e00, transno 4296037319 00000004:00080000:3.0:1713481296.550438:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097715f80, transno 4296037321 00000004:00080000:3.0:1713481296.550441:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097715500, transno 4296037322 00000004:00080000:3.0:1713481296.550443:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096277480, transno 4296037323 00000004:00080000:3.0:1713481296.550446:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918c7b80, transno 4296037324 00000004:00080000:3.0:1713481296.550448:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082281500, transno 4296037325 00000004:00080000:3.0:1713481296.550450:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120758e00, transno 4296037326 00000004:00080000:3.0:1713481296.550453:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a71f80, transno 4296037327 00000004:00080000:3.0:1713481296.550456:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a70a80, transno 4296037328 00000004:00080000:3.0:1713481296.550459:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012075b480, transno 4296037329 00000004:00080000:3.0:1713481296.550462:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097655f80, transno 4296037330 00000004:00080000:3.0:1713481296.550464:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078183480, transno 4296037331 00000004:00080000:3.0:1713481296.550467:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918c7800, transno 4296037332 00000004:00080000:3.0:1713481296.550469:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078183800, transno 4296037333 00000004:00080000:3.0:1713481296.550471:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918c5500, transno 4296037334 00000004:00080000:3.0:1713481296.550474:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da26680, transno 4296037335 00000004:00080000:3.0:1713481296.550476:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120473b80, transno 4296037336 00000004:00080000:3.0:1713481296.550478:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609ca80, transno 4296037337 00000004:00080000:3.0:1713481296.550481:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da26300, transno 4296037338 00000004:00080000:3.0:1713481296.550484:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e229c00, transno 4296037339 00000004:00080000:3.0:1713481296.550486:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da26a00, transno 4296037340 00000004:00080000:3.0:1713481296.550489:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e58700, transno 4296037341 00000004:00080000:3.0:1713481296.550491:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5aa00, transno 4296037342 00000004:00080000:3.0:1713481296.550494:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5ad80, transno 4296037343 00000004:00080000:3.0:1713481296.550496:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b19ad80, transno 4296037344 00000004:00080000:3.0:1713481296.550499:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097e43800, transno 4296037345 00000004:00080000:3.0:1713481296.550501:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078180380, transno 4296037346 00000004:00080000:3.0:1713481296.550504:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078180a80, transno 4296037347 00000004:00080000:3.0:1713481296.550507:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fb1df80, transno 4296037348 00000004:00080000:3.0:1713481296.550509:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079977800, transno 4296037349 00000004:00080000:3.0:1713481296.550511:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b19b480, transno 4296037350 00000004:00080000:3.0:1713481296.550515:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17d500, transno 4296037351 00000004:00080000:3.0:1713481296.550517:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17f480, transno 4296037352 00000004:00080000:3.0:1713481296.550520:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce5880, transno 4296037353 00000004:00080000:3.0:1713481296.550522:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17e680, transno 4296037354 00000004:00080000:3.0:1713481296.550525:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17ca80, transno 4296037355 00000004:00080000:3.0:1713481296.550527:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077ab7100, transno 4296037356 00000004:00080000:3.0:1713481296.550529:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077ab4700, transno 4296037357 00000004:00080000:3.0:1713481296.550532:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008481ed80, transno 4296037358 00000004:00080000:3.0:1713481296.550534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120093b80, transno 4296037359 00000004:00080000:3.0:1713481296.550537:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ef800, transno 4296037360 00000004:00080000:3.0:1713481296.550540:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17ed80, transno 4296037361 00000004:00080000:3.0:1713481296.550543:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a9aa00, transno 4296037362 00000004:00080000:3.0:1713481296.550545:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728eea00, transno 4296037363 00000004:00080000:3.0:1713481296.550548:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ee680, transno 4296037364 00000004:00080000:3.0:1713481296.550551:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a230380, transno 4296037365 00000004:00080000:3.0:1713481296.550553:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136375180, transno 4296037366 00000004:00080000:3.0:1713481296.550556:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007721ea00, transno 4296037367 00000004:00080000:3.0:1713481296.550558:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b42300, transno 4296037368 00000004:00080000:3.0:1713481296.550561:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124d45500, transno 4296037369 00000004:00080000:3.0:1713481296.550564:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1b4a80, transno 4296037370 00000004:00080000:3.0:1713481296.550567:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007721ca80, transno 4296037371 00000004:00080000:3.0:1713481296.550570:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17df80, transno 4296037372 00000004:00080000:3.0:1713481296.550573:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136376a00, transno 4296037373 00000004:00080000:3.0:1713481296.550575:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec42680, transno 4296037374 00000004:00080000:3.0:1713481296.550578:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e17ce00, transno 4296037375 00000004:00080000:3.0:1713481296.550581:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120091c00, transno 4296037376 00000004:00080000:3.0:1713481296.550583:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076869880, transno 4296037377 00000004:00080000:3.0:1713481296.550586:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801207b1c00, transno 4296037378 00000004:00080000:3.0:1713481296.550589:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801207b2d80, transno 4296037379 00000004:00080000:3.0:1713481296.550591:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077015880, transno 4296037380 00000004:00080000:3.0:1713481296.550594:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801207b1880, transno 4296037381 00000004:00080000:3.0:1713481296.550597:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956e300, transno 4296037382 00000004:00080000:3.0:1713481296.550600:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686a680, transno 4296037383 00000004:00080000:3.0:1713481296.550602:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007686a300, transno 4296037384 00000004:00080000:3.0:1713481296.550605:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ab76a00, transno 4296037386 00000004:00080000:3.0:1713481296.550608:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e32df80, transno 4296037387 00000004:00080000:3.0:1713481296.550610:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9e300, transno 4296037388 00000004:00080000:3.0:1713481296.550613:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956f480, transno 4296037389 00000004:00080000:3.0:1713481296.550615:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332ce00, transno 4296037390 00000004:00080000:3.0:1713481296.550618:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332c700, transno 4296037391 00000004:00080000:3.0:1713481296.550620:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332fb80, transno 4296037392 00000004:00080000:3.0:1713481296.550622:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332dc00, transno 4296037393 00000004:00080000:3.0:1713481296.550625:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e726300, transno 4296037394 00000004:00080000:3.0:1713481296.550627:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121dd4a80, transno 4296037395 00000004:00080000:3.0:1713481296.550630:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a1880, transno 4296037396 00000004:00080000:3.0:1713481296.550632:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008332d180, transno 4296037397 00000004:00080000:3.0:1713481296.550635:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a0e00, transno 4296037398 00000004:00080000:3.0:1713481296.550637:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821fb80, transno 4296037399 00000004:00080000:3.0:1713481296.550640:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013224aa00, transno 4296037400 00000004:00080000:3.0:1713481296.550643:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132249880, transno 4296037401 00000004:00080000:3.0:1713481296.550646:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a2a00, transno 4296037402 00000004:00080000:3.0:1713481296.550649:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a96680, transno 4296037403 00000004:00080000:3.0:1713481296.550651:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883e8700, transno 4296037404 00000004:00080000:3.0:1713481296.550654:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883e9180, transno 4296037405 00000004:00080000:3.0:1713481296.550657:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e52680, transno 4296037406 00000004:00080000:3.0:1713481296.550660:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921b9f80, transno 4296037407 00000004:00080000:3.0:1713481296.550663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f4000, transno 4296037408 00000004:00080000:3.0:1713481296.550680:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e52d80, transno 4296037409 00000004:00080000:3.0:1713481296.550683:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883ead80, transno 4296037410 00000004:00080000:3.0:1713481296.550686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a1c00, transno 4296037411 00000004:00080000:3.0:1713481296.550689:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076868380, transno 4296037412 00000004:00080000:3.0:1713481296.550692:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013224b480, transno 4296037413 00000004:00080000:3.0:1713481296.550694:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ab77480, transno 4296037414 00000004:00080000:3.0:1713481296.550697:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007731d180, transno 4296037415 00000004:00080000:3.0:1713481296.550701:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a54f800, transno 4296037416 00000004:00080000:3.0:1713481296.550703:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a89500, transno 4296037417 00000004:00080000:3.0:1713481296.550705:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a8ad80, transno 4296037418 00000004:00080000:3.0:1713481296.550708:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013499c000, transno 4296037419 00000004:00080000:3.0:1713481296.550710:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a2680, transno 4296037420 00000004:00080000:3.0:1713481296.550713:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135baf480, transno 4296037421 00000004:00080000:3.0:1713481296.550715:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e68380, transno 4296037422 00000004:00080000:3.0:1713481296.550718:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084303800, transno 4296037423 00000004:00080000:3.0:1713481296.550720:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e69500, transno 4296037424 00000004:00080000:3.0:1713481296.550723:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b3dd880, transno 4296037425 00000004:00080000:3.0:1713481296.550725:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b3df480, transno 4296037426 00000004:00080000:3.0:1713481296.550727:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a2d80, transno 4296037427 00000004:00080000:3.0:1713481296.550730:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d82d80, transno 4296037428 00000004:00080000:3.0:1713481296.550733:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800772f7800, transno 4296037429 00000004:00080000:3.0:1713481296.550735:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008223ea00, transno 4296037430 00000004:00080000:3.0:1713481296.550738:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078545180, transno 4296037432 00000004:00080000:3.0:1713481296.550740:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078546300, transno 4296037433 00000004:00080000:3.0:1713481296.550742:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d80380, transno 4296037434 00000004:00080000:3.0:1713481296.550745:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078547480, transno 4296037435 00000004:00080000:3.0:1713481296.550748:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094119f80, transno 4296037436 00000004:00080000:3.0:1713481296.550751:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e5880, transno 4296037437 00000004:00080000:3.0:1713481296.550754:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e7480, transno 4296037438 00000004:00080000:3.0:1713481296.550756:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e5c00, transno 4296037439 00000004:00080000:3.0:1713481296.550759:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e4a80, transno 4296037440 00000004:00080000:3.0:1713481296.550761:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e4380, transno 4296037441 00000004:00080000:3.0:1713481296.550763:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcdb480, transno 4296037442 00000004:00080000:3.0:1713481296.550766:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077129180, transno 4296037443 00000004:00080000:3.0:1713481296.550768:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5ce00, transno 4296037444 00000004:00080000:3.0:1713481296.550771:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007712a300, transno 4296037445 00000004:00080000:3.0:1713481296.550774:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b41c00, transno 4296037446 00000004:00080000:3.0:1713481296.550776:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007712b800, transno 4296037447 00000004:00080000:3.0:1713481296.550779:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a003b80, transno 4296037448 00000004:00080000:3.0:1713481296.550781:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085e07b80, transno 4296037449 00000004:00080000:3.0:1713481296.550784:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a860000, transno 4296037450 00000004:00080000:3.0:1713481296.550786:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ab3f480, transno 4296037451 00000004:00080000:3.0:1713481296.550789:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1ebb80, transno 4296037452 00000004:00080000:3.0:1713481296.550791:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a860e00, transno 4296037453 00000004:00080000:3.0:1713481296.550794:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cfd0000, transno 4296037454 00000004:00080000:3.0:1713481296.550796:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d159180, transno 4296037455 00000004:00080000:3.0:1713481296.550799:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800967cc700, transno 4296037456 00000004:00080000:3.0:1713481296.550801:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec6c380, transno 4296037457 00000004:00080000:3.0:1713481296.550804:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a68a80, transno 4296037458 00000004:00080000:3.0:1713481296.550806:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076821180, transno 4296037460 00000004:00080000:3.0:1713481296.550809:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883b9500, transno 4296037461 00000004:00080000:3.0:1713481296.550811:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8abb80, transno 4296037463 00000004:00080000:3.0:1713481296.550814:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e3ff100, transno 4296037464 00000004:00080000:3.0:1713481296.550816:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3ead80, transno 4296037465 00000004:00080000:3.0:1713481296.550819:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ab3c380, transno 4296037466 00000004:00080000:3.0:1713481296.550822:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800868cdf80, transno 4296037467 00000004:00080000:3.0:1713481296.550825:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8ab800, transno 4296037468 00000004:00080000:3.0:1713481296.550827:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072af0000, transno 4296037469 00000004:00080000:3.0:1713481296.550830:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072af0700, transno 4296037470 00000004:00080000:3.0:1713481296.550832:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083795880, transno 4296037471 00000004:00080000:3.0:1713481296.550835:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cfd2a00, transno 4296037472 00000004:00080000:3.0:1713481296.550837:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d1bb80, transno 4296037473 00000004:00080000:3.0:1713481296.550840:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122bac700, transno 4296037474 00000004:00080000:3.0:1713481296.550843:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122baea00, transno 4296037475 00000004:00080000:3.0:1713481296.550845:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009182aa00, transno 4296037476 00000004:00080000:3.0:1713481296.550848:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091828380, transno 4296037477 00000004:00080000:3.0:1713481296.550850:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941d0a80, transno 4296037478 00000004:00080000:3.0:1713481296.550853:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f89c000, transno 4296037479 00000004:00080000:3.0:1713481296.550856:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829fb80, transno 4296037480 00000004:00080000:3.0:1713481296.550858:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083149180, transno 4296037481 00000004:00080000:3.0:1713481296.550861:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079567800, transno 4296037482 00000004:00080000:3.0:1713481296.550864:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009194aa00, transno 4296037483 00000004:00080000:3.0:1713481296.550866:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079566680, transno 4296037484 00000004:00080000:3.0:1713481296.550869:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079566300, transno 4296037485 00000004:00080000:3.0:1713481296.550871:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9aed80, transno 4296037486 00000004:00080000:3.0:1713481296.550874:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008314b800, transno 4296037487 00000004:00080000:3.0:1713481296.550876:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3ce00, transno 4296037488 00000004:00080000:3.0:1713481296.550879:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007946ed80, transno 4296037489 00000004:00080000:3.0:1713481296.550881:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea4e00, transno 4296037490 00000004:00080000:3.0:1713481296.550883:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea5c00, transno 4296037491 00000004:00080000:3.0:1713481296.550886:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea7100, transno 4296037492 00000004:00080000:3.0:1713481296.550888:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea6a00, transno 4296037493 00000004:00080000:3.0:1713481296.550891:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af71f80, transno 4296037494 00000004:00080000:3.0:1713481296.550893:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898a4e00, transno 4296037495 00000004:00080000:3.0:1713481296.550896:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130435f80, transno 4296037496 00000004:00080000:3.0:1713481296.550899:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898a6d80, transno 4296037497 00000004:00080000:3.0:1713481296.550902:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898a6300, transno 4296037498 00000004:00080000:3.0:1713481296.550904:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898a5f80, transno 4296037499 00000004:00080000:3.0:1713481296.550907:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007288c700, transno 4296037500 00000004:00080000:3.0:1713481296.550909:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007288f800, transno 4296037501 00000004:00080000:3.0:1713481296.550912:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007288ce00, transno 4296037502 00000004:00080000:3.0:1713481296.550914:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007288c000, transno 4296037503 00000004:00080000:3.0:1713481296.550916:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3d9500, transno 4296037504 00000004:00080000:3.0:1713481296.550919:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0b8380, transno 4296037505 00000004:00080000:3.0:1713481296.550922:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007845f800, transno 4296037506 00000004:00080000:3.0:1713481296.550925:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091948700, transno 4296037507 00000004:00080000:3.0:1713481296.550927:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091955f80, transno 4296037508 00000004:00080000:3.0:1713481296.550930:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3d9880, transno 4296037509 00000004:00080000:3.0:1713481296.550932:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009194b100, transno 4296037510 00000004:00080000:3.0:1713481296.550934:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d95c00, transno 4296037511 00000004:00080000:3.0:1713481296.550937:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d95180, transno 4296037512 00000004:00080000:3.0:1713481296.550939:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120226a00, transno 4296037514 00000004:00080000:3.0:1713481296.550941:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120225500, transno 4296037515 00000004:00080000:3.0:1713481296.550944:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e131c00, transno 4296037516 00000004:00080000:3.0:1713481296.550946:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ea7800, transno 4296037517 00000004:00080000:3.0:1713481296.550948:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077325f80, transno 4296037518 00000004:00080000:3.0:1713481296.550950:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e795c00, transno 4296037519 00000004:00080000:3.0:1713481296.550953:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec52680, transno 4296037520 00000004:00080000:3.0:1713481296.550955:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec51880, transno 4296037521 00000004:00080000:3.0:1713481296.550957:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081dc4e00, transno 4296037522 00000004:00080000:3.0:1713481296.550960:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec53800, transno 4296037523 00000004:00080000:3.0:1713481296.550962:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e305180, transno 4296037524 00000004:00080000:3.0:1713481296.550964:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec51c00, transno 4296037525 00000004:00080000:3.0:1713481296.550967:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081dc5f80, transno 4296037526 00000004:00080000:3.0:1713481296.550970:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079941c00, transno 4296037527 00000004:00080000:3.0:1713481296.550973:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132f5ce00, transno 4296037528 00000004:00080000:3.0:1713481296.550975:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096761f80, transno 4296037529 00000004:00080000:3.0:1713481296.550977:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096763480, transno 4296037530 00000004:00080000:3.0:1713481296.550980:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096760a80, transno 4296037531 00000004:00080000:3.0:1713481296.550982:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b83a300, transno 4296037532 00000004:00080000:3.0:1713481296.550984:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096762300, transno 4296037533 00000004:00080000:3.0:1713481296.550986:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081dc6300, transno 4296037534 00000004:00080000:3.0:1713481296.550988:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b83b480, transno 4296037535 00000004:00080000:3.0:1713481296.550992:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cdd500, transno 4296037536 00000004:00080000:3.0:1713481296.550995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007867d180, transno 4296037537 00000004:00080000:3.0:1713481296.550998:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af1ca80, transno 4296037538 00000004:00080000:3.0:1713481296.551000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b838380, transno 4296037539 00000004:00080000:3.0:1713481296.551003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af1d500, transno 4296037540 00000004:00080000:3.0:1713481296.551005:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a95c00, transno 4296037541 00000004:00080000:3.0:1713481296.551008:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a94000, transno 4296037542 00000004:00080000:3.0:1713481296.551010:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a91f80, transno 4296037543 00000004:00080000:3.0:1713481296.551013:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a91500, transno 4296037544 00000004:00080000:3.0:1713481296.551016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa6300, transno 4296037545 00000004:00080000:3.0:1713481296.551018:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1da300, transno 4296037546 00000004:00080000:3.0:1713481296.551021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962b7100, transno 4296037547 00000004:00080000:3.0:1713481296.551024:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078659f80, transno 4296037548 00000004:00080000:3.0:1713481296.551026:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb3100, transno 4296037549 00000004:00080000:3.0:1713481296.551029:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb2a00, transno 4296037550 00000004:00080000:3.0:1713481296.551031:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa7480, transno 4296037551 00000004:00080000:3.0:1713481296.551034:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078659c00, transno 4296037552 00000004:00080000:3.0:1713481296.551037:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb3b80, transno 4296037553 00000004:00080000:3.0:1713481296.551040:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f91ea00, transno 4296037554 00000004:00080000:3.0:1713481296.551042:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f91dc00, transno 4296037555 00000004:00080000:3.0:1713481296.551044:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cdc000, transno 4296037556 00000004:00080000:3.0:1713481296.551047:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4df80, transno 4296037557 00000004:00080000:3.0:1713481296.551050:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796e0a80, transno 4296037558 00000004:00080000:3.0:1713481296.551052:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007738b800, transno 4296037559 00000004:00080000:3.0:1713481296.551054:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007738ad80, transno 4296037560 00000004:00080000:3.0:1713481296.551057:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a5ad80, transno 4296037561 00000004:00080000:3.0:1713481296.551059:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b361500, transno 4296037562 00000004:00080000:3.0:1713481296.551062:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b363b80, transno 4296037563 00000004:00080000:3.0:1713481296.551064:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b361f80, transno 4296037564 00000004:00080000:3.0:1713481296.551067:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a58e00, transno 4296037565 00000004:00080000:3.0:1713481296.551070:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b83aa00, transno 4296037566 00000004:00080000:3.0:1713481296.551073:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b838a80, transno 4296037567 00000004:00080000:3.0:1713481296.551076:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a58380, transno 4296037568 00000004:00080000:3.0:1713481296.551079:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b360700, transno 4296037569 00000004:00080000:3.0:1713481296.551081:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078616680, transno 4296037570 00000004:00080000:3.0:1713481296.551084:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d34a80, transno 4296037571 00000004:00080000:3.0:1713481296.551086:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe69880, transno 4296037572 00000004:00080000:3.0:1713481296.551089:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008168e680, transno 4296037573 00000004:00080000:3.0:1713481296.551091:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009232b800, transno 4296037574 00000004:00080000:3.0:1713481296.551093:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091c1f480, transno 4296037575 00000004:00080000:3.0:1713481296.551096:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe6ad80, transno 4296037576 00000004:00080000:3.0:1713481296.551098:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837ad880, transno 4296037577 00000004:00080000:3.0:1713481296.551101:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077311500, transno 4296037578 00000004:00080000:3.0:1713481296.551103:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a832a00, transno 4296037579 00000004:00080000:3.0:1713481296.551106:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a239880, transno 4296037580 00000004:00080000:3.0:1713481296.551108:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007867f480, transno 4296037581 00000004:00080000:3.0:1713481296.551111:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bdf80, transno 4296037582 00000004:00080000:3.0:1713481296.551113:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bf100, transno 4296037583 00000004:00080000:3.0:1713481296.551115:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135caea00, transno 4296037584 00000004:00080000:3.0:1713481296.551134:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a832680, transno 4296037585 00000004:00080000:3.0:1713481296.551137:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801200a7480, transno 4296037586 00000004:00080000:3.0:1713481296.551140:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007decd880, transno 4296037587 00000004:00080000:3.0:1713481296.551143:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b0c000, transno 4296037588 00000004:00080000:3.0:1713481296.551146:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881b3b80, transno 4296037589 00000004:00080000:3.0:1713481296.551149:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c5f80, transno 4296037590 00000004:00080000:3.0:1713481296.551151:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b0dc00, transno 4296037591 00000004:00080000:3.0:1713481296.551154:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a2668700, transno 4296037592 00000004:00080000:3.0:1713481296.551157:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773d1500, transno 4296037593 00000004:00080000:3.0:1713481296.551159:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bea00, transno 4296037594 00000004:00080000:3.0:1713481296.551162:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a04e680, transno 4296037595 00000004:00080000:3.0:1713481296.551165:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a04f800, transno 4296037596 00000004:00080000:3.0:1713481296.551168:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783cca80, transno 4296037597 00000004:00080000:3.0:1713481296.551170:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e158700, transno 4296037598 00000004:00080000:3.0:1713481296.551173:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a04ce00, transno 4296037599 00000004:00080000:3.0:1713481296.551175:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120244380, transno 4296037600 00000004:00080000:3.0:1713481296.551178:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a266ad80, transno 4296037601 00000004:00080000:3.0:1713481296.551180:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e159c00, transno 4296037602 00000004:00080000:3.0:1713481296.551182:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd68700, transno 4296037603 00000004:00080000:3.0:1713481296.551185:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f941180, transno 4296037604 00000004:00080000:3.0:1713481296.551187:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f943b80, transno 4296037605 00000004:00080000:3.0:1713481296.551189:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed85500, transno 4296037606 00000004:00080000:3.0:1713481296.551192:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed85880, transno 4296037607 00000004:00080000:3.0:1713481296.551194:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a909f80, transno 4296037609 00000004:00080000:3.0:1713481296.551196:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a266bb80, transno 4296037610 00000004:00080000:3.0:1713481296.551199:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b0d180, transno 4296037611 00000004:00080000:3.0:1713481296.551201:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009406b100, transno 4296037612 00000004:00080000:3.0:1713481296.551203:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009406b800, transno 4296037613 00000004:00080000:3.0:1713481296.551206:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008493aa00, transno 4296037614 00000004:00080000:3.0:1713481296.551208:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092328a80, transno 4296037615 00000004:00080000:3.0:1713481296.551211:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094069180, transno 4296037616 00000004:00080000:3.0:1713481296.551213:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bd2a00, transno 4296037617 00000004:00080000:3.0:1713481296.551216:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bd0a80, transno 4296037618 00000004:00080000:3.0:1713481296.551218:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e159f80, transno 4296037619 00000004:00080000:3.0:1713481296.551221:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094069500, transno 4296037620 00000004:00080000:3.0:1713481296.551223:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cd7b80, transno 4296037621 00000004:00080000:3.0:1713481296.551226:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ea8e00, transno 4296037622 00000004:00080000:3.0:1713481296.551228:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e158e00, transno 4296037623 00000004:00080000:3.0:1713481296.551231:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1d880, transno 4296037624 00000004:00080000:3.0:1713481296.551233:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e15b480, transno 4296037625 00000004:00080000:3.0:1713481296.551235:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e3480, transno 4296037626 00000004:00080000:3.0:1713481296.551238:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a17ce00, transno 4296037627 00000004:00080000:3.0:1713481296.551241:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083811180, transno 4296037628 00000004:00080000:3.0:1713481296.551243:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083810700, transno 4296037629 00000004:00080000:3.0:1713481296.551246:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083813480, transno 4296037630 00000004:00080000:3.0:1713481296.551249:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012098d180, transno 4296037631 00000004:00080000:3.0:1713481296.551251:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be2d80, transno 4296037632 00000004:00080000:3.0:1713481296.551254:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e9dc00, transno 4296037633 00000004:00080000:3.0:1713481296.551256:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1df80, transno 4296037634 00000004:00080000:3.0:1713481296.551259:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0f1180, transno 4296037635 00000004:00080000:3.0:1713481296.551261:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e9f480, transno 4296037636 00000004:00080000:3.0:1713481296.551264:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ab6a00, transno 4296037637 00000004:00080000:3.0:1713481296.551267:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1c380, transno 4296037638 00000004:00080000:3.0:1713481296.551270:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af5500, transno 4296037639 00000004:00080000:3.0:1713481296.551272:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1e680, transno 4296037640 00000004:00080000:3.0:1713481296.551275:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be1880, transno 4296037642 00000004:00080000:3.0:1713481296.551277:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a17f100, transno 4296037643 00000004:00080000:3.0:1713481296.551280:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af4700, transno 4296037644 00000004:00080000:3.0:1713481296.551282:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df49180, transno 4296037645 00000004:00080000:3.0:1713481296.551285:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1d500, transno 4296037646 00000004:00080000:3.0:1713481296.551287:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0f3100, transno 4296037647 00000004:00080000:3.0:1713481296.551290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a33e300, transno 4296037648 00000004:00080000:3.0:1713481296.551293:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0f0380, transno 4296037649 00000004:00080000:3.0:1713481296.551296:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de9b800, transno 4296037650 00000004:00080000:3.0:1713481296.551299:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078590a80, transno 4296037651 00000004:00080000:3.0:1713481296.551302:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620e300, transno 4296037652 00000004:00080000:3.0:1713481296.551304:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078610e00, transno 4296037653 00000004:00080000:3.0:1713481296.551307:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781cc380, transno 4296037654 00000004:00080000:3.0:1713481296.551310:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f053100, transno 4296037655 00000004:00080000:3.0:1713481296.551313:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b839c00, transno 4296037656 00000004:00080000:3.0:1713481296.551315:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994c000, transno 4296037657 00000004:00080000:3.0:1713481296.551318:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120aa5880, transno 4296037658 00000004:00080000:3.0:1713481296.551321:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e56680, transno 4296037659 00000004:00080000:3.0:1713481296.551324:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f053480, transno 4296037660 00000004:00080000:3.0:1713481296.551327:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076874380, transno 4296037661 00000004:00080000:3.0:1713481296.551329:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a1ca80, transno 4296037662 00000004:00080000:3.0:1713481296.551332:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a1c380, transno 4296037663 00000004:00080000:3.0:1713481296.551334:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b74000, transno 4296037664 00000004:00080000:3.0:1713481296.551337:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a1d500, transno 4296037665 00000004:00080000:3.0:1713481296.551339:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007550d880, transno 4296037666 00000004:00080000:3.0:1713481296.551342:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007550ed80, transno 4296037667 00000004:00080000:3.0:1713481296.551345:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b74a80, transno 4296037668 00000004:00080000:3.0:1713481296.551347:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202abb80, transno 4296037669 00000004:00080000:3.0:1713481296.551350:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df49500, transno 4296037670 00000004:00080000:3.0:1713481296.551352:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801358b8380, transno 4296037671 00000004:00080000:3.0:1713481296.551355:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082356300, transno 4296037672 00000004:00080000:3.0:1713481296.551357:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db8b480, transno 4296037673 00000004:00080000:3.0:1713481296.551360:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089462a00, transno 4296037674 00000004:00080000:3.0:1713481296.551363:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134628e00, transno 4296037675 00000004:00080000:3.0:1713481296.551365:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f050700, transno 4296037676 00000004:00080000:3.0:1713481296.551368:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099988e00, transno 4296037677 00000004:00080000:3.0:1713481296.551371:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de99880, transno 4296037678 00000004:00080000:3.0:1713481296.551373:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009998ad80, transno 4296037679 00000004:00080000:3.0:1713481296.551376:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bd4700, transno 4296037680 00000004:00080000:3.0:1713481296.551379:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b7ad80, transno 4296037681 00000004:00080000:3.0:1713481296.551381:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800772f5f80, transno 4296037682 00000004:00080000:3.0:1713481296.551383:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fdad80, transno 4296037683 00000004:00080000:3.0:1713481296.551386:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620ca80, transno 4296037684 00000004:00080000:3.0:1713481296.551388:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801b4380, transno 4296037685 00000004:00080000:3.0:1713481296.551390:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b7b100, transno 4296037686 00000004:00080000:3.0:1713481296.551392:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078705500, transno 4296037688 00000004:00080000:3.0:1713481296.551395:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078704a80, transno 4296037689 00000004:00080000:3.0:1713481296.551398:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800797fd180, transno 4296037690 00000004:00080000:3.0:1713481296.551401:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b3b80, transno 4296037691 00000004:00080000:3.0:1713481296.551404:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081690000, transno 4296037692 00000004:00080000:3.0:1713481296.551406:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078704e00, transno 4296037693 00000004:00080000:3.0:1713481296.551409:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b0700, transno 4296037694 00000004:00080000:3.0:1713481296.551411:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b0e00, transno 4296037695 00000004:00080000:3.0:1713481296.551414:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084970380, transno 4296037696 00000004:00080000:3.0:1713481296.551417:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009090c700, transno 4296037697 00000004:00080000:3.0:1713481296.551419:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be72d80, transno 4296037698 00000004:00080000:3.0:1713481296.551422:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009cac8700, transno 4296037699 00000004:00080000:3.0:1713481296.551425:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009cac9880, transno 4296037700 00000004:00080000:3.0:1713481296.551427:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009cac9f80, transno 4296037701 00000004:00080000:3.0:1713481296.551430:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007720ed80, transno 4296037702 00000004:00080000:3.0:1713481296.551432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be70700, transno 4296037703 00000004:00080000:3.0:1713481296.551434:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007810ce00, transno 4296037704 00000004:00080000:3.0:1713481296.551437:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800802d5180, transno 4296037705 00000004:00080000:3.0:1713481296.551439:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089881880, transno 4296037706 00000004:00080000:3.0:1713481296.551441:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009835a300, transno 4296037707 00000004:00080000:3.0:1713481296.551444:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f937b80, transno 4296037708 00000004:00080000:3.0:1713481296.551446:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098359c00, transno 4296037709 00000004:00080000:3.0:1713481296.551448:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007573a300, transno 4296037710 00000004:00080000:3.0:1713481296.551451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007573aa00, transno 4296037711 00000004:00080000:3.0:1713481296.551453:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075738700, transno 4296037712 00000004:00080000:3.0:1713481296.551455:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075738380, transno 4296037713 00000004:00080000:3.0:1713481296.551458:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794fce00, transno 4296037714 00000004:00080000:3.0:1713481296.551461:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794ff800, transno 4296037715 00000004:00080000:3.0:1713481296.551464:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f935180, transno 4296037716 00000004:00080000:3.0:1713481296.551466:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a49180, transno 4296037717 00000004:00080000:3.0:1713481296.551469:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794fd500, transno 4296037718 00000004:00080000:3.0:1713481296.551472:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1dc00, transno 4296037719 00000004:00080000:3.0:1713481296.551475:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ec8000, transno 4296037720 00000004:00080000:3.0:1713481296.551478:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1f480, transno 4296037721 00000004:00080000:3.0:1713481296.551480:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f84ce00, transno 4296037722 00000004:00080000:3.0:1713481296.551483:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794fe680, transno 4296037723 00000004:00080000:3.0:1713481296.551486:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f936d80, transno 4296037724 00000004:00080000:3.0:1713481296.551489:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120145500, transno 4296037725 00000004:00080000:3.0:1713481296.551492:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ec9f80, transno 4296037726 00000004:00080000:3.0:1713481296.551495:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078da8000, transno 4296037727 00000004:00080000:3.0:1713481296.551498:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800786ed180, transno 4296037728 00000004:00080000:3.0:1713481296.551501:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120aa7100, transno 4296037729 00000004:00080000:3.0:1713481296.551504:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfaed80, transno 4296037730 00000004:00080000:3.0:1713481296.551506:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120134700, transno 4296037731 00000004:00080000:3.0:1713481296.551509:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120136d80, transno 4296037732 00000004:00080000:3.0:1713481296.551511:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120137800, transno 4296037733 00000004:00080000:3.0:1713481296.551514:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007814aa00, transno 4296037734 00000004:00080000:3.0:1713481296.551516:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa01c00, transno 4296037735 00000004:00080000:3.0:1713481296.551519:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfadf80, transno 4296037736 00000004:00080000:3.0:1713481296.551521:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de96a00, transno 4296037737 00000004:00080000:3.0:1713481296.551524:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075739c00, transno 4296037738 00000004:00080000:3.0:1713481296.551527:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779ebb80, transno 4296037739 00000004:00080000:3.0:1713481296.551529:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007811b480, transno 4296037740 00000004:00080000:3.0:1713481296.551532:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9ea680, transno 4296037741 00000004:00080000:3.0:1713481296.551534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008022d500, transno 4296037742 00000004:00080000:3.0:1713481296.551537:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c03b80, transno 4296037743 00000004:00080000:3.0:1713481296.551540:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007daff100, transno 4296037744 00000004:00080000:3.0:1713481296.551543:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078149180, transno 4296037745 00000004:00080000:3.0:1713481296.551546:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dafd880, transno 4296037746 00000004:00080000:3.0:1713481296.551548:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a90700, transno 4296037747 00000004:00080000:3.0:1713481296.551551:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a90380, transno 4296037748 00000004:00080000:3.0:1713481296.551554:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078dabb80, transno 4296037749 00000004:00080000:3.0:1713481296.551557:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007811b800, transno 4296037750 00000004:00080000:3.0:1713481296.551560:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078dab800, transno 4296037751 00000004:00080000:3.0:1713481296.551563:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cfb100, transno 4296037752 00000004:00080000:3.0:1713481296.551566:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cf8700, transno 4296037753 00000004:00080000:3.0:1713481296.551569:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779e9500, transno 4296037754 00000004:00080000:3.0:1713481296.551571:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120552d80, transno 4296037755 00000004:00080000:3.0:1713481296.551574:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779ea300, transno 4296037756 00000004:00080000:3.0:1713481296.551577:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a92a00, transno 4296037757 00000004:00080000:3.0:1713481296.551580:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072afce00, transno 4296037758 00000004:00080000:3.0:1713481296.551582:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768e8000, transno 4296037759 00000004:00080000:3.0:1713481296.551584:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a8df80, transno 4296037760 00000004:00080000:3.0:1713481296.551587:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007866d500, transno 4296037761 00000004:00080000:3.0:1713481296.551590:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ddc7100, transno 4296037762 00000004:00080000:3.0:1713481296.551592:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007286e680, transno 4296037763 00000004:00080000:3.0:1713481296.551594:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007abb9180, transno 4296037764 00000004:00080000:3.0:1713481296.551597:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007286c700, transno 4296037765 00000004:00080000:3.0:1713481296.551599:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013676e680, transno 4296037766 00000004:00080000:3.0:1713481296.551602:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013676fb80, transno 4296037767 00000004:00080000:3.0:1713481296.551604:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013676c700, transno 4296037768 00000004:00080000:3.0:1713481296.551606:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299e300, transno 4296037769 00000004:00080000:3.0:1713481296.551609:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5ce00, transno 4296037770 00000004:00080000:3.0:1713481296.551611:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cf8000, transno 4296037771 00000004:00080000:3.0:1713481296.551614:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299f480, transno 4296037772 00000004:00080000:3.0:1713481296.551616:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007abbb480, transno 4296037773 00000004:00080000:3.0:1713481296.551619:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120552680, transno 4296037774 00000004:00080000:3.0:1713481296.551621:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fd7d180, transno 4296037775 00000004:00080000:3.0:1713481296.551624:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d1bfb80, transno 4296037776 00000004:00080000:3.0:1713481296.551627:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082117480, transno 4296037777 00000004:00080000:3.0:1713481296.551629:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082114e00, transno 4296037778 00000004:00080000:3.0:1713481296.551633:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0fbb80, transno 4296037779 00000004:00080000:3.0:1713481296.551635:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754f9c00, transno 4296037780 00000004:00080000:3.0:1713481296.551638:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e1c00, transno 4296037781 00000004:00080000:3.0:1713481296.551640:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084875180, transno 4296037782 00000004:00080000:3.0:1713481296.551644:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e0a80, transno 4296037783 00000004:00080000:3.0:1713481296.551646:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e0000, transno 4296037784 00000004:00080000:3.0:1713481296.551648:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e0e00, transno 4296037785 00000004:00080000:3.0:1713481296.551651:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754f8a80, transno 4296037786 00000004:00080000:3.0:1713481296.551653:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e1880, transno 4296037787 00000004:00080000:3.0:1713481296.551656:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773c9500, transno 4296037788 00000004:00080000:3.0:1713481296.551658:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078cd3800, transno 4296037789 00000004:00080000:3.0:1713481296.551661:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077aff800, transno 4296037790 00000004:00080000:3.0:1713481296.551663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077329f80, transno 4296037791 00000004:00080000:3.0:1713481296.551681:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773cb480, transno 4296037792 00000004:00080000:3.0:1713481296.551684:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe43480, transno 4296037793 00000004:00080000:3.0:1713481296.551686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768e9c00, transno 4296037794 00000004:00080000:3.0:1713481296.551689:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe43100, transno 4296037795 00000004:00080000:3.0:1713481296.551691:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007287d180, transno 4296037796 00000004:00080000:3.0:1713481296.551693:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a66a00, transno 4296037797 00000004:00080000:3.0:1713481296.551696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a66d80, transno 4296037798 00000004:00080000:3.0:1713481296.551698:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c50d880, transno 4296037799 00000004:00080000:3.0:1713481296.551700:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008158f100, transno 4296037801 00000004:00080000:3.0:1713481296.551704:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015ad80, transno 4296037802 00000004:00080000:3.0:1713481296.551706:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800816f6300, transno 4296037803 00000004:00080000:3.0:1713481296.551709:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a8d4e00, transno 4296037804 00000004:00080000:3.0:1713481296.551712:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077378e00, transno 4296037805 00000004:00080000:3.0:1713481296.551715:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075556300, transno 4296037806 00000004:00080000:3.0:1713481296.551718:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a2a0e00, transno 4296037807 00000004:00080000:3.0:1713481296.551720:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077971500, transno 4296037808 00000004:00080000:3.0:1713481296.551723:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120040380, transno 4296037809 00000004:00080000:3.0:1713481296.551726:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015a300, transno 4296037810 00000004:00080000:3.0:1713481296.551729:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120159500, transno 4296037811 00000004:00080000:3.0:1713481296.551732:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a2a1f80, transno 4296037812 00000004:00080000:3.0:1713481296.551735:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015aa00, transno 4296037813 00000004:00080000:3.0:1713481296.551738:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b31180, transno 4296037814 00000004:00080000:3.0:1713481296.551740:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b30a80, transno 4296037815 00000004:00080000:3.0:1713481296.551743:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120410700, transno 4296037816 00000004:00080000:3.0:1713481296.551745:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e179180, transno 4296037817 00000004:00080000:3.0:1713481296.551748:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a41b100, transno 4296037818 00000004:00080000:3.0:1713481296.551751:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120075500, transno 4296037819 00000004:00080000:3.0:1713481296.551754:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800803d6d80, transno 4296037820 00000004:00080000:3.0:1713481296.551757:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120411180, transno 4296037821 00000004:00080000:3.0:1713481296.551759:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931d880, transno 4296037822 00000004:00080000:3.0:1713481296.551762:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090828000, transno 4296037823 00000004:00080000:3.0:1713481296.551765:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086c07100, transno 4296037824 00000004:00080000:3.0:1713481296.551767:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120077800, transno 4296037825 00000004:00080000:3.0:1713481296.551770:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078182680, transno 4296037826 00000004:00080000:3.0:1713481296.551772:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120075880, transno 4296037827 00000004:00080000:3.0:1713481296.551775:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931fb80, transno 4296037828 00000004:00080000:3.0:1713481296.551778:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931c000, transno 4296037829 00000004:00080000:3.0:1713481296.551781:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918c7100, transno 4296037830 00000004:00080000:3.0:1713481296.551784:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5bb80, transno 4296037831 00000004:00080000:3.0:1713481296.551787:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079709880, transno 4296037832 00000004:00080000:3.0:1713481296.551789:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787ebb80, transno 4296037833 00000004:00080000:3.0:1713481296.551791:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec41180, transno 4296037834 00000004:00080000:3.0:1713481296.551794:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a1180, transno 4296037835 00000004:00080000:3.0:1713481296.551796:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a0a80, transno 4296037836 00000004:00080000:3.0:1713481296.551798:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a2680, transno 4296037837 00000004:00080000:3.0:1713481296.551801:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bece00, transno 4296037838 00000004:00080000:3.0:1713481296.551804:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a1f80, transno 4296037839 00000004:00080000:3.0:1713481296.551807:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce6d80, transno 4296037840 00000004:00080000:3.0:1713481296.551810:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce4000, transno 4296037841 00000004:00080000:3.0:1713481296.551813:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce7100, transno 4296037842 00000004:00080000:3.0:1713481296.551815:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097b4c700, transno 4296037843 00000004:00080000:3.0:1713481296.551818:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec43480, transno 4296037844 00000004:00080000:3.0:1713481296.551821:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078612a00, transno 4296037845 00000004:00080000:3.0:1713481296.551823:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce5f80, transno 4296037846 00000004:00080000:3.0:1713481296.551826:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a73b80, transno 4296037847 00000004:00080000:3.0:1713481296.551829:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e59180, transno 4296037848 00000004:00080000:3.0:1713481296.551832:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097657800, transno 4296037849 00000004:00080000:3.0:1713481296.551835:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de9a300, transno 4296037850 00000004:00080000:3.0:1713481296.551838:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e59f80, transno 4296037851 00000004:00080000:3.0:1713481296.551840:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3ca80, transno 4296037852 00000004:00080000:3.0:1713481296.551843:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed3f480, transno 4296037853 00000004:00080000:3.0:1713481296.551846:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136375880, transno 4296037854 00000004:00080000:3.0:1713481296.551849:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136374700, transno 4296037855 00000004:00080000:3.0:1713481296.551851:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a70000, transno 4296037856 00000004:00080000:3.0:1713481296.551854:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077014380, transno 4296037857 00000004:00080000:3.0:1713481296.551857:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090829c00, transno 4296037858 00000004:00080000:3.0:1713481296.551859:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec43b80, transno 4296037859 00000004:00080000:3.0:1713481296.551862:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f05c00, transno 4296037860 00000004:00080000:3.0:1713481296.551865:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077015180, transno 4296037861 00000004:00080000:3.0:1713481296.551868:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b2f6300, transno 4296037862 00000004:00080000:3.0:1713481296.551870:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097e40a80, transno 4296037863 00000004:00080000:3.0:1713481296.551873:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082104000, transno 4296037864 00000004:00080000:3.0:1713481296.551876:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086964e00, transno 4296037865 00000004:00080000:3.0:1713481296.551879:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009faa4a80, transno 4296037866 00000004:00080000:3.0:1713481296.551881:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9d180, transno 4296037867 00000004:00080000:3.0:1713481296.551884:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009faa4000, transno 4296037868 00000004:00080000:3.0:1713481296.551887:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821c000, transno 4296037869 00000004:00080000:3.0:1713481296.551890:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b8e300, transno 4296037870 00000004:00080000:3.0:1713481296.551893:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821df80, transno 4296037871 00000004:00080000:3.0:1713481296.551895:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b333b80, transno 4296037872 00000004:00080000:3.0:1713481296.551898:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad8700, transno 4296037873 00000004:00080000:3.0:1713481296.551901:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821d880, transno 4296037874 00000004:00080000:3.0:1713481296.551903:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad9180, transno 4296037875 00000004:00080000:3.0:1713481296.551905:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076adb800, transno 4296037876 00000004:00080000:3.0:1713481296.551908:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdd9880, transno 4296037877 00000004:00080000:3.0:1713481296.551911:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086fec000, transno 4296037878 00000004:00080000:3.0:1713481296.551913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077014a80, transno 4296037879 00000004:00080000:3.0:1713481296.551916:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2d3b80, transno 4296037880 00000004:00080000:3.0:1713481296.551919:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077016a00, transno 4296037881 00000004:00080000:3.0:1713481296.551921:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9fb80, transno 4296037882 00000004:00080000:3.0:1713481296.551924:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f05500, transno 4296037883 00000004:00080000:3.0:1713481296.551927:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f06680, transno 4296037884 00000004:00080000:3.0:1713481296.551929:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b331500, transno 4296037885 00000004:00080000:3.0:1713481296.551932:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136376300, transno 4296037887 00000004:00080000:3.0:1713481296.551934:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a97800, transno 4296037888 00000004:00080000:3.0:1713481296.551937:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce7480, transno 4296037889 00000004:00080000:3.0:1713481296.551939:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8df480, transno 4296037890 00000004:00080000:3.0:1713481296.551942:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2d3100, transno 4296037891 00000004:00080000:3.0:1713481296.551945:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33f480, transno 4296037892 00000004:00080000:3.0:1713481296.551948:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ab74000, transno 4296037893 00000004:00080000:3.0:1713481296.551951:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801207b0e00, transno 4296037894 00000004:00080000:3.0:1713481296.551953:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078376a00, transno 4296037895 00000004:00080000:3.0:1713481296.551956:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078374e00, transno 4296037896 00000004:00080000:3.0:1713481296.551958:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094119c00, transno 4296037897 00000004:00080000:3.0:1713481296.551961:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009411b100, transno 4296037898 00000004:00080000:3.0:1713481296.551964:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e724a80, transno 4296037899 00000004:00080000:3.0:1713481296.551966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089ae8e00, transno 4296037900 00000004:00080000:3.0:1713481296.551970:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a0700, transno 4296037901 00000004:00080000:3.0:1713481296.551972:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015e300, transno 4296037902 00000004:00080000:3.0:1713481296.551975:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a0a80, transno 4296037903 00000004:00080000:3.0:1713481296.551977:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a2300, transno 4296037904 00000004:00080000:3.0:1713481296.551980:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdd8e00, transno 4296037905 00000004:00080000:3.0:1713481296.551983:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fddbb80, transno 4296037906 00000004:00080000:3.0:1713481296.551985:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a73480, transno 4296037907 00000004:00080000:3.0:1713481296.551988:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a0a80, transno 4296037908 00000004:00080000:3.0:1713481296.551992:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136377100, transno 4296037909 00000004:00080000:3.0:1713481296.551994:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008817aa00, transno 4296037910 00000004:00080000:3.0:1713481296.551998:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a40380, transno 4296037911 00000004:00080000:3.0:1713481296.552000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8dc380, transno 4296037912 00000004:00080000:3.0:1713481296.552003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078374a80, transno 4296037913 00000004:00080000:3.0:1713481296.552005:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094118700, transno 4296037914 00000004:00080000:3.0:1713481296.552008:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078377b80, transno 4296037915 00000004:00080000:3.0:1713481296.552011:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120148380, transno 4296037916 00000004:00080000:3.0:1713481296.552013:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078374000, transno 4296037917 00000004:00080000:3.0:1713481296.552016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082306d80, transno 4296037918 00000004:00080000:3.0:1713481296.552018:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082306680, transno 4296037919 00000004:00080000:3.0:1713481296.552021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e276d80, transno 4296037920 00000004:00080000:3.0:1713481296.552024:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e275880, transno 4296037921 00000004:00080000:3.0:1713481296.552027:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800967cc380, transno 4296037922 00000004:00080000:3.0:1713481296.552030:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bbf480, transno 4296037923 00000004:00080000:3.0:1713481296.552033:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b6fb80, transno 4296037924 00000004:00080000:3.0:1713481296.552035:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088179500, transno 4296037925 00000004:00080000:3.0:1713481296.552038:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062ca80, transno 4296037926 00000004:00080000:3.0:1713481296.552041:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920b9c00, transno 4296037927 00000004:00080000:3.0:1713481296.552043:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062ea00, transno 4296037928 00000004:00080000:3.0:1713481296.552045:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062ce00, transno 4296037929 00000004:00080000:3.0:1713481296.552048:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736d500, transno 4296037930 00000004:00080000:3.0:1713481296.552051:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736f100, transno 4296037931 00000004:00080000:3.0:1713481296.552053:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c4a80, transno 4296037932 00000004:00080000:3.0:1713481296.552056:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122bac380, transno 4296037933 00000004:00080000:3.0:1713481296.552058:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736c000, transno 4296037934 00000004:00080000:3.0:1713481296.552061:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736e680, transno 4296037935 00000004:00080000:3.0:1713481296.552063:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5fb80, transno 4296037936 00000004:00080000:3.0:1713481296.552066:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5d180, transno 4296037937 00000004:00080000:3.0:1713481296.552068:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5f100, transno 4296037938 00000004:00080000:3.0:1713481296.552071:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ee28700, transno 4296037939 00000004:00080000:3.0:1713481296.552073:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736d880, transno 4296037940 00000004:00080000:3.0:1713481296.552076:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cfd2300, transno 4296037941 00000004:00080000:3.0:1713481296.552079:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c4700, transno 4296037942 00000004:00080000:3.0:1713481296.552081:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009182ad80, transno 4296037943 00000004:00080000:3.0:1713481296.552084:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ee29f80, transno 4296037944 00000004:00080000:3.0:1713481296.552087:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ee2aa00, transno 4296037945 00000004:00080000:3.0:1713481296.552089:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883bb100, transno 4296037946 00000004:00080000:3.0:1713481296.552092:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5ea00, transno 4296037947 00000004:00080000:3.0:1713481296.552094:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5ed80, transno 4296037948 00000004:00080000:3.0:1713481296.552097:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e271180, transno 4296037949 00000004:00080000:3.0:1713481296.552099:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083b87800, transno 4296037950 00000004:00080000:3.0:1713481296.552102:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086d65180, transno 4296037951 00000004:00080000:3.0:1713481296.552105:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150f480, transno 4296037952 00000004:00080000:3.0:1713481296.552108:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086d67b80, transno 4296037953 00000004:00080000:3.0:1713481296.552111:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8a8000, transno 4296037954 00000004:00080000:3.0:1713481296.552113:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8a8380, transno 4296037955 00000004:00080000:3.0:1713481296.552115:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8a8700, transno 4296037956 00000004:00080000:3.0:1713481296.552135:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8a9c00, transno 4296037957 00000004:00080000:3.0:1713481296.552139:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8aa680, transno 4296037958 00000004:00080000:3.0:1713481296.552142:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f8a9500, transno 4296037959 00000004:00080000:3.0:1713481296.552144:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2a9880, transno 4296037960 00000004:00080000:3.0:1713481296.552147:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a9180, transno 4296037961 00000004:00080000:3.0:1713481296.552150:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aa2300, transno 4296037962 00000004:00080000:3.0:1713481296.552153:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079566d80, transno 4296037963 00000004:00080000:3.0:1713481296.552156:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aa3800, transno 4296037964 00000004:00080000:3.0:1713481296.552158:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a48e00, transno 4296037965 00000004:00080000:3.0:1713481296.552160:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3d9c00, transno 4296037966 00000004:00080000:3.0:1713481296.552163:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e55fb80, transno 4296037967 00000004:00080000:3.0:1713481296.552165:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af72300, transno 4296037968 00000004:00080000:3.0:1713481296.552168:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3dad80, transno 4296037969 00000004:00080000:3.0:1713481296.552171:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3da680, transno 4296037970 00000004:00080000:3.0:1713481296.552173:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af70700, transno 4296037971 00000004:00080000:3.0:1713481296.552176:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3d8380, transno 4296037972 00000004:00080000:3.0:1713481296.552178:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801322a5180, transno 4296037973 00000004:00080000:3.0:1713481296.552181:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0b8a80, transno 4296037974 00000004:00080000:3.0:1713481296.552184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782b5180, transno 4296037975 00000004:00080000:3.0:1713481296.552186:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011edcd880, transno 4296037976 00000004:00080000:3.0:1713481296.552188:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079940700, transno 4296037977 00000004:00080000:3.0:1713481296.552191:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007987ea00, transno 4296037978 00000004:00080000:3.0:1713481296.552193:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829c380, transno 4296037979 00000004:00080000:3.0:1713481296.552196:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d18000, transno 4296037980 00000004:00080000:3.0:1713481296.552199:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1db800, transno 4296037981 00000004:00080000:3.0:1713481296.552201:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af1ed80, transno 4296037982 00000004:00080000:3.0:1713481296.552203:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1d8700, transno 4296037983 00000004:00080000:3.0:1713481296.552206:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af1e680, transno 4296037984 00000004:00080000:3.0:1713481296.552208:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af1fb80, transno 4296037985 00000004:00080000:3.0:1713481296.552211:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b58e00, transno 4296037986 00000004:00080000:3.0:1713481296.552213:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1db100, transno 4296037987 00000004:00080000:3.0:1713481296.552216:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008afef480, transno 4296037988 00000004:00080000:3.0:1713481296.552219:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a923100, transno 4296037989 00000004:00080000:3.0:1713481296.552221:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a86b800, transno 4296037990 00000004:00080000:3.0:1713481296.552224:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a869180, transno 4296037991 00000004:00080000:3.0:1713481296.552227:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e65180, transno 4296037992 00000004:00080000:3.0:1713481296.552229:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099805180, transno 4296037993 00000004:00080000:3.0:1713481296.552232:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099806a00, transno 4296037994 00000004:00080000:3.0:1713481296.552234:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb3800, transno 4296037995 00000004:00080000:3.0:1713481296.552237:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081cf7800, transno 4296037996 00000004:00080000:3.0:1713481296.552239:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008afec000, transno 4296037997 00000004:00080000:3.0:1713481296.552241:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962b7480, transno 4296037998 00000004:00080000:3.0:1713481296.552243:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099804a80, transno 4296037999 00000004:00080000:3.0:1713481296.552246:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac5c00, transno 4296038000 00000004:00080000:3.0:1713481296.552248:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008220a300, transno 4296038001 00000004:00080000:3.0:1713481296.552250:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081cf5180, transno 4296038002 00000004:00080000:3.0:1713481296.552252:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e8ed80, transno 4296038003 00000004:00080000:3.0:1713481296.552254:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011faead80, transno 4296038004 00000004:00080000:3.0:1713481296.552256:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136345180, transno 4296038005 00000004:00080000:3.0:1713481296.552259:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083280700, transno 4296038006 00000004:00080000:3.0:1713481296.552261:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075754380, transno 4296038007 00000004:00080000:3.0:1713481296.552263:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008afeea00, transno 4296038008 00000004:00080000:3.0:1713481296.552265:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008afec700, transno 4296038009 00000004:00080000:3.0:1713481296.552267:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086e34700, transno 4296038010 00000004:00080000:3.0:1713481296.552270:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007decd500, transno 4296038011 00000004:00080000:3.0:1713481296.552272:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007decce00, transno 4296038012 00000004:00080000:3.0:1713481296.552274:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dece300, transno 4296038013 00000004:00080000:3.0:1713481296.552277:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007decea00, transno 4296038014 00000004:00080000:3.0:1713481296.552280:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3ca80, transno 4296038015 00000004:00080000:3.0:1713481296.552282:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a2669f80, transno 4296038016 00000004:00080000:3.0:1713481296.552285:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a53480, transno 4296038017 00000004:00080000:3.0:1713481296.552287:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120bec000, transno 4296038018 00000004:00080000:3.0:1713481296.552290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120bec380, transno 4296038019 00000004:00080000:3.0:1713481296.552293:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798fa680, transno 4296038020 00000004:00080000:3.0:1713481296.552296:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a266aa00, transno 4296038021 00000004:00080000:3.0:1713481296.552298:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a2668a80, transno 4296038022 00000004:00080000:3.0:1713481296.552301:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008383a300, transno 4296038024 00000004:00080000:3.0:1713481296.552304:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a50380, transno 4296038025 00000004:00080000:3.0:1713481296.552307:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bc700, transno 4296038026 00000004:00080000:3.0:1713481296.552309:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a86a300, transno 4296038027 00000004:00080000:3.0:1713481296.552312:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a833b80, transno 4296038028 00000004:00080000:3.0:1713481296.552314:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076b29f80, transno 4296038029 00000004:00080000:3.0:1713481296.552317:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798fbb80, transno 4296038030 00000004:00080000:3.0:1713481296.552320:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782af480, transno 4296038031 00000004:00080000:3.0:1713481296.552323:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f89e300, transno 4296038033 00000004:00080000:3.0:1713481296.552326:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009194bb80, transno 4296038034 00000004:00080000:3.0:1713481296.552329:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f89f100, transno 4296038035 00000004:00080000:3.0:1713481296.552332:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783cc000, transno 4296038036 00000004:00080000:3.0:1713481296.552334:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed85180, transno 4296038037 00000004:00080000:3.0:1713481296.552337:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f942680, transno 4296038038 00000004:00080000:3.0:1713481296.552340:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086ae8700, transno 4296038039 00000004:00080000:3.0:1713481296.552343:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a90b100, transno 4296038040 00000004:00080000:3.0:1713481296.552346:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f940e00, transno 4296038041 00000004:00080000:3.0:1713481296.552348:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a04dc00, transno 4296038042 00000004:00080000:3.0:1713481296.552351:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e3b80, transno 4296038043 00000004:00080000:3.0:1713481296.552353:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120b4a300, transno 4296038044 00000004:00080000:3.0:1713481296.552356:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a04d500, transno 4296038045 00000004:00080000:3.0:1713481296.552359:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3e9f80, transno 4296038046 00000004:00080000:3.0:1713481296.552362:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798f9500, transno 4296038047 00000004:00080000:3.0:1713481296.552365:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798f9f80, transno 4296038048 00000004:00080000:3.0:1713481296.552367:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d0e0000, transno 4296038049 00000004:00080000:3.0:1713481296.552370:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d0e3b80, transno 4296038050 00000004:00080000:3.0:1713481296.552372:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bd0000, transno 4296038051 00000004:00080000:3.0:1713481296.552375:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135a12300, transno 4296038052 00000004:00080000:3.0:1713481296.552378:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092988000, transno 4296038053 00000004:00080000:3.0:1713481296.552381:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097e41500, transno 4296038054 00000004:00080000:3.0:1713481296.552384:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c6680, transno 4296038055 00000004:00080000:3.0:1713481296.552386:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768d2a00, transno 4296038056 00000004:00080000:3.0:1713481296.552389:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078078700, transno 4296038057 00000004:00080000:3.0:1713481296.552391:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ab5500, transno 4296038058 00000004:00080000:3.0:1713481296.552394:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077946d80, transno 4296038059 00000004:00080000:3.0:1713481296.552396:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078079880, transno 4296038060 00000004:00080000:3.0:1713481296.552399:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084823480, transno 4296038061 00000004:00080000:3.0:1713481296.552402:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092329f80, transno 4296038062 00000004:00080000:3.0:1713481296.552405:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a5e300, transno 4296038063 00000004:00080000:3.0:1713481296.552407:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077944000, transno 4296038064 00000004:00080000:3.0:1713481296.552410:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0bd180, transno 4296038065 00000004:00080000:3.0:1713481296.552412:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0bc380, transno 4296038066 00000004:00080000:3.0:1713481296.552415:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0bc700, transno 4296038067 00000004:00080000:3.0:1713481296.552417:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092329c00, transno 4296038068 00000004:00080000:3.0:1713481296.552419:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994e300, transno 4296038069 00000004:00080000:3.0:1713481296.552421:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994ea00, transno 4296038070 00000004:00080000:3.0:1713481296.552424:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076877480, transno 4296038071 00000004:00080000:3.0:1713481296.552427:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c34000, transno 4296038072 00000004:00080000:3.0:1713481296.552429:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798cb800, transno 4296038073 00000004:00080000:3.0:1713481296.552432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120248380, transno 4296038074 00000004:00080000:3.0:1713481296.552435:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e57480, transno 4296038075 00000004:00080000:3.0:1713481296.552438:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798c8700, transno 4296038076 00000004:00080000:3.0:1713481296.552441:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798c9500, transno 4296038077 00000004:00080000:3.0:1713481296.552443:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b7b800, transno 4296038078 00000004:00080000:3.0:1713481296.552446:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed38380, transno 4296038079 00000004:00080000:3.0:1713481296.552448:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c35880, transno 4296038080 00000004:00080000:3.0:1713481296.552451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e57b80, transno 4296038081 00000004:00080000:3.0:1713481296.552453:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b79180, transno 4296038082 00000004:00080000:3.0:1713481296.552457:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed39180, transno 4296038083 00000004:00080000:3.0:1713481296.552460:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e315c00, transno 4296038084 00000004:00080000:3.0:1713481296.552463:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e315500, transno 4296038085 00000004:00080000:3.0:1713481296.552465:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096768e00, transno 4296038086 00000004:00080000:3.0:1713481296.552468:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b78e00, transno 4296038087 00000004:00080000:3.0:1713481296.552470:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed91c00, transno 4296038088 00000004:00080000:3.0:1713481296.552473:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af3480, transno 4296038089 00000004:00080000:3.0:1713481296.552476:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781a4000, transno 4296038090 00000004:00080000:3.0:1713481296.552479:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078706d80, transno 4296038091 00000004:00080000:3.0:1713481296.552481:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed92680, transno 4296038093 00000004:00080000:3.0:1713481296.552484:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768d1c00, transno 4296038094 00000004:00080000:3.0:1713481296.552487:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078707480, transno 4296038095 00000004:00080000:3.0:1713481296.552490:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768d2300, transno 4296038096 00000004:00080000:3.0:1713481296.552492:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f050e00, transno 4296038097 00000004:00080000:3.0:1713481296.552494:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f051f80, transno 4296038098 00000004:00080000:3.0:1713481296.552497:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af1180, transno 4296038099 00000004:00080000:3.0:1713481296.552499:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f050a80, transno 4296038100 00000004:00080000:3.0:1713481296.552502:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086ec0000, transno 4296038101 00000004:00080000:3.0:1713481296.552505:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794cb100, transno 4296038102 00000004:00080000:3.0:1713481296.552507:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120251880, transno 4296038103 00000004:00080000:3.0:1713481296.552510:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077153480, transno 4296038104 00000004:00080000:3.0:1713481296.552513:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077151180, transno 4296038105 00000004:00080000:3.0:1713481296.552516:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b28e00, transno 4296038106 00000004:00080000:3.0:1713481296.552518:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082354e00, transno 4296038107 00000004:00080000:3.0:1713481296.552521:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007556c000, transno 4296038108 00000004:00080000:3.0:1713481296.552523:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800802d5500, transno 4296038109 00000004:00080000:3.0:1713481296.552526:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009090c000, transno 4296038110 00000004:00080000:3.0:1713481296.552528:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4b1180, transno 4296038111 00000004:00080000:3.0:1713481296.552531:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076835f80, transno 4296038112 00000004:00080000:3.0:1713481296.552534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120f2f800, transno 4296038113 00000004:00080000:3.0:1713481296.552537:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad84380, transno 4296038114 00000004:00080000:3.0:1713481296.552539:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b2680, transno 4296038115 00000004:00080000:3.0:1713481296.552542:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b1500, transno 4296038116 00000004:00080000:3.0:1713481296.552544:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801358ba300, transno 4296038118 00000004:00080000:3.0:1713481296.552547:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801358b8000, transno 4296038119 00000004:00080000:3.0:1713481296.552549:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076837480, transno 4296038120 00000004:00080000:3.0:1713481296.552551:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796ddc00, transno 4296038121 00000004:00080000:3.0:1713481296.552555:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780edc00, transno 4296038122 00000004:00080000:3.0:1713481296.552557:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1c000, transno 4296038123 00000004:00080000:3.0:1713481296.552560:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008808b100, transno 4296038124 00000004:00080000:3.0:1713481296.552563:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120a1f800, transno 4296038125 00000004:00080000:3.0:1713481296.552565:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b0000, transno 4296038126 00000004:00080000:3.0:1713481296.552568:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078da9880, transno 4296038127 00000004:00080000:3.0:1713481296.552571:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084973100, transno 4296038128 00000004:00080000:3.0:1713481296.552573:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b79500, transno 4296038129 00000004:00080000:3.0:1713481296.552576:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120a1d180, transno 4296038130 00000004:00080000:3.0:1713481296.552579:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa00380, transno 4296038131 00000004:00080000:3.0:1713481296.552581:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b7aa00, transno 4296038132 00000004:00080000:3.0:1713481296.552584:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c00a80, transno 4296038133 00000004:00080000:3.0:1713481296.552587:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796e0700, transno 4296038134 00000004:00080000:3.0:1713481296.552590:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d09b100, transno 4296038135 00000004:00080000:3.0:1713481296.552593:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007866f800, transno 4296038136 00000004:00080000:3.0:1713481296.552595:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078da8a80, transno 4296038137 00000004:00080000:3.0:1713481296.552598:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f936680, transno 4296038138 00000004:00080000:3.0:1713481296.552600:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a80a80, transno 4296038139 00000004:00080000:3.0:1713481296.552603:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d09aa00, transno 4296038140 00000004:00080000:3.0:1713481296.552606:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007daffb80, transno 4296038141 00000004:00080000:3.0:1713481296.552608:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c01c00, transno 4296038142 00000004:00080000:3.0:1713481296.552610:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e349880, transno 4296038143 00000004:00080000:3.0:1713481296.552613:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078daad80, transno 4296038144 00000004:00080000:3.0:1713481296.552616:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078da9180, transno 4296038145 00000004:00080000:3.0:1713481296.552618:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078da8e00, transno 4296038146 00000004:00080000:3.0:1713481296.552621:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794fc000, transno 4296038147 00000004:00080000:3.0:1713481296.552624:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de2d880, transno 4296038148 00000004:00080000:3.0:1713481296.552627:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007286c000, transno 4296038149 00000004:00080000:3.0:1713481296.552629:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de2dc00, transno 4296038150 00000004:00080000:3.0:1713481296.552631:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086b45f80, transno 4296038151 00000004:00080000:3.0:1713481296.552634:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120a1fb80, transno 4296038152 00000004:00080000:3.0:1713481296.552637:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1c700, transno 4296038153 00000004:00080000:3.0:1713481296.552639:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084874e00, transno 4296038154 00000004:00080000:3.0:1713481296.552642:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b20700, transno 4296038155 00000004:00080000:3.0:1713481296.552645:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b23800, transno 4296038156 00000004:00080000:3.0:1713481296.552647:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b20e00, transno 4296038157 00000004:00080000:3.0:1713481296.552650:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084876300, transno 4296038158 00000004:00080000:3.0:1713481296.552653:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1fb80, transno 4296038159 00000004:00080000:3.0:1713481296.552655:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1c380, transno 4296038160 00000004:00080000:3.0:1713481296.552658:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d1bca80, transno 4296038161 00000004:00080000:3.0:1713481296.552661:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077973800, transno 4296038162 00000004:00080000:3.0:1713481296.552663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d878e00, transno 4296038163 00000004:00080000:3.0:1713481296.552681:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078119180, transno 4296038164 00000004:00080000:3.0:1713481296.552685:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135905f80, transno 4296038165 00000004:00080000:3.0:1713481296.552688:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013676d180, transno 4296038166 00000004:00080000:3.0:1713481296.552690:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072847b80, transno 4296038167 00000004:00080000:3.0:1713481296.552693:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072844e00, transno 4296038168 00000004:00080000:3.0:1713481296.552695:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078343b80, transno 4296038169 00000004:00080000:3.0:1713481296.552698:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a5f800, transno 4296038170 00000004:00080000:3.0:1713481296.552700:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120411500, transno 4296038171 00000004:00080000:3.0:1713481296.552703:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078596d80, transno 4296038172 00000004:00080000:3.0:1713481296.552706:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120412680, transno 4296038173 00000004:00080000:3.0:1713481296.552708:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072afd180, transno 4296038174 00000004:00080000:3.0:1713481296.552712:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f998700, transno 4296038175 00000004:00080000:3.0:1713481296.552715:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ed0000, transno 4296038176 00000004:00080000:3.0:1713481296.552717:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728d6a00, transno 4296038177 00000004:00080000:3.0:1713481296.552720:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a65180, transno 4296038178 00000004:00080000:3.0:1713481296.552722:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120077b80, transno 4296038179 00000004:00080000:3.0:1713481296.552725:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072845180, transno 4296038180 00000004:00080000:3.0:1713481296.552727:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072846a00, transno 4296038181 00000004:00080000:3.0:1713481296.552730:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007809dc00, transno 4296038182 00000004:00080000:3.0:1713481296.552733:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078336680, transno 4296038183 00000004:00080000:3.0:1713481296.552736:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe79500, transno 4296038186 00000004:00080000:3.0:1713481296.552739:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5c700, transno 4296038187 00000004:00080000:3.0:1713481296.552742:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a2d80, transno 4296038188 00000004:00080000:3.0:1713481296.552745:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe79c00, transno 4296038189 00000004:00080000:3.0:1713481296.552747:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135bef800, transno 4296038190 00000004:00080000:3.0:1713481296.552750:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072847100, transno 4296038192 00000004:00080000:3.0:1713481296.552752:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a0e00, transno 4296038193 00000004:00080000:3.0:1713481296.552754:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078183b80, transno 4296038194 00000004:00080000:3.0:1713481296.552757:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5d180, transno 4296038195 00000004:00080000:3.0:1713481296.552760:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956ca80, transno 4296038196 00000004:00080000:3.0:1713481296.552762:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076afdc00, transno 4296038197 00000004:00080000:3.0:1713481296.552765:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ece00, transno 4296038198 00000004:00080000:3.0:1713481296.552768:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609d880, transno 4296038199 00000004:00080000:3.0:1713481296.552770:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e404e00, transno 4296038200 00000004:00080000:3.0:1713481296.552773:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e51180, transno 4296038201 00000004:00080000:3.0:1713481296.552776:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787b9500, transno 4296038202 00000004:00080000:3.0:1713481296.552778:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012252d500, transno 4296038203 00000004:00080000:3.0:1713481296.552781:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609d500, transno 4296038204 00000004:00080000:3.0:1713481296.552783:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787b8380, transno 4296038205 00000004:00080000:3.0:1713481296.552785:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da9c380, transno 4296038206 00000004:00080000:3.0:1713481296.552788:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076adb480, transno 4296038207 00000004:00080000:3.0:1713481296.552791:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800768e8700, transno 4296038208 00000004:00080000:3.0:1713481296.552794:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c1880, transno 4296038209 00000004:00080000:3.0:1713481296.552797:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076ad9c00, transno 4296038210 00000004:00080000:3.0:1713481296.552799:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c1500, transno 4296038212 00000004:00080000:3.0:1713481296.552802:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c0a80, transno 4296038461 00000004:00080000:3.0:1713481296.552804:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076af5500, transno 4296038462 00000004:00080000:3.0:1713481296.552807:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078546680, transno 4296038463 00000004:00080000:3.0:1713481296.552809:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec33100, transno 4296038464 00000004:00080000:3.0:1713481296.552812:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1b7480, transno 4296038465 00000004:00080000:3.0:1713481296.552815:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bfce00, transno 4296038466 00000004:00080000:3.0:1713481296.552818:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090752d80, transno 4296038467 00000004:00080000:3.0:1713481296.552820:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bfdc00, transno 4296038468 00000004:00080000:3.0:1713481296.552823:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a8700, transno 4296038469 00000004:00080000:3.0:1713481296.552826:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a48380, transno 4296038470 00000004:00080000:3.0:1713481296.552828:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785aad80, transno 4296038471 00000004:00080000:3.0:1713481296.552831:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a4aa00, transno 4296038472 00000004:00080000:3.0:1713481296.552834:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837ac000, transno 4296038473 00000004:00080000:3.0:1713481296.552836:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837ace00, transno 4296038474 00000004:00080000:3.0:1713481296.552839:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e274e00, transno 4296038475 00000004:00080000:3.0:1713481296.552841:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e64e00, transno 4296038476 00000004:00080000:3.0:1713481296.552844:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e275500, transno 4296038477 00000004:00080000:3.0:1713481296.552846:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e65c00, transno 4296038478 00000004:00080000:3.0:1713481296.552849:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781c2680, transno 4296038479 00000004:00080000:3.0:1713481296.552852:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e65f80, transno 4296038480 00000004:00080000:3.0:1713481296.552854:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e66d80, transno 4296038481 00000004:00080000:3.0:1713481296.552857:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085ec9c00, transno 4296038482 00000004:00080000:3.0:1713481296.552859:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800781c2d80, transno 4296038483 00000004:00080000:3.0:1713481296.552862:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007738b480, transno 4296038484 00000004:00080000:3.0:1713481296.552865:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e725f80, transno 4296038485 00000004:00080000:3.0:1713481296.552868:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082304a80, transno 4296038486 00000004:00080000:3.0:1713481296.552871:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007821e680, transno 4296038487 00000004:00080000:3.0:1713481296.552874:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007738a680, transno 4296038488 00000004:00080000:3.0:1713481296.552877:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bed9f80, transno 4296038489 00000004:00080000:3.0:1713481296.552879:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787bb800, transno 4296038490 00000004:00080000:3.0:1713481296.552882:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081cf4e00, transno 4296038491 00000004:00080000:3.0:1713481296.552884:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008afedc00, transno 4296038492 00000004:00080000:3.0:1713481296.552887:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078614e00, transno 4296038493 00000004:00080000:3.0:1713481296.552890:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007737e680, transno 4296038494 00000004:00080000:3.0:1713481296.552893:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800837aea00, transno 4296038495 00000004:00080000:3.0:1713481296.552896:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec33800, transno 4296038496 00000004:00080000:3.0:1713481296.552899:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080300700, transno 4296038497 00000004:00080000:3.0:1713481296.552901:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009194a680, transno 4296038498 00000004:00080000:3.0:1713481296.552904:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb2680, transno 4296038499 00000004:00080000:3.0:1713481296.552907:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d3d500, transno 4296038500 00000004:00080000:3.0:1713481296.552910:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075504e00, transno 4296038501 00000004:00080000:3.0:1713481296.552913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a266b100, transno 4296038502 00000004:00080000:3.0:1713481296.552915:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a07bb80, transno 4296038503 00000004:00080000:3.0:1713481296.552918:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a078380, transno 4296038504 00000004:00080000:3.0:1713481296.552920:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773d0380, transno 4296038505 00000004:00080000:3.0:1713481296.552923:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a078e00, transno 4296038506 00000004:00080000:3.0:1713481296.552925:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d68e00, transno 4296038507 00000004:00080000:3.0:1713481296.552929:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c35b100, transno 4296038508 00000004:00080000:3.0:1713481296.552931:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136454000, transno 4296038509 00000004:00080000:3.0:1713481296.552934:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a07b100, transno 4296038510 00000004:00080000:3.0:1713481296.552936:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013225ad80, transno 4296038511 00000004:00080000:3.0:1713481296.552939:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084939f80, transno 4296038512 00000004:00080000:3.0:1713481296.552941:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008493a680, transno 4296038513 00000004:00080000:3.0:1713481296.552944:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801a9f80, transno 4296038514 00000004:00080000:3.0:1713481296.552947:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801abb80, transno 4296038515 00000004:00080000:3.0:1713481296.552950:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800821d0700, transno 4296038516 00000004:00080000:3.0:1713481296.552953:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800821d2a00, transno 4296038517 00000004:00080000:3.0:1713481296.552956:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800801a8e00, transno 4296038518 00000004:00080000:3.0:1713481296.552959:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c27f100, transno 4296038519 00000004:00080000:3.0:1713481296.552961:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084938000, transno 4296038520 00000004:00080000:3.0:1713481296.552964:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078593b80, transno 4296038521 00000004:00080000:3.0:1713481296.552966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1c000, transno 4296038522 00000004:00080000:3.0:1713481296.552969:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880080301880, transno 4296038523 00000004:00080000:3.0:1713481296.552972:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121a1f480, transno 4296038524 00000004:00080000:3.0:1713481296.552974:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085cad180, transno 4296038525 00000004:00080000:3.0:1713481296.552977:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994f800, transno 4296038526 00000004:00080000:3.0:1713481296.552980:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078079500, transno 4296038527 00000004:00080000:3.0:1713481296.552983:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b8d180, transno 4296038528 00000004:00080000:3.0:1713481296.552985:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0f3480, transno 4296038529 00000004:00080000:3.0:1713481296.552988:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082020a80, transno 4296038530 00000004:00080000:3.0:1713481296.552990:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008493a300, transno 4296038531 00000004:00080000:3.0:1713481296.552993:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135cadc00, transno 4296038532 00000004:00080000:3.0:1713481296.552995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a078a80, transno 4296038533 00000004:00080000:3.0:1713481296.552998:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082020380, transno 4296038534 00000004:00080000:3.0:1713481296.553000:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e34a80, transno 4296038535 00000004:00080000:3.0:1713481296.553003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994c380, transno 4296038536 00000004:00080000:3.0:1713481296.553006:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994fb80, transno 4296038537 00000004:00080000:3.0:1713481296.553009:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881ac000, transno 4296038538 00000004:00080000:3.0:1713481296.553012:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881af800, transno 4296038539 00000004:00080000:3.0:1713481296.553014:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881af100, transno 4296038540 00000004:00080000:3.0:1713481296.553016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881adf80, transno 4296038541 00000004:00080000:3.0:1713481296.553019:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009dd95880, transno 4296038542 00000004:00080000:3.0:1713481296.553021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e91880, transno 4296038543 00000004:00080000:3.0:1713481296.553023:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007852d500, transno 4296038544 00000004:00080000:3.0:1713481296.553026:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132b43800, transno 4296038545 00000004:00080000:3.0:1713481296.553029:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620f480, transno 4296038546 00000004:00080000:3.0:1713481296.553032:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132b43b80, transno 4296038547 00000004:00080000:3.0:1713481296.553035:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798cb100, transno 4296038548 00000004:00080000:3.0:1713481296.553038:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798c9880, transno 4296038549 00000004:00080000:3.0:1713481296.553040:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b9b100, transno 4296038550 00000004:00080000:3.0:1713481296.553043:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132b42d80, transno 4296038551 00000004:00080000:3.0:1713481296.553045:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754fc000, transno 4296038552 00000004:00080000:3.0:1713481296.553048:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e315880, transno 4296038553 00000004:00080000:3.0:1713481296.553050:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df48a80, transno 4296038554 00000004:00080000:3.0:1713481296.553053:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe2f800, transno 4296038555 00000004:00080000:3.0:1713481296.553056:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007710b100, transno 4296038556 00000004:00080000:3.0:1713481296.553059:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881a7100, transno 4296038557 00000004:00080000:3.0:1713481296.553062:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881a4000, transno 4296038558 00000004:00080000:3.0:1713481296.553064:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120985f80, transno 4296038559 00000004:00080000:3.0:1713481296.553067:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077963800, transno 4296038560 00000004:00080000:3.0:1713481296.553069:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e065c00, transno 4296038561 00000004:00080000:3.0:1713481296.553072:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120144700, transno 4296038562 00000004:00080000:3.0:1713481296.553074:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794ca680, transno 4296038563 00000004:00080000:3.0:1713481296.553077:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801358bbb80, transno 4296038564 00000004:00080000:3.0:1713481296.553079:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120135180, transno 4296038565 00000004:00080000:3.0:1713481296.553082:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c8700, transno 4296038566 00000004:00080000:3.0:1713481296.553085:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083839180, transno 4296038567 00000004:00080000:3.0:1713481296.553087:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801358b9f80, transno 4296038568 00000004:00080000:3.0:1713481296.553090:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133b74e00, transno 4296038569 00000004:00080000:3.0:1713481296.553093:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd28a80, transno 4296038570 00000004:00080000:3.0:1713481296.553095:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120986a00, transno 4296038571 00000004:00080000:3.0:1713481296.553098:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800796ddf80, transno 4296038572 00000004:00080000:3.0:1713481296.553100:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007573b100, transno 4296038573 00000004:00080000:3.0:1713481296.553103:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bd8bb80, transno 4296038574 00000004:00080000:3.0:1713481296.553105:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a83100, transno 4296038575 00000004:00080000:3.0:1713481296.553108:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bd8b800, transno 4296038576 00000004:00080000:3.0:1713481296.553111:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008339d500, transno 4296038577 00000004:00080000:3.0:1713481296.553114:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134628000, transno 4296038578 00000004:00080000:3.0:1713481296.553117:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b02a00, transno 4296038579 00000004:00080000:3.0:1713481296.553137:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077199180, transno 4296038580 00000004:00080000:3.0:1713481296.553140:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782f9500, transno 4296038581 00000004:00080000:3.0:1713481296.553143:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086941500, transno 4296038582 00000004:00080000:3.0:1713481296.553145:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782f8380, transno 4296038583 00000004:00080000:3.0:1713481296.553148:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086940380, transno 4296038584 00000004:00080000:3.0:1713481296.553150:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086ec3480, transno 4296038585 00000004:00080000:3.0:1713481296.553153:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780ee680, transno 4296038586 00000004:00080000:3.0:1713481296.553156:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007814a680, transno 4296038587 00000004:00080000:3.0:1713481296.553159:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a93480, transno 4296038588 00000004:00080000:3.0:1713481296.553161:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dafc000, transno 4296038589 00000004:00080000:3.0:1713481296.553163:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e34a300, transno 4296038590 00000004:00080000:3.0:1713481296.553166:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e349f80, transno 4296038591 00000004:00080000:3.0:1713481296.553169:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007556c700, transno 4296038592 00000004:00080000:3.0:1713481296.553171:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007556ce00, transno 4296038593 00000004:00080000:3.0:1713481296.553174:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c03480, transno 4296038594 00000004:00080000:3.0:1713481296.553177:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096d7a300, transno 4296038595 00000004:00080000:3.0:1713481296.553180:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096d78700, transno 4296038596 00000004:00080000:3.0:1713481296.553182:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a91f80, transno 4296038597 00000004:00080000:3.0:1713481296.553185:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086b47100, transno 4296038598 00000004:00080000:3.0:1713481296.553188:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078149500, transno 4296038599 00000004:00080000:3.0:1713481296.553190:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098c43100, transno 4296038600 00000004:00080000:3.0:1713481296.553193:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e1fb80, transno 4296038601 00000004:00080000:3.0:1713481296.553195:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801358de300, transno 4296038602 00000004:00080000:3.0:1713481296.553198:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ae9f80, transno 4296038603 00000004:00080000:3.0:1713481296.553201:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d098e00, transno 4296038901 00000004:00080000:3.0:1713481296.553204:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a2a0380, transno 4296038966 00000004:00080000:3.0:1713481296.553206:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013676c000, transno 4296038967 00000004:00080000:3.0:1713481296.553209:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b2300, transno 4296038968 00000004:00080000:3.0:1713481296.553212:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec3f800, transno 4296038970 00000004:00080000:3.0:1713481296.553215:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed90000, transno 4296038971 00000004:00080000:3.0:1713481296.553218:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120039c00, transno 4296038972 00000004:00080000:3.0:1713481296.553220:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c00000, transno 4296038973 00000004:00080000:3.0:1713481296.553223:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089b20e00, transno 4296038974 00000004:00080000:3.0:1713481296.553226:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d11f80, transno 4296038975 00000004:00080000:3.0:1713481296.553228:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d10e00, transno 4296038976 00000004:00080000:3.0:1713481296.553231:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801209b6a00, transno 4296038977 00000004:00080000:3.0:1713481296.553234:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120074380, transno 4296038978 00000004:00080000:3.0:1713481296.553236:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d12d80, transno 4296038979 00000004:00080000:3.0:1713481296.553239:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078021500, transno 4296038980 00000004:00080000:3.0:1713481296.553242:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097717100, transno 4296038981 00000004:00080000:3.0:1713481296.553244:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de20700, transno 4296038982 00000004:00080000:3.0:1713481296.553247:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007819a680, transno 4296038983 00000004:00080000:3.0:1713481296.553249:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078198a80, transno 4296038984 00000004:00080000:3.0:1713481296.553252:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801209b7b80, transno 4296038985 00000004:00080000:3.0:1713481296.553254:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a97480, transno 4296038986 00000004:00080000:3.0:1713481296.553257:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783f8a80, transno 4296038987 00000004:00080000:3.0:1713481296.553260:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084836300, transno 4296038988 00000004:00080000:3.0:1713481296.553262:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a95f80, transno 4296038989 00000004:00080000:3.0:1713481296.553265:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ed93100, transno 4296038990 00000004:00080000:3.0:1713481296.553267:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5e300, transno 4296038991 00000004:00080000:3.0:1713481296.553270:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5dc00, transno 4296038992 00000004:00080000:3.0:1713481296.553273:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120405500, transno 4296038993 00000004:00080000:3.0:1713481296.553275:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728d7800, transno 4296038994 00000004:00080000:3.0:1713481296.553278:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099844380, transno 4296038995 00000004:00080000:3.0:1713481296.553280:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120405880, transno 4296038996 00000004:00080000:3.0:1713481296.553282:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787c5c00, transno 4296038997 00000004:00080000:3.0:1713481296.553285:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af42680, transno 4296038998 00000004:00080000:3.0:1713481296.553288:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af42a00, transno 4296038999 00000004:00080000:3.0:1713481296.553290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af43800, transno 4296039000 00000004:00080000:3.0:1713481296.553293:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5d880, transno 4296039001 00000004:00080000:3.0:1713481296.553296:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe7aa00, transno 4296039002 00000004:00080000:3.0:1713481296.553299:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b0f8e00, transno 4296039003 00000004:00080000:3.0:1713481296.553302:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdaca80, transno 4296039004 00000004:00080000:3.0:1713481296.553305:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdaf800, transno 4296039005 00000004:00080000:3.0:1713481296.553308:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d210380, transno 4296039006 00000004:00080000:3.0:1713481296.553310:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d213800, transno 4296039007 00000004:00080000:3.0:1713481296.553313:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d210a80, transno 4296039008 00000004:00080000:3.0:1713481296.553315:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdaf100, transno 4296039009 00000004:00080000:3.0:1713481296.553318:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684f480, transno 4296039010 00000004:00080000:3.0:1713481296.553321:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783f9f80, transno 4296039012 00000004:00080000:3.0:1713481296.553323:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d73100, transno 4296039013 00000004:00080000:3.0:1713481296.553326:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5c700, transno 4296039014 00000004:00080000:3.0:1713481296.553328:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783fb480, transno 4296039015 00000004:00080000:3.0:1713481296.553330:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684ea00, transno 4296039016 00000004:00080000:3.0:1713481296.553333:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5f800, transno 4296039017 00000004:00080000:3.0:1713481296.553335:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800786d5c00, transno 4296039018 00000004:00080000:3.0:1713481296.553338:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9ff100, transno 4296039019 00000004:00080000:3.0:1713481296.553340:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9fc000, transno 4296039020 00000004:00080000:3.0:1713481296.553342:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077014700, transno 4296039021 00000004:00080000:3.0:1713481296.553345:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d73480, transno 4296039023 00000004:00080000:3.0:1713481296.553347:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007aa5d180, transno 4296039024 00000004:00080000:3.0:1713481296.553349:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684d880, transno 4296039025 00000004:00080000:3.0:1713481296.553351:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d72d80, transno 4296039026 00000004:00080000:3.0:1713481296.553354:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ddbb80, transno 4296039027 00000004:00080000:3.0:1713481296.553357:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780d9500, transno 4296039028 00000004:00080000:3.0:1713481296.553359:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684fb80, transno 4296039029 00000004:00080000:3.0:1713481296.553362:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdadc00, transno 4296039030 00000004:00080000:3.0:1713481296.553365:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120405c00, transno 4296039031 00000004:00080000:3.0:1713481296.553368:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684d500, transno 4296039032 00000004:00080000:3.0:1713481296.553370:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdac700, transno 4296039033 00000004:00080000:3.0:1713481296.553373:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7d180, transno 4296039034 00000004:00080000:3.0:1713481296.553375:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120406d80, transno 4296039035 00000004:00080000:3.0:1713481296.553378:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e89880, transno 4296039036 00000004:00080000:3.0:1713481296.553380:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e88700, transno 4296039037 00000004:00080000:3.0:1713481296.553383:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5ea00, transno 4296039038 00000004:00080000:3.0:1713481296.553385:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728d4a80, transno 4296039039 00000004:00080000:3.0:1713481296.553388:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090407800, transno 4296039040 00000004:00080000:3.0:1713481296.553391:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e8aa00, transno 4296039041 00000004:00080000:3.0:1713481296.553393:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e6bb80, transno 4296039042 00000004:00080000:3.0:1713481296.553396:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084837800, transno 4296039043 00000004:00080000:3.0:1713481296.553398:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684c700, transno 4296039045 00000004:00080000:3.0:1713481296.553401:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e88a80, transno 4296039046 00000004:00080000:3.0:1713481296.553403:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d71500, transno 4296039047 00000004:00080000:3.0:1713481296.553406:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d71c00, transno 4296039048 00000004:00080000:3.0:1713481296.553408:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684dc00, transno 4296039049 00000004:00080000:3.0:1713481296.553410:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007727f800, transno 4296039050 00000004:00080000:3.0:1713481296.553414:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135847b80, transno 4296039051 00000004:00080000:3.0:1713481296.553416:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d72a00, transno 4296039052 00000004:00080000:3.0:1713481296.553419:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078d70a80, transno 4296039053 00000004:00080000:3.0:1713481296.553422:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136178380, transno 4296039054 00000004:00080000:3.0:1713481296.553424:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e5500, transno 4296039055 00000004:00080000:3.0:1713481296.553427:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e4e00, transno 4296039056 00000004:00080000:3.0:1713481296.553430:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a9ac700, transno 4296039057 00000004:00080000:3.0:1713481296.553432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b4f800, transno 4296039058 00000004:00080000:3.0:1713481296.553435:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b4ca80, transno 4296039059 00000004:00080000:3.0:1713481296.553437:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5f480, transno 4296039061 00000004:00080000:3.0:1713481296.553440:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5df80, transno 4296039062 00000004:00080000:3.0:1713481296.553443:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5c000, transno 4296039063 00000004:00080000:3.0:1713481296.553446:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008afee300, transno 4296039064 00000004:00080000:3.0:1713481296.553449:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800755a7b80, transno 4296039065 00000004:00080000:3.0:1713481296.553451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097e85180, transno 4296039066 00000004:00080000:3.0:1713481296.553454:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800898a6a00, transno 4296039067 00000004:00080000:3.0:1713481296.553457:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec41500, transno 4296039068 00000004:00080000:3.0:1713481296.553460:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bcb480, transno 4296039069 00000004:00080000:3.0:1713481296.553462:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d3ce00, transno 4296039070 00000004:00080000:3.0:1713481296.553465:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da47b80, transno 4296039071 00000004:00080000:3.0:1713481296.553467:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bc8e00, transno 4296039072 00000004:00080000:3.0:1713481296.553471:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013617b100, transno 4296039073 00000004:00080000:3.0:1713481296.553473:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fae8000, transno 4296039074 00000004:00080000:3.0:1713481296.553476:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b363480, transno 4296039075 00000004:00080000:3.0:1713481296.553478:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e9d880, transno 4296039076 00000004:00080000:3.0:1713481296.553481:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086bcb800, transno 4296039077 00000004:00080000:3.0:1713481296.553483:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012069aa00, transno 4296039078 00000004:00080000:3.0:1713481296.553485:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009406b480, transno 4296039079 00000004:00080000:3.0:1713481296.553488:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c897b80, transno 4296039080 00000004:00080000:3.0:1713481296.553491:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d35500, transno 4296039081 00000004:00080000:3.0:1713481296.553493:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a868700, transno 4296039082 00000004:00080000:3.0:1713481296.553495:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2bf800, transno 4296039083 00000004:00080000:3.0:1713481296.553498:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a868e00, transno 4296039085 00000004:00080000:3.0:1713481296.553501:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ec6680, transno 4296039086 00000004:00080000:3.0:1713481296.553503:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ab4000, transno 4296039087 00000004:00080000:3.0:1713481296.553506:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a90380, transno 4296039088 00000004:00080000:3.0:1713481296.553508:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ac4000, transno 4296039089 00000004:00080000:3.0:1713481296.553511:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120699180, transno 4296039090 00000004:00080000:3.0:1713481296.553513:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072ab4380, transno 4296039091 00000004:00080000:3.0:1713481296.553515:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092b9a300, transno 4296039092 00000004:00080000:3.0:1713481296.553518:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007807b100, transno 4296039093 00000004:00080000:3.0:1713481296.553521:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120245c00, transno 4296039094 00000004:00080000:3.0:1713481296.553524:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082021180, transno 4296039095 00000004:00080000:3.0:1713481296.553526:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082020700, transno 4296039096 00000004:00080000:3.0:1713481296.553529:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bf1500, transno 4296039097 00000004:00080000:3.0:1713481296.553532:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013609f800, transno 4296039098 00000004:00080000:3.0:1713481296.553534:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0f3b80, transno 4296039099 00000004:00080000:3.0:1713481296.553537:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e35c00, transno 4296039100 00000004:00080000:3.0:1713481296.553539:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c2fd500, transno 4296039101 00000004:00080000:3.0:1713481296.553542:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798c9180, transno 4296039102 00000004:00080000:3.0:1713481296.553545:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132b41180, transno 4296039103 00000004:00080000:3.0:1713481296.553547:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132b42680, transno 4296039104 00000004:00080000:3.0:1713481296.553550:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e369500, transno 4296039105 00000004:00080000:3.0:1713481296.553553:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077109f80, transno 4296039106 00000004:00080000:3.0:1713481296.553556:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798caa00, transno 4296039107 00000004:00080000:3.0:1713481296.553559:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013620dc00, transno 4296039108 00000004:00080000:3.0:1713481296.553561:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085caca80, transno 4296039109 00000004:00080000:3.0:1713481296.553563:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088365180, transno 4296039110 00000004:00080000:3.0:1713481296.553566:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009676b800, transno 4296039111 00000004:00080000:3.0:1713481296.553569:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009676b480, transno 4296039112 00000004:00080000:3.0:1713481296.553571:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081691c00, transno 4296039113 00000004:00080000:3.0:1713481296.553574:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4b1c00, transno 4296039114 00000004:00080000:3.0:1713481296.553577:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299aa00, transno 4296039115 00000004:00080000:3.0:1713481296.553579:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0bdc00, transno 4296039116 00000004:00080000:3.0:1713481296.553582:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077069880, transno 4296039117 00000004:00080000:3.0:1713481296.553585:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077960000, transno 4296039118 00000004:00080000:3.0:1713481296.553587:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120144e00, transno 4296039119 00000004:00080000:3.0:1713481296.553590:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078706680, transno 4296039120 00000004:00080000:3.0:1713481296.553592:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bd8a300, transno 4296039121 00000004:00080000:3.0:1713481296.553595:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e317480, transno 4296039122 00000004:00080000:3.0:1713481296.553597:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e317b80, transno 4296039123 00000004:00080000:3.0:1713481296.553601:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e314e00, transno 4296039124 00000004:00080000:3.0:1713481296.553603:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c34a80, transno 4296039125 00000004:00080000:3.0:1713481296.553606:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ecbb80, transno 4296039126 00000004:00080000:3.0:1713481296.553609:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a49880, transno 4296039127 00000004:00080000:3.0:1713481296.553612:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120250a80, transno 4296039128 00000004:00080000:3.0:1713481296.553614:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a93100, transno 4296039129 00000004:00080000:3.0:1713481296.553617:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133c51500, transno 4296039130 00000004:00080000:3.0:1713481296.553620:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e348000, transno 4296039131 00000004:00080000:3.0:1713481296.553622:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077a80700, transno 4296039132 00000004:00080000:3.0:1713481296.553625:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b2d180, transno 4296039133 00000004:00080000:3.0:1713481296.553627:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078617480, transno 4296039134 00000004:00080000:3.0:1713481296.553630:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120251c00, transno 4296039135 00000004:00080000:3.0:1713481296.553633:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de2ed80, transno 4296039136 00000004:00080000:3.0:1713481296.553635:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de2d180, transno 4296039137 00000004:00080000:3.0:1713481296.553638:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081e1d880, transno 4296039138 00000004:00080000:3.0:1713481296.553640:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201a7800, transno 4296039139 00000004:00080000:3.0:1713481296.553643:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201a6680, transno 4296039140 00000004:00080000:3.0:1713481296.553645:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201a6a00, transno 4296039141 00000004:00080000:3.0:1713481296.553648:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201a6300, transno 4296039142 00000004:00080000:3.0:1713481296.553650:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077af2a00, transno 4296039143 00000004:00080000:3.0:1713481296.553653:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a49180, transno 4296039144 00000004:00080000:3.0:1713481296.553656:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076a91180, transno 4296039145 00000004:00080000:3.0:1713481296.553658:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c99c00, transno 4296039146 00000004:00080000:3.0:1713481296.553661:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800772f6d80, transno 4296039147 00000004:00080000:3.0:1713481296.553663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007836f800, transno 4296039148 00000004:00080000:3.0:1713481296.553679:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077199f80, transno 4296039159 00000004:00080000:3.0:1713481296.553682:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a921f80, transno 4296039183 00000004:00080000:3.0:1713481296.553684:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009232a680, transno 4296039209 00000004:00080000:3.0:1713481296.553686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007287f480, transno 4296039689 00000004:00080000:3.0:1713481296.553690:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007287ed80, transno 4296039690 00000004:00080000:3.0:1713481296.553693:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009090e680, transno 4296039691 00000004:00080000:3.0:1713481296.553696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008399ea00, transno 4296039692 00000004:00080000:3.0:1713481296.553699:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120112d80, transno 4296039693 00000004:00080000:3.0:1713481296.553701:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008399ed80, transno 4296039694 00000004:00080000:3.0:1713481296.553703:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120505180, transno 4296039695 00000004:00080000:3.0:1713481296.553706:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084820000, transno 4296039696 00000004:00080000:3.0:1713481296.553709:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078706a00, transno 4296039698 00000004:00080000:3.0:1713481296.553711:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084301f80, transno 4296039699 00000004:00080000:3.0:1713481296.553714:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009090d880, transno 4296039700 00000004:00080000:3.0:1713481296.553717:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097b4d500, transno 4296039701 00000004:00080000:3.0:1713481296.553719:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084300e00, transno 4296039702 00000004:00080000:3.0:1713481296.553723:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081ecc000, transno 4296039703 00000004:00080000:3.0:1713481296.553726:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086ec3800, transno 4296039704 00000004:00080000:3.0:1713481296.553728:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078397100, transno 4296039705 00000004:00080000:3.0:1713481296.553731:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e725500, transno 4296039706 00000004:00080000:3.0:1713481296.553734:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075756300, transno 4296039707 00000004:00080000:3.0:1713481296.553736:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f84ea00, transno 4296039708 00000004:00080000:3.0:1713481296.553739:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078793800, transno 4296039709 00000004:00080000:3.0:1713481296.553741:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122b21c00, transno 4296039710 00000004:00080000:3.0:1713481296.553744:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5d880, transno 4296039711 00000004:00080000:3.0:1713481296.553746:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5df80, transno 4296039712 00000004:00080000:3.0:1713481296.553748:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ee5e300, transno 4296039713 00000004:00080000:3.0:1713481296.553751:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ae0700, transno 4296039714 00000004:00080000:3.0:1713481296.553755:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800891b4e00, transno 4296039715 00000004:00080000:3.0:1713481296.553758:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ae2d80, transno 4296039716 00000004:00080000:3.0:1713481296.553760:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120412a00, transno 4296039717 00000004:00080000:3.0:1713481296.553763:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ae3480, transno 4296039718 00000004:00080000:3.0:1713481296.553765:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f935880, transno 4296039719 00000004:00080000:3.0:1713481296.553768:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120413b80, transno 4296039720 00000004:00080000:3.0:1713481296.553770:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079564700, transno 4296039721 00000004:00080000:3.0:1713481296.553773:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b58000, transno 4296039722 00000004:00080000:3.0:1713481296.553776:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e1d9880, transno 4296039723 00000004:00080000:3.0:1713481296.553779:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075756d80, transno 4296039724 00000004:00080000:3.0:1713481296.553781:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b71500, transno 4296039725 00000004:00080000:3.0:1713481296.553784:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2ab100, transno 4296039726 00000004:00080000:3.0:1713481296.553787:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081d97100, transno 4296039727 00000004:00080000:3.0:1713481296.553789:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135b5bb80, transno 4296039728 00000004:00080000:3.0:1713481296.553792:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124058000, transno 4296039729 00000004:00080000:3.0:1713481296.553795:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a922d80, transno 4296039730 00000004:00080000:3.0:1713481296.553797:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aa0a80, transno 4296039731 00000004:00080000:3.0:1713481296.553800:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a920a80, transno 4296039732 00000004:00080000:3.0:1713481296.553802:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150c700, transno 4296039733 00000004:00080000:3.0:1713481296.553805:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a923800, transno 4296039734 00000004:00080000:3.0:1713481296.553807:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e55c700, transno 4296039735 00000004:00080000:3.0:1713481296.553810:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b8f800, transno 4296039736 00000004:00080000:3.0:1713481296.553813:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133c52300, transno 4296039737 00000004:00080000:3.0:1713481296.553815:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa4e00, transno 4296039738 00000004:00080000:3.0:1713481296.553818:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0baa00, transno 4296039739 00000004:00080000:3.0:1713481296.553821:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007841c380, transno 4296039740 00000004:00080000:3.0:1713481296.553823:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec50e00, transno 4296039741 00000004:00080000:3.0:1713481296.553825:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008150f100, transno 4296039742 00000004:00080000:3.0:1713481296.553828:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008daa6a00, transno 4296039743 00000004:00080000:3.0:1713481296.553831:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ec50380, transno 4296039744 00000004:00080000:3.0:1713481296.553834:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075546300, transno 4296039745 00000004:00080000:3.0:1713481296.553836:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2a8380, transno 4296039746 00000004:00080000:3.0:1713481296.553839:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800967cc000, transno 4296039747 00000004:00080000:3.0:1713481296.553841:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800967cca80, transno 4296039748 00000004:00080000:3.0:1713481296.553844:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800967cd180, transno 4296039749 00000004:00080000:3.0:1713481296.553846:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007992f100, transno 4296039750 00000004:00080000:3.0:1713481296.553849:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007712aa00, transno 4296039751 00000004:00080000:3.0:1713481296.553852:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078375f80, transno 4296039752 00000004:00080000:3.0:1713481296.553855:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078377480, transno 4296039753 00000004:00080000:3.0:1713481296.553857:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801205adc00, transno 4296039754 00000004:00080000:3.0:1713481296.553860:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d15bb80, transno 4296039755 00000004:00080000:3.0:1713481296.553863:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36ce00, transno 4296039756 00000004:00080000:3.0:1713481296.553866:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012062f100, transno 4296039757 00000004:00080000:3.0:1713481296.553868:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e36d180, transno 4296039758 00000004:00080000:3.0:1713481296.553870:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007812d880, transno 4296039759 00000004:00080000:3.0:1713481296.553873:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007712b480, transno 4296039760 00000004:00080000:3.0:1713481296.553875:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007812f100, transno 4296039761 00000004:00080000:3.0:1713481296.553878:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007812c380, transno 4296039762 00000004:00080000:3.0:1713481296.553881:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201e9880, transno 4296039763 00000004:00080000:3.0:1713481296.553883:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201ead80, transno 4296039764 00000004:00080000:3.0:1713481296.553886:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007812f480, transno 4296039765 00000004:00080000:3.0:1713481296.553888:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013499ce00, transno 4296039766 00000004:00080000:3.0:1713481296.553891:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e33fb80, transno 4296039767 00000004:00080000:3.0:1713481296.553894:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015dc00, transno 4296039768 00000004:00080000:3.0:1713481296.553896:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c4e00, transno 4296039769 00000004:00080000:3.0:1713481296.553899:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a16a00, transno 4296039770 00000004:00080000:3.0:1713481296.553902:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012015c700, transno 4296039771 00000004:00080000:3.0:1713481296.553905:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a15500, transno 4296039772 00000004:00080000:3.0:1713481296.553908:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c0700, transno 4296039773 00000004:00080000:3.0:1713481296.553910:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728d4e00, transno 4296039774 00000004:00080000:3.0:1713481296.553913:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a002a00, transno 4296039775 00000004:00080000:3.0:1713481296.553916:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdaf480, transno 4296039776 00000004:00080000:3.0:1713481296.553918:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a002d80, transno 4296039777 00000004:00080000:3.0:1713481296.553920:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdae300, transno 4296039778 00000004:00080000:3.0:1713481296.553923:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdac380, transno 4296039779 00000004:00080000:3.0:1713481296.553925:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdaed80, transno 4296039780 00000004:00080000:3.0:1713481296.553928:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787c6300, transno 4296039782 00000004:00080000:3.0:1713481296.553931:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787c7b80, transno 4296039783 00000004:00080000:3.0:1713481296.553934:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684f800, transno 4296039784 00000004:00080000:3.0:1713481296.553936:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007684d180, transno 4296039785 00000004:00080000:3.0:1713481296.553939:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d211f80, transno 4296039786 00000004:00080000:3.0:1713481296.553941:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fdad500, transno 4296039787 00000004:00080000:3.0:1713481296.553944:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae9880, transno 4296039788 00000004:00080000:3.0:1713481296.553947:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121aeb480, transno 4296039789 00000004:00080000:3.0:1713481296.553950:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202ca680, transno 4296039790 00000004:00080000:3.0:1713481296.553952:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202cbb80, transno 4296039791 00000004:00080000:3.0:1713481296.553955:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9fe680, transno 4296039792 00000004:00080000:3.0:1713481296.553958:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121d89880, transno 4296039793 00000004:00080000:3.0:1713481296.553960:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078334000, transno 4296039794 00000004:00080000:3.0:1713481296.553963:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121d8ad80, transno 4296039795 00000004:00080000:3.0:1713481296.553966:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a419f80, transno 4296039796 00000004:00080000:3.0:1713481296.553968:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136152680, transno 4296039797 00000004:00080000:3.0:1713481296.553971:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de21500, transno 4296039798 00000004:00080000:3.0:1713481296.553973:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009de23800, transno 4296039799 00000004:00080000:3.0:1713481296.553976:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801209b4e00, transno 4296039800 00000004:00080000:3.0:1713481296.553978:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df49f80, transno 4296039801 00000004:00080000:3.0:1713481296.553981:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007df48380, transno 4296039802 00000004:00080000:3.0:1713481296.553984:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135906a00, transno 4296039803 00000004:00080000:3.0:1713481296.553987:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133be2680, transno 4296039804 00000004:00080000:3.0:1713481296.553989:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121aea300, transno 4296039805 00000004:00080000:3.0:1713481296.553992:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e27b480, transno 4296039806 00000004:00080000:3.0:1713481296.553995:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a1e2a00, transno 4296039807 00000004:00080000:3.0:1713481296.553998:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007286dc00, transno 4296039808 00000004:00080000:3.0:1713481296.554001:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120076a00, transno 4296039809 00000004:00080000:3.0:1713481296.554003:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae8e00, transno 4296039810 00000004:00080000:3.0:1713481296.554006:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078340380, transno 4296039811 00000004:00080000:3.0:1713481296.554010:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787ff480, transno 4296039812 00000004:00080000:3.0:1713481296.554013:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787fed80, transno 4296039813 00000004:00080000:3.0:1713481296.554016:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d285500, transno 4296039814 00000004:00080000:3.0:1713481296.554018:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007866c380, transno 4296039815 00000004:00080000:3.0:1713481296.554021:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078193b80, transno 4296039816 00000004:00080000:3.0:1713481296.554023:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007866f480, transno 4296039817 00000004:00080000:3.0:1713481296.554026:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007866d180, transno 4296039818 00000004:00080000:3.0:1713481296.554029:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007556ed80, transno 4296039819 00000004:00080000:3.0:1713481296.554031:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075442d80, transno 4296039820 00000004:00080000:3.0:1713481296.554034:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728eed80, transno 4296039821 00000004:00080000:3.0:1713481296.554036:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d286d80, transno 4296039822 00000004:00080000:3.0:1713481296.554039:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202c9c00, transno 4296039823 00000004:00080000:3.0:1713481296.554041:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007810ed80, transno 4296039824 00000004:00080000:3.0:1713481296.554044:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086c04000, transno 4296039825 00000004:00080000:3.0:1713481296.554046:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b78e00, transno 4296039826 00000004:00080000:3.0:1713481296.554049:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086c06300, transno 4296039827 00000004:00080000:3.0:1713481296.554053:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bff480, transno 4296039828 00000004:00080000:3.0:1713481296.554055:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a43b80, transno 4296039829 00000004:00080000:3.0:1713481296.554057:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099198e00, transno 4296039830 00000004:00080000:3.0:1713481296.554060:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099198a80, transno 4296039831 00000004:00080000:3.0:1713481296.554062:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009919ad80, transno 4296039832 00000004:00080000:3.0:1713481296.554065:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b7a680, transno 4296039833 00000004:00080000:3.0:1713481296.554068:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078199180, transno 4296039834 00000004:00080000:3.0:1713481296.554071:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120113100, transno 4296039835 00000004:00080000:3.0:1713481296.554074:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b0a300, transno 4296039836 00000004:00080000:3.0:1713481296.554077:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883e8a80, transno 4296039837 00000004:00080000:3.0:1713481296.554080:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120112a00, transno 4296039838 00000004:00080000:3.0:1713481296.554082:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783f8000, transno 4296039839 00000004:00080000:3.0:1713481296.554085:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a8b480, transno 4296039840 00000004:00080000:3.0:1713481296.554088:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089b20a80, transno 4296039841 00000004:00080000:3.0:1713481296.554090:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013584b480, transno 4296039842 00000004:00080000:3.0:1713481296.554094:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083a3fb80, transno 4296039843 00000004:00080000:3.0:1713481296.554096:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ead80, transno 4296039844 00000004:00080000:3.0:1713481296.554099:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e8380, transno 4296039845 00000004:00080000:3.0:1713481296.554102:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728eb480, transno 4296039846 00000004:00080000:3.0:1713481296.554104:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728eb100, transno 4296039847 00000004:00080000:3.0:1713481296.554106:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be0e00, transno 4296039848 00000004:00080000:3.0:1713481296.554109:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086c04e00, transno 4296039849 00000004:00080000:3.0:1713481296.554112:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136150000, transno 4296039850 00000004:00080000:3.0:1713481296.554115:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798f8380, transno 4296039851 00000004:00080000:3.0:1713481296.554135:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956c000, transno 4296039852 00000004:00080000:3.0:1713481296.554139:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c2d80, transno 4296039853 00000004:00080000:3.0:1713481296.554142:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956df80, transno 4296039854 00000004:00080000:3.0:1713481296.554144:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136153b80, transno 4296039855 00000004:00080000:3.0:1713481296.554147:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800798fa300, transno 4296039856 00000004:00080000:3.0:1713481296.554150:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd29500, transno 4296039857 00000004:00080000:3.0:1713481296.554153:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078e5a300, transno 4296039858 00000004:00080000:3.0:1713481296.554155:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e406680, transno 4296039859 00000004:00080000:3.0:1713481296.554158:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120111c00, transno 4296039860 00000004:00080000:3.0:1713481296.554160:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007970bb80, transno 4296039861 00000004:00080000:3.0:1713481296.554163:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007836ed80, transno 4296039862 00000004:00080000:3.0:1713481296.554166:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120111500, transno 4296039863 00000004:00080000:3.0:1713481296.554169:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098359f80, transno 4296039864 00000004:00080000:3.0:1713481296.554172:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0baa00, transno 4296039865 00000004:00080000:3.0:1713481296.554174:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0b8a80, transno 4296039866 00000004:00080000:3.0:1713481296.554177:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0b9c00, transno 4296039867 00000004:00080000:3.0:1713481296.554179:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0bb800, transno 4296039868 00000004:00080000:3.0:1713481296.554182:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012069bb80, transno 4296039869 00000004:00080000:3.0:1713481296.554184:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a23a680, transno 4296039870 00000004:00080000:3.0:1713481296.554187:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c1f80, transno 4296039871 00000004:00080000:3.0:1713481296.554190:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078daaa00, transno 4296039872 00000004:00080000:3.0:1713481296.554193:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784d6d80, transno 4296039873 00000004:00080000:3.0:1713481296.554196:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135844e00, transno 4296039874 00000004:00080000:3.0:1713481296.554199:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083450380, transno 4296039875 00000004:00080000:3.0:1713481296.554201:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135846d80, transno 4296039876 00000004:00080000:3.0:1713481296.554204:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299d180, transno 4296039877 00000004:00080000:3.0:1713481296.554206:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083451c00, transno 4296039878 00000004:00080000:3.0:1713481296.554209:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089a5d500, transno 4296039879 00000004:00080000:3.0:1713481296.554212:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881aca80, transno 4296039880 00000004:00080000:3.0:1713481296.554215:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011da4f100, transno 4296039881 00000004:00080000:3.0:1713481296.554218:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072b2c000, transno 4296039882 00000004:00080000:3.0:1713481296.554221:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120be0700, transno 4296039883 00000004:00080000:3.0:1713481296.554224:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120699f80, transno 4296039884 00000004:00080000:3.0:1713481296.554226:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796df80, transno 4296039885 00000004:00080000:3.0:1713481296.554229:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096762680, transno 4296039886 00000004:00080000:3.0:1713481296.554231:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096761180, transno 4296039887 00000004:00080000:3.0:1713481296.554234:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012069a300, transno 4296039888 00000004:00080000:3.0:1713481296.554236:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800786d5880, transno 4296039889 00000004:00080000:3.0:1713481296.554238:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800773c1880, transno 4296039890 00000004:00080000:3.0:1713481296.554241:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994dc00, transno 4296039891 00000004:00080000:3.0:1713481296.554244:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007994ce00, transno 4296039892 00000004:00080000:3.0:1713481296.554246:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f987100, transno 4296039893 00000004:00080000:3.0:1713481296.554249:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e274000, transno 4296039894 00000004:00080000:3.0:1713481296.554252:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007db7ca80, transno 4296039895 00000004:00080000:3.0:1713481296.554254:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f985f80, transno 4296039896 00000004:00080000:3.0:1713481296.554257:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880082305880, transno 4296039897 00000004:00080000:3.0:1713481296.554260:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a118a80, transno 4296039898 00000004:00080000:3.0:1713481296.554262:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800881a4a80, transno 4296039899 00000004:00080000:3.0:1713481296.554265:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130434000, transno 4296039900 00000004:00080000:3.0:1713481296.554268:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800786da300, transno 4296039901 00000004:00080000:3.0:1713481296.554271:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075545500, transno 4296039902 00000004:00080000:3.0:1713481296.554274:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075545c00, transno 4296039903 00000004:00080000:3.0:1713481296.554277:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075544e00, transno 4296039904 00000004:00080000:3.0:1713481296.554279:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075545180, transno 4296039905 00000004:00080000:3.0:1713481296.554282:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a1d500, transno 4296039906 00000004:00080000:3.0:1713481296.554284:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800771e9500, transno 4296039907 00000004:00080000:3.0:1713481296.554287:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075546680, transno 4296039908 00000004:00080000:3.0:1713481296.554290:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007720df80, transno 4296039909 00000004:00080000:3.0:1713481296.554292:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a8000, transno 4296039910 00000004:00080000:3.0:1713481296.554295:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785ab800, transno 4296039911 00000004:00080000:3.0:1713481296.554298:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083b87480, transno 4296039912 00000004:00080000:3.0:1713481296.554301:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe7bb80, transno 4296039913 00000004:00080000:3.0:1713481296.554304:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a3db480, transno 4296039915 00000004:00080000:3.0:1713481296.554306:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcd9500, transno 4296039916 00000004:00080000:3.0:1713481296.554309:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090406300, transno 4296039917 00000004:00080000:3.0:1713481296.554312:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077129500, transno 4296039918 00000004:00080000:3.0:1713481296.554314:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f9fce00, transno 4296039919 00000004:00080000:3.0:1713481296.554316:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077970a80, transno 4296039920 00000004:00080000:3.0:1713481296.554318:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d12a00, transno 4296039921 00000004:00080000:3.0:1713481296.554321:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013499ca80, transno 4296039922 00000004:00080000:3.0:1713481296.554323:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d12300, transno 4296039923 00000004:00080000:3.0:1713481296.554326:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075440e00, transno 4296039924 00000004:00080000:3.0:1713481296.554329:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a0000, transno 4296039925 00000004:00080000:3.0:1713481296.554331:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800823a0380, transno 4296039926 00000004:00080000:3.0:1713481296.554334:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079a41500, transno 4296039927 00000004:00080000:3.0:1713481296.554337:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089b23b80, transno 4296039928 00000004:00080000:3.0:1713481296.554339:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dda0e00, transno 4296039929 00000004:00080000:3.0:1713481296.554342:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008409c000, transno 4296039930 00000004:00080000:3.0:1713481296.554345:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098f88e00, transno 4296039931 00000004:00080000:3.0:1713481296.554347:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a69180, transno 4296039932 00000004:00080000:3.0:1713481296.554350:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956c700, transno 4296039933 00000004:00080000:3.0:1713481296.554353:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e178e00, transno 4296039934 00000004:00080000:3.0:1713481296.554356:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084970000, transno 4296039935 00000004:00080000:3.0:1713481296.554359:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086965f80, transno 4296039936 00000004:00080000:3.0:1713481296.554361:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078337480, transno 4296039937 00000004:00080000:3.0:1713481296.554364:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e3b80, transno 4296039938 00000004:00080000:3.0:1713481296.554366:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a0e1180, transno 4296039939 00000004:00080000:3.0:1713481296.554369:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202ca300, transno 4296039940 00000004:00080000:3.0:1713481296.554371:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c2a00, transno 4296039941 00000004:00080000:3.0:1713481296.554374:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728ea680, transno 4296039942 00000004:00080000:3.0:1713481296.554376:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c1f80, transno 4296039943 00000004:00080000:3.0:1713481296.554379:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c0a80, transno 4296039944 00000004:00080000:3.0:1713481296.554382:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133a6aa00, transno 4296039945 00000004:00080000:3.0:1713481296.554385:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078181500, transno 4296039946 00000004:00080000:3.0:1713481296.554387:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077155180, transno 4296039947 00000004:00080000:3.0:1713481296.554390:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931e680, transno 4296039948 00000004:00080000:3.0:1713481296.554392:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931dc00, transno 4296039949 00000004:00080000:3.0:1713481296.554394:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931df80, transno 4296039950 00000004:00080000:3.0:1713481296.554396:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931ce00, transno 4296039951 00000004:00080000:3.0:1713481296.554399:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078541880, transno 4296039952 00000004:00080000:3.0:1713481296.554401:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008931f800, transno 4296039953 00000004:00080000:3.0:1713481296.554404:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072844380, transno 4296039954 00000004:00080000:3.0:1713481296.554407:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aa3b80, transno 4296039955 00000004:00080000:3.0:1713481296.554409:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130434a80, transno 4296039956 00000004:00080000:3.0:1713481296.554412:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a118000, transno 4296039957 00000004:00080000:3.0:1713481296.554415:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079b71880, transno 4296039958 00000004:00080000:3.0:1713481296.554418:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a11b100, transno 4296039959 00000004:00080000:3.0:1713481296.554420:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a11ad80, transno 4296039960 00000004:00080000:3.0:1713481296.554422:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081566a00, transno 4296039961 00000004:00080000:3.0:1713481296.554425:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800728e9180, transno 4296039962 00000004:00080000:3.0:1713481296.554428:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920b9180, transno 4296039963 00000004:00080000:3.0:1713481296.554432:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880089881c00, transno 4296039964 00000004:00080000:3.0:1713481296.554435:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072a49f80, transno 4296039965 00000004:00080000:3.0:1713481296.554438:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dafca80, transno 4296039966 00000004:00080000:3.0:1713481296.554440:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007da25180, transno 4296039967 00000004:00080000:3.0:1713481296.554443:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078619500, transno 4296039968 00000004:00080000:3.0:1713481296.554445:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078618700, transno 4296039969 00000004:00080000:3.0:1713481296.554448:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099847480, transno 4296039970 00000004:00080000:3.0:1713481296.554451:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099844000, transno 4296039972 00000004:00080000:3.0:1713481296.554454:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099844e00, transno 4296039974 00000004:00080000:3.0:1713481296.554456:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007861b480, transno 4296039975 00000004:00080000:3.0:1713481296.554458:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120551880, transno 4296039976 00000004:00080000:3.0:1713481296.554461:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092916d80, transno 4296039977 00000004:00080000:3.0:1713481296.554464:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078c70a80, transno 4296039978 00000004:00080000:3.0:1713481296.554467:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce4380, transno 4296039979 00000004:00080000:3.0:1713481296.554469:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880083b85500, transno 4296039981 00000004:00080000:3.0:1713481296.554472:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801209a7100, transno 4296039982 00000004:00080000:3.0:1713481296.554474:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086941f80, transno 4296039983 00000004:00080000:3.0:1713481296.554476:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007956d880, transno 4296039984 00000004:00080000:3.0:1713481296.554479:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce6a00, transno 4296039985 00000004:00080000:3.0:1713481296.554482:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787fe680, transno 4296039986 00000004:00080000:3.0:1713481296.554484:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800787fea00, transno 4296039987 00000004:00080000:3.0:1713481296.554487:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202c9880, transno 4296039988 00000004:00080000:3.0:1713481296.554490:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078790700, transno 4296039990 00000004:00080000:3.0:1713481296.554492:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dcd9880, transno 4296039991 00000004:00080000:3.0:1713481296.554495:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008399c000, transno 4296039992 00000004:00080000:3.0:1713481296.554497:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007736e300, transno 4296039993 00000004:00080000:3.0:1713481296.554500:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880075547480, transno 4296039995 00000004:00080000:3.0:1713481296.554502:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007dc8aa00, transno 4296039996 00000004:00080000:3.0:1713481296.554505:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130437480, transno 4296039997 00000004:00080000:3.0:1713481296.554507:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007de11880, transno 4296039998 00000004:00080000:3.0:1713481296.554511:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c0380, transno 4296040000 00000004:00080000:3.0:1713481296.554513:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800784c1180, transno 4296040001 00000004:00080000:3.0:1713481296.554516:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079567480, transno 4296040002 00000004:00080000:3.0:1713481296.554519:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801322a6a00, transno 4296040003 00000004:00080000:3.0:1713481296.554521:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a0380, transno 4296040006 00000004:00080000:3.0:1713481296.554523:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086aa0380, transno 4296040007 00000004:00080000:3.0:1713481296.554526:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e228000, transno 4296040008 00000004:00080000:3.0:1713481296.554528:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072864700, transno 4296040009 00000004:00080000:3.0:1713481296.554531:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2a9f80, transno 4296040010 00000004:00080000:3.0:1713481296.554533:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007796ce00, transno 4296040011 00000004:00080000:3.0:1713481296.554536:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e2ab480, transno 4296040012 00000004:00080000:3.0:1713481296.554538:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800815c5f80, transno 4296040013 00000004:00080000:3.0:1713481296.554540:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f70a80, transno 4296040015 00000004:00080000:3.0:1713481296.554542:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a922680, transno 4296040016 00000004:00080000:3.0:1713481296.554545:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e111880, transno 4296040017 00000004:00080000:3.0:1713481296.554547:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e0bb480, transno 4296040018 00000004:00080000:3.0:1713481296.554549:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800785a3480, transno 4296040019 00000004:00080000:3.0:1713481296.554552:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085d3c380, transno 4296040020 00000004:00080000:3.0:1713481296.554555:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201e9500, transno 4296040021 00000004:00080000:3.0:1713481296.554557:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081c5e300, transno 4296040022 00000004:00080000:3.0:1713481296.554560:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794c3b80, transno 4296040024 00000004:00080000:3.0:1713481296.554562:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078dda300, transno 4296040025 00000004:00080000:3.0:1713481296.554565:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800779d9c00, transno 4296040026 00000004:00080000:3.0:1713481296.554568:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079658a80, transno 4296040027 00000004:00080000:3.0:1713481296.554571:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007965aa00, transno 4296040028 00000004:00080000:3.0:1713481296.554574:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078618a80, transno 4296040029 00000004:00080000:3.0:1713481296.554577:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133be0000, transno 4296040030 00000004:00080000:3.0:1713481296.554579:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007861bb80, transno 4296040031 00000004:00080000:3.0:1713481296.554582:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007727ea00, transno 4296040033 00000004:00080000:3.0:1713481296.554584:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ae9c00, transno 4296040034 00000004:00080000:3.0:1713481296.554588:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078ce6300, transno 4296040035 00000004:00080000:3.0:1713481296.554591:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012002e300, transno 4296040036 00000004:00080000:3.0:1713481296.554594:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121ec4a80, transno 4296040037 00000004:00080000:3.0:1713481296.554596:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012002ca80, transno 4296040038 00000004:00080000:3.0:1713481296.554599:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783fe680, transno 4296040039 00000004:00080000:3.0:1713481296.554601:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007727ed80, transno 4296040040 00000004:00080000:3.0:1713481296.554603:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135904000, transno 4296040042 00000004:00080000:3.0:1713481296.554606:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077156d80, transno 4296040043 00000004:00080000:3.0:1713481296.554609:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880072844700, transno 4296040044 00000004:00080000:3.0:1713481296.554612:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086940a80, transno 4296040045 00000004:00080000:3.0:1713481296.554615:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078766d80, transno 4296040046 00000004:00080000:3.0:1713481296.554618:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e32dc00, transno 4296040047 00000004:00080000:3.0:1713481296.554621:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084bfd180, transno 4296040049 00000004:00080000:3.0:1713481296.554623:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800794e0a80, transno 4296040050 00000004:00080000:3.0:1713481296.554626:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084b08380, transno 4296040052 00000004:00080000:3.0:1713481296.554629:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883ea300, transno 4296040054 00000004:00080000:3.0:1713481296.554631:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e89c00, transno 4296040055 00000004:00080000:3.0:1713481296.554634:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a418a80, transno 4296040056 00000004:00080000:3.0:1713481296.554637:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880121e88e00, transno 4296040057 00000004:00080000:3.0:1713481296.554639:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201a7480, transno 4296040058 00000004:00080000:3.0:1713481296.554642:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007287e300, transno 4296040059 00000004:00080000:3.0:1713481296.554645:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078377800, transno 4296040061 00000004:00080000:3.0:1713481296.554648:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883ea680, transno 4296040063 00000004:00080000:3.0:1713481296.554650:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011d212d80, transno 4296040105 00000004:00080000:3.0:1713481296.554653:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a078700, transno 4296040106 00000004:00080000:3.0:1713481296.554655:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f940700, transno 4296040107 00000004:00080000:3.0:1713481296.554658:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077016680, transno 4296040109 00000004:00080000:3.0:1713481296.554660:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011e22a680, transno 4296040110 00000004:00080000:3.0:1713481296.554663:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801201eb100, transno 4296040117 00000004:00080000:3.0:1713481296.554680:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077360a80, transno 4296040156 00000004:00080000:3.0:1713481296.554684:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077946a00, transno 4296040216 00000004:00080000:3.0:1713481296.554686:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800780a2680, transno 4296040524 00000004:00080000:3.0:1713481296.554689:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007726aa00, transno 4296040525 00000004:00080000:3.0:1713481296.554691:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007e404a80, transno 4296040526 00000004:00080000:3.0:1713481296.554694:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078792d80, transno 4296040527 00000004:00080000:3.0:1713481296.554696:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a002300, transno 4296040528 00000004:00080000:3.0:1713481296.554699:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880078793480, transno 4296040529 00000004:00080000:3.0:1713481296.554701:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800782fb480, transno 4296040639 00000004:00080000:3.0:1713481296.554704:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880077360000, transno 4296040640 00000004:00080000:3.0:1713481296.554706:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079bfaa00, transno 4296040642 00000004:00080000:3.0:1713481296.554709:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079bfb800, transno 4296040643 00000004:00080000:3.0:1713481296.554712:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011fb1c000, transno 4296040644 00000004:00080000:3.0:1713481296.554714:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880079bfa300, transno 4296040645 00000004:00080000:3.0:1713481296.554717:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921d4e00, transno 4296040646 00000004:00080000:3.0:1713481296.554720:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880086f04e00, transno 4296040647 00000004:00080000:3.0:1713481296.554723:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094219880, transno 4296040649 00000004:00080000:3.0:1713481296.554725:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783fea00, transno 4296040651 00000004:00080000:3.0:1713481296.554727:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880081608700, transno 4296040652 00000004:00080000:3.0:1713481296.554731:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800783c4e00, transno 4296040653 00000004:00080000:3.0:1713481296.554733:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009421a300, transno 4296040654 00000004:00080000:3.0:1713481296.554736:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007829d880, transno 4296040655 00000004:00080000:3.0:1713481296.554739:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801202cb100, transno 4296040656 00000004:00080000:3.0:1713481296.554741:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090405180, transno 4296040657 00000004:00080000:3.0:1713481296.554744:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090404e00, transno 4296040659 00000004:00080000:3.0:1713481296.554747:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800883e9f80, transno 4296040660 00000004:00080000:3.0:1713481296.554749:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800754ff480, transno 4296040661 00000004:00080000:3.0:1713481296.554751:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133be2d80, transno 4296040662 00000004:00080000:3.0:1713481296.554753:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007fe40380, transno 4296040663 00000004:00080000:3.0:1713481296.554756:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120411880, transno 4296040664 00000004:00080000:3.0:1713481296.554759:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880133be2a00, transno 4296040665 00000004:00080000:3.0:1713481296.554762:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120699c00, transno 4296040666 00000004:00080000:3.0:1713481296.554764:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007a290e00, transno 4296040667 00000004:00080000:3.0:1713481296.554766:0:3491:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084820700, transno 4296040668 00000100:00100000:3.0:1713481296.554775:0:3491:0:(client.c:2997:ptlrpc_free_committed()) @@@ stopping search req@ffff88009aa58380 x1796714784433536/t4296040671(4296040671) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1713481312 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 00000004:00080000:3.0:1713481296.554794:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009aa58380/2, rc 0, transno 1073375 00000100:00100000:3.0:1713481296.554799:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009aa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784433536:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.554825:0:16769:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882371392 00000100:00100000:3.0:1713481296.554829:0:16769:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882371392 00002000:00010000:3.0:1713481296.554861:0:16769:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419272/40659 (0->18446744073709551615) 00002000:00100000:3.0:1713481296.554865:0:16769:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012252dc00 with x1796714882371392 ext(0->18446744073709551615) 00002000:00010000:3.0:1713481296.554875:0:16769:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012252dc00. 00000100:00100000:3.0:1713481296.554906:0:16612:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 376553 00000100:00100000:3.0:1713481296.554912:0:16612:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012252dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_042:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16430:1957:x1796714882371392:12345-192.168.202.24@tcp:10:dir_create.sh.0 00002000:00010000:3.0:1713481296.555067:0:16612:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000408:0x9ed3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1713481296.555071:0:16612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000408:0x9ed3:0x0] updating lvb mtime from disk: 0 -> 1713481295 00002000:00010000:3.0:1713481296.555073:0:16612:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000408:0x9ed3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713481296.555075:0:16612:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000408:0x9ed3:0x0] updating lvb ctime from disk: 0 -> 1713481295 00002000:00010000:3.0:1713481296.555077:0:16612:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000408:0x9ed3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1713481296.555111:0:16612:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012252dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_042:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16431:1957:x1796714882371392:12345-192.168.202.24@tcp:10:dir_create.sh.0 Request processed in 197us (3904us total) trans 4296040681 rc 0/0 00000100:00100000:3.0:1713481296.555153:0:16612:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 376553 00002000:00010000:3.0:1713481296.555157:0:16612:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419272/40659 (0->18446744073709551615) 00002000:00100000:3.0:1713481296.555160:0:16612:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012252dc00 with x1796714882371392 ext(0->18446744073709551615) 00002000:00010000:3.0:1713481296.555164:0:16612:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012252dc00. 00010000:00010000:3.0:1713481296.555216:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078c26880/0xdfc0fb148959adf lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb2f expref: 26656 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.555240:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078395500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784450304:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.555278:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800980ccfc0/0xdfc0fb148a37a24 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x82ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4792b expref: 26655 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555289:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800980ccfc0, rc 0) 00000100:00100000:3.0:1713481296.555309:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26655:11552:x1796714882370624:12345-192.168.202.24@tcp:101:dd.0 Request processed in 15299us (15421us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.555316:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561901 00000004:00080000:3.0:1713481296.555369:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079a6c000/2, rc 0, transno 1073382 00000100:00100000:3.0:1713481296.555373:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784431424:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713481296.555386:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801201e8e00/2, rc 0, transno 1073379 00000100:00100000:3.0:1713481296.555390:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784430720:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.555395:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.555404:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784451520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.555444:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.555493:0:15498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134e3ad00/0xdfc0fb148688409 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23f4 expref: 26654 pid: 16539 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.555511:0:15498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15498:1796714784449536:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.555547:0:15498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555556:0:15498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555564:0:15498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555573:0:15498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555579:0:15498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555587:0:15498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555593:0:15498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800980cd200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.555597:0:15498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555603:0:15498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555620:0:15498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.555626:0:15498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800980cd200/0xdfc0fb148a379c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.555830:0:15498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+2622:3492:x1796714784449344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17798us (17855us total) trans 4295960560 rc 0/0 00000100:00100000:3.0:1713481296.555839:0:15498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561893 00000100:00100000:3.0:1713481296.555881:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012002d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784451584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.555901:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.555940:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784451200:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1713481296.555952:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0e2680/2, rc 0, transno 993261 00000100:00100000:3.0:1713481296.555961:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784449984:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.555971:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084834380/2, rc 0, transno 993264 00000100:00100000:3.0:1713481296.555974:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784449344:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.555991:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007684f100/2, rc 0, transno 1073380 00000100:00100000:3.0:1713481296.555994:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784431744:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713481296.556006:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a233100/2, rc 0, transno 1073377 00000100:00100000:3.0:1713481296.556009:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784431104:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.556031:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.556038:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012002c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784451648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.556057:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.556166:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079ad3840/0xdfc0fb1486883fb lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d23ca expref: 26655 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.556183:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784448768:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.556213:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556220:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556227:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556235:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556241:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556247:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556254:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801347c73c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.556257:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556263:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556279:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556286:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801347c73c0/0xdfc0fb148a37944 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.556436:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2624:3492:x1796714784448704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 20715us (20970us total) trans 4295960561 rc 0/0 00000100:00100000:3.0:1713481296.556443:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561887 00000100:00100000:3.0:1713481296.556468:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561918 00000100:00100000:3.0:1713481296.556473:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2623:3490:x1796714784452416:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.556487:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43179 count 1 00010000:00010000:3.0:1713481296.556500:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556513:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007833f840/0xdfc0fb148688575 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2456 expref: 26654 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.556519:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.556521:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.556524:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556542:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007833f840/0xdfc0fb148688575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2456 expref: 26654 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.556552:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007833f840/0xdfc0fb148688575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2456 expref: 26654 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.556562:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784452544:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.556590:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.556623:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083232ac0/0xdfc0fb148688417 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2410 expref: 26654 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.556639:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784450176:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.556653:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556658:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556662:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556681:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556686:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556689:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556693:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800980cc480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.556695:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556698:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556714:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.556719:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800980cc480/0xdfc0fb148a37a16 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.556829:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2625:3491:x1796714784450112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17245us (17374us total) trans 4295960562 rc 0/0 00000100:00100000:3.0:1713481296.556835:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561900 00000100:00100000:3.0:1713481296.557251:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882373056 00000100:00100000:3.0:1713481296.557256:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882373056 00000100:00100000:3.0:1713481296.557283:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882373888 00000100:00100000:3.0:1713481296.557285:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882373888 00000100:00100000:3.0:1713481296.557300:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125639 00000100:00100000:3.0:1713481296.557305:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2394:18876:x1796714882373056:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:3.0:1713481296.557415:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2395:18876:x1796714882373056:12345-192.168.202.24@tcp:35:touch.0 Request processed in 107us (3267us total) trans 4295107526 rc 0/0 00000100:00100000:3.0:1713481296.557422:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125639 00000100:00100000:3.0:1713481296.557440:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125640 00000100:00100000:3.0:1713481296.557446:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18678:x1796714882373888:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:3.0:1713481296.557533:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2066:18678:x1796714882373888:12345-192.168.202.24@tcp:35:rm.0 Request processed in 85us (841us total) trans 4295107527 rc 0/0 00000100:00100000:3.0:1713481296.557540:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125640 00000100:00100000:3.0:1713481296.557583:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ee28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:10467:1796714784449728:0@lo:1000:mdt00_005.0 00000004:00080000:3.0:1713481296.558029:0:10467:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa104:0x0], index 0: 0 00010000:00010000:3.0:1713481296.558148:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff29b00/0xdfc0fb148a37bd6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.558158:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff29b00/0xdfc0fb148a37bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558167:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff29b00/0xdfc0fb148a37bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558194:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558200:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558206:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558211:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558216:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096f6c240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.558218:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558224:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558233:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009285f800) 00010000:00010000:3.0:1713481296.558236:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.558238:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558248:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c240/0xdfc0fb148a3788e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000004:00010000:3.0:1713481296.558270:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880135bedf80 reply state ffff880072b30000 transno 4295107528 ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558279:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.558285:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x39 (ffff88009c06c300) 00010000:00010000:3.0:1713481296.558287:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.558290:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713481296.558329:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096f6c000/0xdfc0fb148a37887 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2caf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478bb expref: 2067 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.558347:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff29b00/0xdfc0fb148a37bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478bb expref: 2066 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.558353:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb5:0x0].0x0 (ffff88009d25cb00) 00010000:00010000:3.0:1713481296.558356:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.558358:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff29b00, rc 0) 00000100:00100000:3.0:1713481296.558381:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2067:18753:x1796714882368384:12345-192.168.202.24@tcp:101:touch.0 Request processed in 26210us (26321us total) trans 4295107528 rc 0/0 00000100:00100000:3.0:1713481296.558387:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485668 00000100:00100000:3.0:1713481296.558430:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784449216:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.558455:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.558471:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20910:1960:x1796714882369216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 20699us (20841us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.558483:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819936 00000004:00080000:3.0:1713481296.558534:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007727c000/2, rc 0, transno 1073381 00000100:00100000:3.0:1713481296.558539:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007727c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784433088:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713481296.558554:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120412d80/2, rc 0, transno 993267 00000100:00100000:3.0:1713481296.558564:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784451264:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.558574:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078394a80/2, rc 0, transno 993266 00000100:00100000:3.0:1713481296.558577:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784450112:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.558588:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007861a300/2, rc 0, transno 993263 00000100:00100000:3.0:1713481296.558592:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007861a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784449024:0@lo:6:osp-syn-1-1.0 00000040:00080000:3.0:1713481296.558621:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13644, 64 off881408 00000040:00080000:3.0:1713481296.558663:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14509, 64 off936768 00000040:00080000:3.0:1713481296.558703:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13645, 64 off881472 00000040:00080000:3.0:1713481296.558713:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14510, 64 off936832 00000040:00080000:3.0:1713481296.558722:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13646, 64 off881536 00000040:00080000:3.0:1713481296.558731:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14511, 64 off936896 00000040:00080000:3.0:1713481296.558741:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13647, 64 off881600 00000040:00080000:3.0:1713481296.558750:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14512, 64 off936960 00000040:00080000:3.0:1713481296.558759:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13648, 64 off881664 00000040:00080000:3.0:1713481296.558768:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14513, 64 off937024 00000040:00080000:3.0:1713481296.558777:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13649, 64 off881728 00000040:00080000:3.0:1713481296.558787:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14514, 64 off937088 00000040:00080000:3.0:1713481296.558796:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13650, 64 off881792 00000040:00080000:3.0:1713481296.558804:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14515, 64 off937152 00000040:00080000:3.0:1713481296.558813:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13651, 64 off881856 00000040:00080000:3.0:1713481296.558821:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14516, 64 off937216 00000040:00080000:3.0:1713481296.558831:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13652, 64 off881920 00000040:00080000:3.0:1713481296.558840:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14517, 64 off937280 00000040:00080000:3.0:1713481296.558849:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13653, 64 off881984 00000040:00080000:3.0:1713481296.558858:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14518, 64 off937344 00000040:00080000:3.0:1713481296.558867:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13654, 64 off882048 00000040:00080000:3.0:1713481296.558876:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14519, 64 off937408 00000040:00080000:3.0:1713481296.558885:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13655, 64 off882112 00000040:00080000:3.0:1713481296.558895:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14520, 64 off937472 00000040:00080000:3.0:1713481296.558904:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13656, 64 off882176 00000040:00080000:3.0:1713481296.558914:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14521, 64 off937536 00000040:00080000:3.0:1713481296.558923:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13657, 64 off882240 00000040:00080000:3.0:1713481296.558932:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14522, 64 off937600 00000040:00080000:3.0:1713481296.558941:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13658, 64 off882304 00000040:00080000:3.0:1713481296.558950:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14523, 64 off937664 00000040:00080000:3.0:1713481296.558959:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13659, 64 off882368 00000040:00080000:3.0:1713481296.558968:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14524, 64 off937728 00000040:00080000:3.0:1713481296.558977:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13660, 64 off882432 00000040:00080000:3.0:1713481296.558986:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14525, 64 off937792 00000040:00080000:3.0:1713481296.558994:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13661, 64 off882496 00000040:00080000:3.0:1713481296.559003:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14526, 64 off937856 00000040:00080000:3.0:1713481296.559011:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13662, 64 off882560 00000040:00080000:3.0:1713481296.559021:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14527, 64 off937920 00000040:00080000:3.0:1713481296.559030:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13663, 64 off882624 00000040:00080000:3.0:1713481296.559039:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14528, 64 off937984 00000040:00080000:3.0:1713481296.559049:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13664, 64 off882688 00000040:00080000:3.0:1713481296.559112:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14529, 64 off938048 00000040:00080000:3.0:1713481296.559148:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13665, 64 off882752 00000040:00080000:3.0:1713481296.559159:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14530, 64 off938112 00000040:00080000:3.0:1713481296.559168:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13666, 64 off882816 00000040:00080000:3.0:1713481296.559177:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14531, 64 off938176 00000040:00080000:3.0:1713481296.559186:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13667, 64 off882880 00000040:00080000:3.0:1713481296.559196:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14532, 64 off938240 00000040:00080000:3.0:1713481296.559205:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13668, 64 off882944 00000040:00080000:3.0:1713481296.559213:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14533, 64 off938304 00000040:00080000:3.0:1713481296.559223:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13669, 64 off883008 00000040:00080000:3.0:1713481296.559232:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14534, 64 off938368 00000040:00080000:3.0:1713481296.559242:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13670, 64 off883072 00000040:00080000:3.0:1713481296.559250:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14535, 64 off938432 00000100:00100000:3.0:1713481296.559279:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882374592 00000100:00100000:3.0:1713481296.559283:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882374592 00000100:00100000:3.0:1713481296.559304:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125641 00000100:00100000:3.0:1713481296.559309:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2395:18729:x1796714882374592:12345-192.168.202.24@tcp:37:rm.0 00000040:00080000:3.0:1713481296.559847:0:15577:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13671, 64 off883136 00010000:00010000:3.0:1713481296.559901:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559907:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559915:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559922:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559927:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559931:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559937:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559942:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ff29d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.559945:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559954:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559962:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3847:0x0].0x0 (ffff8801205dc200) 00010000:00010000:3.0:1713481296.559964:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.559967:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 3/0,0 mode: --/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559972:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff29d40/0xdfc0fb148a37c0e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.559996:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e8a1c0/0xdfc0fb148a37afd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.560002:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e8a1c0/0xdfc0fb148a37afd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.560006:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e8a1c0/0xdfc0fb148a37afd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.560011:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092e8a1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.560013:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e8a1c0/0xdfc0fb148a37afd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.560019:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e8a1c0/0xdfc0fb148a37afd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.560025:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3847:0x0].0x0 (ffff8801205dc200) 00010000:00010000:3.0:1713481296.560027:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.560029:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e8a1c0/0xdfc0fb148a37afd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.560034:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e8a1c0/0xdfc0fb148a37afd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00000100:00100000:3.0:1713481296.560083:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882374400 00000100:00100000:3.0:1713481296.560087:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882374400 00000100:00100000:3.0:1713481296.560105:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882375232 00000100:00100000:3.0:1713481296.560108:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882375232 00000100:00100000:3.0:1713481296.560139:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485693 00000100:00100000:3.0:1713481296.560144:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2067:18755:x1796714882374400:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:3.0:1713481296.560165:0:10467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.560176:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086b4a880/0xdfc0fb148a37ae1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47978 expref: 2067 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.560191:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb6:0x0].0x0 (ffff880134a79400) 00010000:00010000:3.0:1713481296.560204:0:10467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.560254:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.560259:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.560263:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000004:00010000:3.0:1713481296.560301:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009919ad80 reply state ffff88009cd65000 transno 4295107529 ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.560306:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.560309:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb6:0x0].0x0 (ffff880073419300) 00010000:00010000:3.0:1713481296.560311:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.560312:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.560335:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2068:18755:x1796714882374400:12345-192.168.202.24@tcp:36:touch.0 Request processed in 191us (1381us total) trans 4295107529 rc 0/0 00000100:00100000:3.0:1713481296.560340:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485693 00000040:00080000:3.0:1713481296.560376:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13672, 64 off883200 00000040:00080000:3.0:1713481296.560389:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14536, 64 off938496 00000040:00080000:3.0:1713481296.560398:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13673, 64 off883264 00000040:00080000:3.0:1713481296.560404:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14537, 64 off938560 00000040:00080000:3.0:1713481296.560410:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13674, 64 off883328 00000040:00080000:3.0:1713481296.560415:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14538, 64 off938624 00000040:00080000:3.0:1713481296.560420:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13675, 64 off883392 00000040:00080000:3.0:1713481296.560426:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14539, 64 off938688 00000040:00080000:3.0:1713481296.560431:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13676, 64 off883456 00000040:00080000:3.0:1713481296.560436:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14540, 64 off938752 00000040:00080000:3.0:1713481296.560441:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13677, 64 off883520 00000040:00080000:3.0:1713481296.560446:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14541, 64 off938816 00000040:00080000:3.0:1713481296.560451:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13678, 64 off883584 00000040:00080000:3.0:1713481296.560456:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14542, 64 off938880 00000040:00080000:3.0:1713481296.560461:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13679, 64 off883648 00000040:00080000:3.0:1713481296.560466:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14543, 64 off938944 00000040:00080000:3.0:1713481296.560471:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13680, 64 off883712 00000040:00080000:3.0:1713481296.560476:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14544, 64 off939008 00000040:00080000:3.0:1713481296.560481:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13681, 64 off883776 00000040:00080000:3.0:1713481296.560486:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14545, 64 off939072 00000040:00080000:3.0:1713481296.560491:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13682, 64 off883840 00000040:00080000:3.0:1713481296.560496:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14546, 64 off939136 00000040:00080000:3.0:1713481296.560501:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13683, 64 off883904 00000040:00080000:3.0:1713481296.560506:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14547, 64 off939200 00000040:00080000:3.0:1713481296.560512:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13684, 64 off883968 00000040:00080000:3.0:1713481296.560517:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14548, 64 off939264 00000040:00080000:3.0:1713481296.560521:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13685, 64 off884032 00000040:00080000:3.0:1713481296.560526:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14549, 64 off939328 00000040:00080000:3.0:1713481296.560532:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13686, 64 off884096 00000040:00080000:3.0:1713481296.560537:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14550, 64 off939392 00000040:00080000:3.0:1713481296.560541:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13687, 64 off884160 00000040:00080000:3.0:1713481296.560546:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14551, 64 off939456 00000040:00080000:3.0:1713481296.560551:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13688, 64 off884224 00000040:00080000:3.0:1713481296.560556:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14552, 64 off939520 00000040:00080000:3.0:1713481296.560561:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13689, 64 off884288 00000040:00080000:3.0:1713481296.560565:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14553, 64 off939584 00000040:00080000:3.0:1713481296.560570:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13690, 64 off884352 00000040:00080000:3.0:1713481296.560575:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14554, 64 off939648 00000040:00080000:3.0:1713481296.560579:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13691, 64 off884416 00000040:00080000:3.0:1713481296.560584:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14555, 64 off939712 00000040:00080000:3.0:1713481296.560589:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13692, 64 off884480 00000040:00080000:3.0:1713481296.560594:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14556, 64 off939776 00000040:00080000:3.0:1713481296.560599:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13693, 64 off884544 00000040:00080000:3.0:1713481296.560604:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14557, 64 off939840 00000040:00080000:3.0:1713481296.560608:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13694, 64 off884608 00000040:00080000:3.0:1713481296.560613:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14558, 64 off939904 00000040:00080000:3.0:1713481296.560618:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13695, 64 off884672 00000040:00080000:3.0:1713481296.560623:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14559, 64 off939968 00000040:00080000:3.0:1713481296.560627:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13696, 64 off884736 00000040:00080000:3.0:1713481296.560632:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14560, 64 off940032 00000040:00080000:3.0:1713481296.560680:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13697, 64 off884800 00000040:00080000:3.0:1713481296.560688:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14561, 64 off940096 00000040:00080000:3.0:1713481296.560694:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13698, 64 off884864 00000040:00080000:3.0:1713481296.560699:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14562, 64 off940160 00000040:00080000:3.0:1713481296.560704:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13699, 64 off884928 00000040:00080000:3.0:1713481296.560709:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14563, 64 off940224 00000040:00080000:3.0:1713481296.560713:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13700, 64 off884992 00000040:00080000:3.0:1713481296.560719:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14564, 64 off940288 00000040:00080000:3.0:1713481296.560724:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13701, 64 off885056 00000040:00080000:3.0:1713481296.560729:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14565, 64 off940352 00000040:00080000:3.0:1713481296.560734:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13702, 64 off885120 00000040:00080000:3.0:1713481296.560739:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14566, 64 off940416 00000040:00080000:3.0:1713481296.560744:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13703, 64 off885184 00000040:00080000:3.0:1713481296.560750:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14567, 64 off940480 00000040:00080000:3.0:1713481296.560754:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13704, 64 off885248 00000040:00080000:3.0:1713481296.560759:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14568, 64 off940544 00000040:00080000:3.0:1713481296.560764:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13705, 64 off885312 00000040:00080000:3.0:1713481296.560769:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14569, 64 off940608 00000040:00080000:3.0:1713481296.560774:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13706, 64 off885376 00000040:00080000:3.0:1713481296.560779:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14570, 64 off940672 00000040:00080000:3.0:1713481296.560784:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13707, 64 off885440 00000040:00080000:3.0:1713481296.560789:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14571, 64 off940736 00000040:00080000:3.0:1713481296.560794:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13708, 64 off885504 00000040:00080000:3.0:1713481296.560798:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14572, 64 off940800 00000040:00080000:3.0:1713481296.560803:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13709, 64 off885568 00000040:00080000:3.0:1713481296.560808:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14573, 64 off940864 00000040:00080000:3.0:1713481296.560813:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13710, 64 off885632 00000040:00080000:3.0:1713481296.560818:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14574, 64 off940928 00000040:00080000:3.0:1713481296.560823:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13711, 64 off885696 00000040:00080000:3.0:1713481296.560828:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14575, 64 off940992 00000040:00080000:3.0:1713481296.560833:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13712, 64 off885760 00000040:00080000:3.0:1713481296.560838:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14576, 64 off941056 00000040:00080000:3.0:1713481296.560844:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13713, 64 off885824 00000040:00080000:3.0:1713481296.560848:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14577, 64 off941120 00000040:00080000:3.0:1713481296.560853:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13714, 64 off885888 00000040:00080000:3.0:1713481296.560857:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14578, 64 off941184 00000040:00080000:3.0:1713481296.560862:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13715, 64 off885952 00000040:00080000:3.0:1713481296.560867:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14579, 64 off941248 00000040:00080000:3.0:1713481296.560872:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13716, 64 off886016 00000040:00080000:3.0:1713481296.560877:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14580, 64 off941312 00000040:00080000:3.0:1713481296.560881:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13717, 64 off886080 00000040:00080000:3.0:1713481296.560886:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14581, 64 off941376 00000040:00080000:3.0:1713481296.560892:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13718, 64 off886144 00000040:00080000:3.0:1713481296.560897:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14582, 64 off941440 00000040:00080000:3.0:1713481296.560902:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13719, 64 off886208 00000040:00080000:3.0:1713481296.560907:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14583, 64 off941504 00000040:00080000:3.0:1713481296.560912:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13720, 64 off886272 00000040:00080000:3.0:1713481296.560917:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14584, 64 off941568 00000040:00080000:3.0:1713481296.560922:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13721, 64 off886336 00000040:00080000:3.0:1713481296.560949:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14585, 64 off941632 00000040:00080000:3.0:1713481296.560955:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13722, 64 off886400 00000040:00080000:3.0:1713481296.560960:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14586, 64 off941696 00000040:00080000:3.0:1713481296.560964:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13723, 64 off886464 00000040:00080000:3.0:1713481296.560969:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14587, 64 off941760 00000040:00080000:3.0:1713481296.560974:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13724, 64 off886528 00000040:00080000:3.0:1713481296.560979:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14588, 64 off941824 00000040:00080000:3.0:1713481296.560984:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13725, 64 off886592 00000040:00080000:3.0:1713481296.560989:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14589, 64 off941888 00000040:00080000:3.0:1713481296.560994:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13726, 64 off886656 00000040:00080000:3.0:1713481296.560999:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14590, 64 off941952 00000040:00080000:3.0:1713481296.561004:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13727, 64 off886720 00000040:00080000:3.0:1713481296.561009:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14591, 64 off942016 00000040:00080000:3.0:1713481296.561014:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13728, 64 off886784 00000040:00080000:3.0:1713481296.561019:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14592, 64 off942080 00000040:00080000:3.0:1713481296.561024:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13729, 64 off886848 00000100:00100000:3.0:1713481296.561059:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882374848 00000100:00100000:3.0:1713481296.561061:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882374848 00000100:00100000:3.0:1713481296.561084:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561930 00000100:00100000:3.0:1713481296.561087:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20909:18792:x1796714882374848:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.561093:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.561101:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ff29680/0xdfc0fb148a37c54 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc4ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa479ef expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.561115:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc4ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.561136:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.561137:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.561141:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ff29680/0xdfc0fb148a37c54 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479ef expref: 20910 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.561149:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007ff29680/0xdfc0fb148a37c54 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc4ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479ef expref: 20910 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.561154:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff29680, rc 0) 00000100:00100000:3.0:1713481296.561165:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20910:18792:x1796714882374848:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 78us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.561170:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561930 00000040:00080000:3.0:1713481296.561190:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14593, 64 off942144 00000040:00080000:3.0:1713481296.561201:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13730, 64 off886912 00000040:00080000:3.0:1713481296.561207:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14594, 64 off942208 00000040:00080000:3.0:1713481296.561212:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13731, 64 off886976 00000040:00080000:3.0:1713481296.561217:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14595, 64 off942272 00000040:00080000:3.0:1713481296.561223:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13732, 64 off887040 00000040:00080000:3.0:1713481296.561228:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14596, 64 off942336 00000040:00080000:3.0:1713481296.561233:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13733, 64 off887104 00000040:00080000:3.0:1713481296.561238:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14597, 64 off942400 00000040:00080000:3.0:1713481296.561243:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13734, 64 off887168 00000040:00080000:3.0:1713481296.561248:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14598, 64 off942464 00000040:00080000:3.0:1713481296.561253:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13735, 64 off887232 00000040:00080000:3.0:1713481296.561258:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14599, 64 off942528 00000040:00080000:3.0:1713481296.561263:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13736, 64 off887296 00000040:00080000:3.0:1713481296.561269:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14600, 64 off942592 00000040:00080000:3.0:1713481296.561274:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13737, 64 off887360 00000040:00080000:3.0:1713481296.561279:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14601, 64 off942656 00000040:00080000:3.0:1713481296.561284:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13738, 64 off887424 00000040:00080000:3.0:1713481296.561289:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14602, 64 off942720 00000040:00080000:3.0:1713481296.561294:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13739, 64 off887488 00000040:00080000:3.0:1713481296.561299:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14603, 64 off942784 00000040:00080000:3.0:1713481296.561303:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13740, 64 off887552 00000040:00080000:3.0:1713481296.561308:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14604, 64 off942848 00000040:00080000:3.0:1713481296.561313:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13741, 64 off887616 00000040:00080000:3.0:1713481296.561318:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14605, 64 off942912 00000040:00080000:3.0:1713481296.561322:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13742, 64 off887680 00000040:00080000:3.0:1713481296.561327:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14606, 64 off942976 00000040:00080000:3.0:1713481296.561332:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13743, 64 off887744 00000040:00080000:3.0:1713481296.561337:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14607, 64 off943040 00000040:00080000:3.0:1713481296.561342:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13744, 64 off887808 00000040:00080000:3.0:1713481296.561347:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14608, 64 off943104 00000040:00080000:3.0:1713481296.561352:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13745, 64 off887872 00000040:00080000:3.0:1713481296.561356:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14609, 64 off943168 00000040:00080000:3.0:1713481296.561361:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13746, 64 off887936 00000040:00080000:3.0:1713481296.561366:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14610, 64 off943232 00000040:00080000:3.0:1713481296.561371:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13747, 64 off888000 00000040:00080000:3.0:1713481296.561376:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14611, 64 off943296 00000040:00080000:3.0:1713481296.561381:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13748, 64 off888064 00000040:00080000:3.0:1713481296.561386:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14612, 64 off943360 00000040:00080000:3.0:1713481296.561391:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13749, 64 off888128 00000040:00080000:3.0:1713481296.561395:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14613, 64 off943424 00000040:00080000:3.0:1713481296.561400:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13750, 64 off888192 00000040:00080000:3.0:1713481296.561405:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14614, 64 off943488 00000040:00080000:3.0:1713481296.561409:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13751, 64 off888256 00000040:00080000:3.0:1713481296.561414:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14615, 64 off943552 00000040:00080000:3.0:1713481296.561419:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13752, 64 off888320 00000040:00080000:3.0:1713481296.561424:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14616, 64 off943616 00000040:00080000:3.0:1713481296.561429:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13753, 64 off888384 00000040:00080000:3.0:1713481296.561434:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14617, 64 off943680 00000040:00080000:3.0:1713481296.561439:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13754, 64 off888448 00000040:00080000:3.0:1713481296.561444:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14618, 64 off943744 00000040:00080000:3.0:1713481296.561449:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13755, 64 off888512 00000040:00080000:3.0:1713481296.561454:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14619, 64 off943808 00000040:00080000:3.0:1713481296.561458:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13756, 64 off888576 00000040:00080000:3.0:1713481296.561463:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14620, 64 off943872 00000040:00080000:3.0:1713481296.561468:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13757, 64 off888640 00000040:00080000:3.0:1713481296.561473:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14621, 64 off943936 00000040:00080000:3.0:1713481296.561477:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13758, 64 off888704 00000040:00080000:3.0:1713481296.561482:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14622, 64 off944000 00000040:00080000:3.0:1713481296.561487:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13759, 64 off888768 00000040:00080000:3.0:1713481296.561492:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14623, 64 off944064 00000040:00080000:3.0:1713481296.561496:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13760, 64 off888832 00000040:00080000:3.0:1713481296.561501:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14624, 64 off944128 00000040:00080000:3.0:1713481296.561525:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13761, 64 off888896 00000040:00080000:3.0:1713481296.561531:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14625, 64 off944192 00000040:00080000:3.0:1713481296.561536:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13762, 64 off888960 00000040:00080000:3.0:1713481296.561541:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14626, 64 off944256 00000040:00080000:3.0:1713481296.561546:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13763, 64 off889024 00000040:00080000:3.0:1713481296.561551:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14627, 64 off944320 00000040:00080000:3.0:1713481296.561556:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13764, 64 off889088 00000040:00080000:3.0:1713481296.561561:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14628, 64 off944384 00000100:00100000:3.0:1713481296.561579:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882374976 00000100:00100000:3.0:1713481296.561581:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882374976 00000100:00100000:3.0:1713481296.561594:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561931 00000100:00100000:3.0:1713481296.561596:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26651:1958:x1796714882374976:12345-192.168.202.24@tcp:2:touch.0 00000100:00100000:3.0:1713481296.561688:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26652:1958:x1796714882374976:12345-192.168.202.24@tcp:2:touch.0 Request processed in 90us (129us total) trans 4295960564 rc 0/0 00000100:00100000:3.0:1713481296.561695:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561931 00000040:00080000:3.0:1713481296.561714:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13765, 64 off889152 00000040:00080000:3.0:1713481296.561722:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14629, 64 off944448 00000040:00080000:3.0:1713481296.561728:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13766, 64 off889216 00000040:00080000:3.0:1713481296.561733:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14630, 64 off944512 00000040:00080000:3.0:1713481296.561738:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13767, 64 off889280 00000040:00080000:3.0:1713481296.561744:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14631, 64 off944576 00000040:00080000:3.0:1713481296.561749:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13768, 64 off889344 00000040:00080000:3.0:1713481296.561753:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14632, 64 off944640 00000040:00080000:3.0:1713481296.561759:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13769, 64 off889408 00000040:00080000:3.0:1713481296.561763:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14633, 64 off944704 00000040:00080000:3.0:1713481296.561768:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13770, 64 off889472 00000040:00080000:3.0:1713481296.561773:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14634, 64 off944768 00000040:00080000:3.0:1713481296.561778:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13771, 64 off889536 00000040:00080000:3.0:1713481296.561783:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14635, 64 off944832 00000040:00080000:3.0:1713481296.561789:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13772, 64 off889600 00000040:00080000:3.0:1713481296.561794:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14636, 64 off944896 00000040:00080000:3.0:1713481296.561799:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13773, 64 off889664 00000040:00080000:3.0:1713481296.561804:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14637, 64 off944960 00000040:00080000:3.0:1713481296.561808:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13774, 64 off889728 00000040:00080000:3.0:1713481296.561815:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14638, 64 off945024 00000040:00080000:3.0:1713481296.561823:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13775, 64 off889792 00000040:00080000:3.0:1713481296.561831:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14639, 64 off945088 00000040:00080000:3.0:1713481296.561838:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13776, 64 off889856 00000040:00080000:3.0:1713481296.561846:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14640, 64 off945152 00000040:00080000:3.0:1713481296.561854:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13777, 64 off889920 00000040:00080000:3.0:1713481296.561862:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14641, 64 off945216 00000040:00080000:3.0:1713481296.561870:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13778, 64 off889984 00000040:00080000:3.0:1713481296.561878:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14642, 64 off945280 00000040:00080000:3.0:1713481296.561886:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13779, 64 off890048 00000040:00080000:3.0:1713481296.561895:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14643, 64 off945344 00000040:00080000:3.0:1713481296.561904:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13780, 64 off890112 00000040:00080000:3.0:1713481296.561911:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14644, 64 off945408 00000040:00080000:3.0:1713481296.561917:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13781, 64 off890176 00000040:00080000:3.0:1713481296.561922:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14645, 64 off945472 00000040:00080000:3.0:1713481296.561927:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13782, 64 off890240 00000040:00080000:3.0:1713481296.561932:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14646, 64 off945536 00000040:00080000:3.0:1713481296.561938:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13783, 64 off890304 00000040:00080000:3.0:1713481296.561943:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14647, 64 off945600 00000040:00080000:3.0:1713481296.561948:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13784, 64 off890368 00000040:00080000:3.0:1713481296.561953:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14648, 64 off945664 00000040:00080000:3.0:1713481296.561958:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13785, 64 off890432 00000040:00080000:3.0:1713481296.561963:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14649, 64 off945728 00000040:00080000:3.0:1713481296.561967:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13786, 64 off890496 00000040:00080000:3.0:1713481296.561972:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14650, 64 off945792 00000040:00080000:3.0:1713481296.561978:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13787, 64 off890560 00000040:00080000:3.0:1713481296.561982:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14651, 64 off945856 00000040:00080000:3.0:1713481296.561987:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13788, 64 off890624 00000040:00080000:3.0:1713481296.561993:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14652, 64 off945920 00000040:00080000:3.0:1713481296.561998:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13789, 64 off890688 00000040:00080000:3.0:1713481296.562003:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14653, 64 off945984 00000040:00080000:3.0:1713481296.562007:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13790, 64 off890752 00000040:00080000:3.0:1713481296.562012:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14654, 64 off946048 00000040:00080000:3.0:1713481296.562016:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13791, 64 off890816 00000040:00080000:3.0:1713481296.562021:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14655, 64 off946112 00000040:00080000:3.0:1713481296.562026:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13792, 64 off890880 00000040:00080000:3.0:1713481296.562030:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14656, 64 off946176 00000040:00080000:3.0:1713481296.562035:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13793, 64 off890944 00000040:00080000:3.0:1713481296.562061:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14657, 64 off946240 00000040:00080000:3.0:1713481296.562067:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13794, 64 off891008 00000040:00080000:3.0:1713481296.562073:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14658, 64 off946304 00000040:00080000:3.0:1713481296.562078:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13795, 64 off891072 00000040:00080000:3.0:1713481296.562084:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14659, 64 off946368 00000040:00080000:3.0:1713481296.562089:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13796, 64 off891136 00000040:00080000:3.0:1713481296.562094:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14660, 64 off946432 00000040:00080000:3.0:1713481296.562099:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13797, 64 off891200 00000040:00080000:3.0:1713481296.562105:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14661, 64 off946496 00000040:00080000:3.0:1713481296.562110:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13798, 64 off891264 00000040:00080000:3.0:1713481296.562114:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14662, 64 off946560 00000040:00080000:3.0:1713481296.562134:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13799, 64 off891328 00000040:00080000:3.0:1713481296.562140:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14663, 64 off946624 00000040:00080000:3.0:1713481296.562145:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13800, 64 off891392 00000040:00080000:3.0:1713481296.562150:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14664, 64 off946688 00000040:00080000:3.0:1713481296.562156:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13801, 64 off891456 00000040:00080000:3.0:1713481296.562161:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14665, 64 off946752 00000040:00080000:3.0:1713481296.562166:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13802, 64 off891520 00000040:00080000:3.0:1713481296.562171:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14666, 64 off946816 00000040:00080000:3.0:1713481296.562176:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13803, 64 off891584 00000040:00080000:3.0:1713481296.562181:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14667, 64 off946880 00000040:00080000:3.0:1713481296.562186:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13804, 64 off891648 00000040:00080000:3.0:1713481296.562191:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14668, 64 off946944 00000040:00080000:3.0:1713481296.562196:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13805, 64 off891712 00000040:00080000:3.0:1713481296.562201:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14669, 64 off947008 00000040:00080000:3.0:1713481296.562206:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13806, 64 off891776 00000040:00080000:3.0:1713481296.562211:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14670, 64 off947072 00000040:00080000:3.0:1713481296.562216:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13807, 64 off891840 00000040:00080000:3.0:1713481296.562221:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14671, 64 off947136 00000040:00080000:3.0:1713481296.562226:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13808, 64 off891904 00000040:00080000:3.0:1713481296.562231:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14672, 64 off947200 00000040:00080000:3.0:1713481296.562235:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13809, 64 off891968 00000040:00080000:3.0:1713481296.562240:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14673, 64 off947264 00000040:00080000:3.0:1713481296.562245:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13810, 64 off892032 00000040:00080000:3.0:1713481296.562249:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14674, 64 off947328 00000040:00080000:3.0:1713481296.562254:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13811, 64 off892096 00000040:00080000:3.0:1713481296.562260:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14675, 64 off947392 00000040:00080000:3.0:1713481296.562265:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13812, 64 off892160 00000040:00080000:3.0:1713481296.562269:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14676, 64 off947456 00000040:00080000:3.0:1713481296.562274:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13813, 64 off892224 00000040:00080000:3.0:1713481296.562278:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14677, 64 off947520 00000040:00080000:3.0:1713481296.562283:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13814, 64 off892288 00000040:00080000:3.0:1713481296.562288:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14678, 64 off947584 00000040:00080000:3.0:1713481296.562292:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13815, 64 off892352 00000040:00080000:3.0:1713481296.562297:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14679, 64 off947648 00000040:00080000:3.0:1713481296.562302:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13816, 64 off892416 00000040:00080000:3.0:1713481296.562307:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14680, 64 off947712 00000040:00080000:3.0:1713481296.562312:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13817, 64 off892480 00000040:00080000:3.0:1713481296.562316:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14681, 64 off947776 00000040:00080000:3.0:1713481296.562321:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13818, 64 off892544 00000040:00080000:3.0:1713481296.562326:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14682, 64 off947840 00000040:00080000:3.0:1713481296.562331:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13819, 64 off892608 00000040:00080000:3.0:1713481296.562335:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14683, 64 off947904 00000040:00080000:3.0:1713481296.562340:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13820, 64 off892672 00000040:00080000:3.0:1713481296.562344:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14684, 64 off947968 00000040:00080000:3.0:1713481296.562349:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13821, 64 off892736 00000040:00080000:3.0:1713481296.562354:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14685, 64 off948032 00000040:00080000:3.0:1713481296.562359:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13822, 64 off892800 00000040:00080000:3.0:1713481296.562364:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14686, 64 off948096 00000040:00080000:3.0:1713481296.562369:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13823, 64 off892864 00000040:00080000:3.0:1713481296.562374:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14687, 64 off948160 00000040:00080000:3.0:1713481296.562379:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13824, 64 off892928 00000040:00080000:3.0:1713481296.562384:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14688, 64 off948224 00000040:00080000:3.0:1713481296.562404:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13825, 64 off892992 00000040:00080000:3.0:1713481296.562410:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14689, 64 off948288 00000040:00080000:3.0:1713481296.562416:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13826, 64 off893056 00000040:00080000:3.0:1713481296.562421:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14690, 64 off948352 00000040:00080000:3.0:1713481296.562426:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13827, 64 off893120 00000040:00080000:3.0:1713481296.562432:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14691, 64 off948416 00000040:00080000:3.0:1713481296.562437:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13828, 64 off893184 00000040:00080000:3.0:1713481296.562443:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14692, 64 off948480 00000040:00080000:3.0:1713481296.562449:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13829, 64 off893248 00000040:00080000:3.0:1713481296.562458:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14693, 64 off948544 00000040:00080000:3.0:1713481296.562466:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13830, 64 off893312 00000040:00080000:3.0:1713481296.562499:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14694, 64 off948608 00000040:00080000:3.0:1713481296.562510:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13831, 64 off893376 00000040:00080000:3.0:1713481296.562518:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14695, 64 off948672 00000040:00080000:3.0:1713481296.562526:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13832, 64 off893440 00000040:00080000:3.0:1713481296.562534:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14696, 64 off948736 00000040:00080000:3.0:1713481296.562542:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13833, 64 off893504 00000040:00080000:3.0:1713481296.562551:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14697, 64 off948800 00000040:00080000:3.0:1713481296.562559:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13834, 64 off893568 00000040:00080000:3.0:1713481296.562567:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14698, 64 off948864 00000040:00080000:3.0:1713481296.562575:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13835, 64 off893632 00000040:00080000:3.0:1713481296.562584:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14699, 64 off948928 00000040:00080000:3.0:1713481296.562592:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13836, 64 off893696 00000040:00080000:3.0:1713481296.562601:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14700, 64 off948992 00000040:00080000:3.0:1713481296.562609:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13837, 64 off893760 00000040:00080000:3.0:1713481296.562617:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14701, 64 off949056 00000040:00080000:3.0:1713481296.562626:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13838, 64 off893824 00000040:00080000:3.0:1713481296.562634:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14702, 64 off949120 00000040:00080000:3.0:1713481296.562643:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13839, 64 off893888 00000040:00080000:3.0:1713481296.562651:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14703, 64 off949184 00000040:00080000:3.0:1713481296.562661:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13840, 64 off893952 00000040:00080000:3.0:1713481296.562685:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14704, 64 off949248 00000040:00080000:3.0:1713481296.562695:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13841, 64 off894016 00000040:00080000:3.0:1713481296.562704:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14705, 64 off949312 00000040:00080000:3.0:1713481296.562713:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13842, 64 off894080 00000040:00080000:3.0:1713481296.562721:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14706, 64 off949376 00000040:00080000:3.0:1713481296.562731:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13843, 64 off894144 00000040:00080000:3.0:1713481296.562739:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14707, 64 off949440 00000040:00080000:3.0:1713481296.562748:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13844, 64 off894208 00000040:00080000:3.0:1713481296.562756:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14708, 64 off949504 00000040:00080000:3.0:1713481296.562764:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13845, 64 off894272 00000040:00080000:3.0:1713481296.562773:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14709, 64 off949568 00000040:00080000:3.0:1713481296.562782:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13846, 64 off894336 00000040:00080000:3.0:1713481296.562791:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14710, 64 off949632 00000040:00080000:3.0:1713481296.562799:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13847, 64 off894400 00000040:00080000:3.0:1713481296.562807:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14711, 64 off949696 00000040:00080000:3.0:1713481296.562814:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13848, 64 off894464 00000040:00080000:3.0:1713481296.562823:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14712, 64 off949760 00000040:00080000:3.0:1713481296.562831:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13849, 64 off894528 00000040:00080000:3.0:1713481296.562839:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14713, 64 off949824 00000100:00100000:3.0:1713481296.562872:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784452544:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.562891:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713481296.562915:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13850, 64 off894592 00000040:00080000:3.0:1713481296.562927:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14714, 64 off949888 00000040:00080000:3.0:1713481296.562936:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13851, 64 off894656 00000040:00080000:3.0:1713481296.562944:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14715, 64 off949952 00000040:00080000:3.0:1713481296.562952:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13852, 64 off894720 00000040:00080000:3.0:1713481296.562961:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14716, 64 off950016 00000040:00080000:3.0:1713481296.562970:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13853, 64 off894784 00000040:00080000:3.0:1713481296.562978:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14717, 64 off950080 00000040:00080000:3.0:1713481296.562987:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13854, 64 off894848 00000040:00080000:3.0:1713481296.562995:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14718, 64 off950144 00000040:00080000:3.0:1713481296.563003:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13855, 64 off894912 00000040:00080000:3.0:1713481296.563013:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14719, 64 off950208 00000100:00100000:3.0:1713481296.563041:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882375680 00000100:00100000:3.0:1713481296.563046:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882375680 00000100:00100000:3.0:1713481296.563067:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125642 00000100:00100000:3.0:1713481296.563073:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2069:18578:x1796714882375680:12345-192.168.202.24@tcp:37:rm.0 00000040:00080000:3.0:1713481296.563649:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13856, 64 off894976 00000040:00080000:3.0:1713481296.563658:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14720, 64 off950272 00000040:00080000:3.0:1713481296.563664:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13857, 64 off895040 00000040:00080000:3.0:1713481296.563712:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14721, 64 off950336 00000040:00080000:3.0:1713481296.563719:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13858, 64 off895104 00000040:00080000:3.0:1713481296.563725:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14722, 64 off950400 00000040:00080000:3.0:1713481296.563730:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13859, 64 off895168 00000040:00080000:3.0:1713481296.563736:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14723, 64 off950464 00000040:00080000:3.0:1713481296.563741:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13860, 64 off895232 00000040:00080000:3.0:1713481296.563746:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14724, 64 off950528 00000040:00080000:3.0:1713481296.563751:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13861, 64 off895296 00000040:00080000:3.0:1713481296.563756:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14725, 64 off950592 00000040:00080000:3.0:1713481296.563762:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13862, 64 off895360 00000040:00080000:3.0:1713481296.563767:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14726, 64 off950656 00000040:00080000:3.0:1713481296.563772:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13863, 64 off895424 00000040:00080000:3.0:1713481296.563777:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14727, 64 off950720 00000040:00080000:3.0:1713481296.563782:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13864, 64 off895488 00000040:00080000:3.0:1713481296.563787:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14728, 64 off950784 00000040:00080000:3.0:1713481296.563792:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13865, 64 off895552 00000040:00080000:3.0:1713481296.563798:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14729, 64 off950848 00000040:00080000:3.0:1713481296.563803:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13866, 64 off895616 00000040:00080000:3.0:1713481296.563808:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14730, 64 off950912 00000040:00080000:3.0:1713481296.563813:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13867, 64 off895680 00000040:00080000:3.0:1713481296.563819:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14731, 64 off950976 00000040:00080000:3.0:1713481296.563824:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13868, 64 off895744 00000040:00080000:3.0:1713481296.563829:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14732, 64 off951040 00000040:00080000:3.0:1713481296.563834:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13869, 64 off895808 00000040:00080000:3.0:1713481296.563840:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14733, 64 off951104 00000040:00080000:3.0:1713481296.563845:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13870, 64 off895872 00000040:00080000:3.0:1713481296.563850:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14734, 64 off951168 00000040:00080000:3.0:1713481296.563856:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13871, 64 off895936 00000040:00080000:3.0:1713481296.563861:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14735, 64 off951232 00000040:00080000:3.0:1713481296.563866:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13872, 64 off896000 00000040:00080000:3.0:1713481296.563872:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14736, 64 off951296 00000040:00080000:3.0:1713481296.563877:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13873, 64 off896064 00000040:00080000:3.0:1713481296.563882:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14737, 64 off951360 00000040:00080000:3.0:1713481296.563887:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13874, 64 off896128 00000040:00080000:3.0:1713481296.563892:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14738, 64 off951424 00000040:00080000:3.0:1713481296.563897:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13875, 64 off896192 00000040:00080000:3.0:1713481296.563901:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14739, 64 off951488 00000040:00080000:3.0:1713481296.563906:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13876, 64 off896256 00000040:00080000:3.0:1713481296.563911:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14740, 64 off951552 00000040:00080000:3.0:1713481296.563916:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13877, 64 off896320 00000040:00080000:3.0:1713481296.563921:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14741, 64 off951616 00000040:00080000:3.0:1713481296.563925:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13878, 64 off896384 00000040:00080000:3.0:1713481296.563930:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14742, 64 off951680 00000040:00080000:3.0:1713481296.563935:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13879, 64 off896448 00000040:00080000:3.0:1713481296.563939:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14743, 64 off951744 00000040:00080000:3.0:1713481296.563944:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13880, 64 off896512 00000040:00080000:3.0:1713481296.563949:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14744, 64 off951808 00000040:00080000:3.0:1713481296.563953:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13881, 64 off896576 00000040:00080000:3.0:1713481296.563958:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14745, 64 off951872 00000040:00080000:3.0:1713481296.563963:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13882, 64 off896640 00000040:00080000:3.0:1713481296.563968:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14746, 64 off951936 00000040:00080000:3.0:1713481296.563973:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13883, 64 off896704 00000040:00080000:3.0:1713481296.563978:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14747, 64 off952000 00000040:00080000:3.0:1713481296.563982:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13884, 64 off896768 00000040:00080000:3.0:1713481296.563987:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14748, 64 off952064 00000040:00080000:3.0:1713481296.563992:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13885, 64 off896832 00000040:00080000:3.0:1713481296.563997:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14749, 64 off952128 00000040:00080000:3.0:1713481296.564002:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13886, 64 off896896 00000040:00080000:3.0:1713481296.564007:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14750, 64 off952192 00000040:00080000:3.0:1713481296.564012:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13887, 64 off896960 00000040:00080000:3.0:1713481296.564017:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14751, 64 off952256 00000040:00080000:3.0:1713481296.564022:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13888, 64 off897024 00000040:00080000:3.0:1713481296.564026:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14752, 64 off952320 00000040:00080000:3.0:1713481296.564044:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13889, 64 off897088 00000040:00080000:3.0:1713481296.564051:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14753, 64 off952384 00000040:00080000:3.0:1713481296.564056:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13890, 64 off897152 00000040:00080000:3.0:1713481296.564061:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14754, 64 off952448 00000040:00080000:3.0:1713481296.564066:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13891, 64 off897216 00000040:00080000:3.0:1713481296.564071:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14755, 64 off952512 00000040:00080000:3.0:1713481296.564076:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13892, 64 off897280 00000040:00080000:3.0:1713481296.564081:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14756, 64 off952576 00000040:00080000:3.0:1713481296.564086:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13893, 64 off897344 00000040:00080000:3.0:1713481296.564091:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14757, 64 off952640 00000040:00080000:3.0:1713481296.564096:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13894, 64 off897408 00000040:00080000:3.0:1713481296.564100:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14758, 64 off952704 00000040:00080000:3.0:1713481296.564105:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13895, 64 off897472 00000040:00080000:3.0:1713481296.564110:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14759, 64 off952768 00000040:00080000:3.0:1713481296.564115:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13896, 64 off897536 00000040:00080000:3.0:1713481296.564135:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14760, 64 off952832 00000040:00080000:3.0:1713481296.564141:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13897, 64 off897600 00000040:00080000:3.0:1713481296.564147:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14761, 64 off952896 00000040:00080000:3.0:1713481296.564152:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13898, 64 off897664 00000040:00080000:3.0:1713481296.564157:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14762, 64 off952960 00000040:00080000:3.0:1713481296.564162:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13899, 64 off897728 00000040:00080000:3.0:1713481296.564170:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14763, 64 off953024 00000040:00080000:3.0:1713481296.564178:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13900, 64 off897792 00000040:00080000:3.0:1713481296.564186:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14764, 64 off953088 00000040:00080000:3.0:1713481296.564194:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13901, 64 off897856 00000040:00080000:3.0:1713481296.564202:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14765, 64 off953152 00000040:00080000:3.0:1713481296.564211:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13902, 64 off897920 00000040:00080000:3.0:1713481296.564219:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14766, 64 off953216 00000040:00080000:3.0:1713481296.564227:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13903, 64 off897984 00000040:00080000:3.0:1713481296.564235:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14767, 64 off953280 00000040:00080000:3.0:1713481296.564243:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13904, 64 off898048 00000040:00080000:3.0:1713481296.564252:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14768, 64 off953344 00000040:00080000:3.0:1713481296.564261:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13905, 64 off898112 00000040:00080000:3.0:1713481296.564269:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14769, 64 off953408 00000040:00080000:3.0:1713481296.564278:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13906, 64 off898176 00000040:00080000:3.0:1713481296.564286:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14770, 64 off953472 00000040:00080000:3.0:1713481296.564295:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13907, 64 off898240 00000040:00080000:3.0:1713481296.564302:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14771, 64 off953536 00000040:00080000:3.0:1713481296.564311:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13908, 64 off898304 00000040:00080000:3.0:1713481296.564319:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14772, 64 off953600 00000040:00080000:3.0:1713481296.564327:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13909, 64 off898368 00000040:00080000:3.0:1713481296.564335:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14773, 64 off953664 00000040:00080000:3.0:1713481296.564344:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13910, 64 off898432 00000040:00080000:3.0:1713481296.564352:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14774, 64 off953728 00000040:00080000:3.0:1713481296.564360:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13911, 64 off898496 00000040:00080000:3.0:1713481296.564368:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14775, 64 off953792 00000040:00080000:3.0:1713481296.564376:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13912, 64 off898560 00000040:00080000:3.0:1713481296.564384:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14776, 64 off953856 00000040:00080000:3.0:1713481296.564392:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13913, 64 off898624 00000040:00080000:3.0:1713481296.564401:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14777, 64 off953920 00000040:00080000:3.0:1713481296.564410:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13914, 64 off898688 00000040:00080000:3.0:1713481296.564419:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14778, 64 off953984 00000040:00080000:3.0:1713481296.564427:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13915, 64 off898752 00000040:00080000:3.0:1713481296.564435:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14779, 64 off954048 00000040:00080000:3.0:1713481296.564443:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13916, 64 off898816 00000040:00080000:3.0:1713481296.564452:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14780, 64 off954112 00000040:00080000:3.0:1713481296.564457:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13917, 64 off898880 00000040:00080000:3.0:1713481296.564463:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14781, 64 off954176 00000040:00080000:3.0:1713481296.564468:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13918, 64 off898944 00000040:00080000:3.0:1713481296.564473:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14782, 64 off954240 00000040:00080000:3.0:1713481296.564479:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13919, 64 off899008 00000040:00080000:3.0:1713481296.564484:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14783, 64 off954304 00000040:00080000:3.0:1713481296.564490:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13920, 64 off899072 00000040:00080000:3.0:1713481296.564495:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14784, 64 off954368 00000040:00080000:3.0:1713481296.564500:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13921, 64 off899136 00000040:00080000:3.0:1713481296.564525:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14785, 64 off954432 00000040:00080000:3.0:1713481296.564531:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13922, 64 off899200 00000040:00080000:3.0:1713481296.564536:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14786, 64 off954496 00000040:00080000:3.0:1713481296.564541:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13923, 64 off899264 00000040:00080000:3.0:1713481296.564546:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14787, 64 off954560 00000040:00080000:3.0:1713481296.564551:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13924, 64 off899328 00000040:00080000:3.0:1713481296.564557:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14788, 64 off954624 00010000:00010000:3.0:1713481296.565000:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565008:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565013:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565017:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565020:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565024:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565026:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565033:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ff2b840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.565035:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565039:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565043:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x389b:0x0].0x0 (ffff880083123300) 00010000:00010000:3.0:1713481296.565044:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.565046:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 3/0,0 mode: --/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565049:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b840/0xdfc0fb148a37caf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x389b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565067:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565070:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565072:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565075:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ff2b180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.565077:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565080:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565084:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x389b:0x0].0x0 (ffff880083123300) 00010000:00010000:3.0:1713481296.565085:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.565087:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.565090:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff2b180/0xdfc0fb148a37a78 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x389b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713481296.565177:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078706300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784449472:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.565200:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.565214:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20909:1960:x1796714882369344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 27233us (27290us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.565220:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819939 00000100:00100000:3.0:1713481296.565297:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882375488 00000100:00100000:3.0:1713481296.565299:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882375488 00010000:00010000:3.0:1713481296.565309:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007833f840/0xdfc0fb148688575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2456 expref: 26650 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.565322:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819968 00000100:00100000:3.0:1713481296.565325:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800773c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26650:1957:x1796714882375488:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.565330:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.565333:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007833f840/0xdfc0fb148688575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2456 expref: 26650 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.565340:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007833f840/0xdfc0fb148688575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2456 expref: 26650 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.565355:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007833f840/0xdfc0fb148688575 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2456 expref: 26650 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.565367:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.565368:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.565370:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565375:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565387:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.565396:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800773c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26649:1957:x1796714882375488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.565399:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819968 00010000:00010000:3.0:1713481296.565424:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009986a1c0/0xdfc0fb14868841e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d241e expref: 26648 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.565434:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784450624:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.565453:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565459:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565462:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565467:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565472:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565476:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565479:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800961e5680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.565480:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565484:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565493:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565496:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800961e5680/0xdfc0fb148a37a39 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.565618:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2630:3490:x1796714784450368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 25204us (25419us total) trans 4295960567 rc 0/0 00000100:00100000:3.0:1713481296.565622:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561903 00010000:00010000:3.0:1713481296.565648:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565653:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565658:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565662:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565679:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565682:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ff2af40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.565683:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565687:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565696:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.565700:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ff2af40/0xdfc0fb148a37bac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.565805:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2630:3490:x1796714784452416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9332us (9554us total) trans 4295960568 rc 0/0 00000100:00100000:3.0:1713481296.565809:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561918 00010000:00010000:3.0:1713481296.566005:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566010:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566013:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566016:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566019:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086b48000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.566020:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566023:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566029:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x238:0x0].0x0 (ffff880134a79d00) 00010000:00010000:3.0:1713481296.566030:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.566032:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 3/0,0 mode: --/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566034:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880086b48000/0xdfc0fb148a37aef lrc: 0/0,0 mode: --/CW res: [0x200000400:0x238:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00000004:00010000:3.0:1713481296.566056:0:15577:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88011e064380 reply state ffff88007da4d000 transno 4295105876 ns: mdt-lustre-MDT0000_UUID lock: ffff880092e89680/0xdfc0fb148a37af6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x238:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566062:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e89680/0xdfc0fb148a37af6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x238:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.566066:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x238:0x0].0x3231 (ffff8801205dcc00) 00010000:00010000:3.0:1713481296.566067:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.566069:0:15577:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.566088:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2196:18604:x1796714882371520:12345-192.168.202.24@tcp:36:rm.0 Request processed in 16472us (16497us total) trans 4295105876 rc 0/0 00000100:00100000:3.0:1713481296.566093:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485685 00000100:00100000:3.0:1713481296.566115:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784454016 00000100:00100000:3.0:1713481296.566117:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784454016 00000100:00100000:3.0:1713481296.566149:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784454080 00000100:00100000:3.0:1713481296.566151:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784454080 00000100:00100000:3.0:1713481296.566160:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561936 00000100:00100000:3.0:1713481296.566163:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801209b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2631:3490:x1796714784454016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.566171:0:15499:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43186 count 1 00010000:00010000:3.0:1713481296.566182:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.566194:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007833db00/0xdfc0fb148688671 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24b8 expref: 26647 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.566200:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.566201:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.566203:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.566221:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007833db00/0xdfc0fb148688671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24b8 expref: 26647 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.566230:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007833db00/0xdfc0fb148688671 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24b8 expref: 26647 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.566240:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784454144:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.566259:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.569231:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569237:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569240:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569243:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569246:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c2e0480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.569248:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569251:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569257:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380a:0x0].0x0 (ffff880083123e00) 00010000:00010000:3.0:1713481296.569259:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.569261:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 3/0,0 mode: --/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569266:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0480/0xdfc0fb148a37a6a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000004:00010000:3.0:1713481296.569288:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009299e680 reply state ffff88009cd64000 transno 4295105877 ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569297:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.569307:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380a:0x0].0x3331 (ffff880083123a00) 00010000:00010000:3.0:1713481296.569309:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.569312:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.569337:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784454336 00000100:00100000:3.0:1713481296.569339:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784454336 00000100:00100000:3.0:1713481296.569362:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20389 00000100:00100000:3.0:1713481296.569366:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15497:x1796714784454336:12345-0@lo:105: 00010000:00010000:3.0:1713481296.569373:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569379:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569385:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569389:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569392:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569397:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569410:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880096f6f600) 00000100:00100000:3.0:1713481296.569440:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15497:x1796714784454336:12345-0@lo:105: Request processed in 73us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.569445:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20389 00010000:00010000:3.0:1713481296.569464:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569469:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.569492:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1713481296.569564:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.569570:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.569578:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.569591:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784454592:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.569612:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.569628:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a780 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.569644:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784454592 00000100:00100000:3.0:1713481296.569646:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784454592 00000100:00100000:3.0:1713481296.569678:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82835 00000100:00100000:3.0:1713481296.569682:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:15514:x1796714784454592:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.569692:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.569700:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6d00/0xdfc0fb148a37d1f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a37d18 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569711:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6d00/0xdfc0fb148a37d1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a37d18 expref: 16 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569717:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6d00/0xdfc0fb148a37d1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37d18 expref: 16 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569722:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.569724:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.569725:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800833e6d00, rc 0) 00000100:00100000:3.0:1713481296.569745:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:15514:x1796714784454592:12345-0@lo:101:mdt_io00_009.0 Request processed in 63us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.569749:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82835 00000100:00100000:3.0:1713481296.569770:0:15514:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295105875 gen 2 00000004:00080000:3.0:1713481296.569774:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295105875 committed transno 4295105875 00000100:00100000:3.0:1713481296.569826:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784454592:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.569834:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37d1f expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569839:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d1f expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.569849:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:3.0:1713481296.569860:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.569863:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.569867:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.569873:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784454656:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.569885:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.569895:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a780 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.569906:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784454656 00000100:00100000:3.0:1713481296.569908:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784454656 00000100:00100000:3.0:1713481296.569919:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82836 00000100:00100000:3.0:1713481296.569921:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:15514:x1796714784454656:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.569926:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.569932:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a37d26 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569940:0:8640:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.569944:0:8640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 4/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a37d26 expref: 17 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569951:0:8640:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.569959:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 3/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37d26 expref: 17 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569963:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x34 (ffff880096ca1a00) 00010000:00010000:3.0:1713481296.569965:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.569967:0:8640:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 3/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37d26 expref: 17 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.569970:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800833e6ac0, rc 0) 00000100:00100000:3.0:1713481296.569986:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:15514:x1796714784454656:12345-0@lo:101:mdt_io00_009.0 Request processed in 63us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.569989:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82836 00000100:00100000:3.0:1713481296.570006:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2a8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784454656:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.570013:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.570017:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.570036:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882376000 00000100:00100000:3.0:1713481296.570038:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882376000 00000100:00100000:3.0:1713481296.570049:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125643 00000100:00100000:3.0:1713481296.570052:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2072:18811:x1796714882376000:12345-192.168.202.24@tcp:35:dir_create.sh.0 00000100:00100000:3.0:1713481296.570173:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2073:18811:x1796714882376000:12345-192.168.202.24@tcp:35:dir_create.sh.0 Request processed in 120us (876us total) trans 4295107533 rc 0/0 00000100:00100000:3.0:1713481296.570177:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125643 00010000:00080000:3.0:1713481296.570194:0:15483:0:(ldlm_lib.c:3380:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1713481296.570202:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2183:18580:x1796714882370816:12345-192.168.202.24@tcp:36:rm.0 Request processed in 28934us (30285us total) trans 4295105877 rc 0/0 00000100:00100000:3.0:1713481296.570207:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485680 00010000:00010000:3.0:1713481296.570255:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.570262:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.570267:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.570272:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c2e0fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.570274:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.570284:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.570292:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380a:0x0].0x3331 (ffff880083123a00) 00010000:00010000:3.0:1713481296.570294:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.570297:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.570302:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c2e0fc0/0xdfc0fb148a37a71 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x380a:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000004:00080000:3.0:1713481296.570349:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b0a9880/2, rc 0, transno 1073378 00000100:00100000:3.0:1713481296.570354:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784430592:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713481296.570374:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086b46d80/2, rc 0, transno 993262 00000100:00100000:3.0:1713481296.570381:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784450432:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.570419:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.570425:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784454720:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.570447:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.570471:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784454720 00000100:00100000:3.0:1713481296.570474:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784454720 00000100:00100000:3.0:1713481296.570500:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561940 00000100:00100000:3.0:1713481296.570505:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2632:3492:x1796714784454720:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.570516:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43188 count 1 00010000:00010000:3.0:1713481296.570526:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800833e5440/0xdfc0fb148a37d34 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.570537:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132b27600/0xdfc0fb14868867f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24d4 expref: 26647 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.570549:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.570550:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.570552:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800833e5440/0xdfc0fb148a37d34 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.570567:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132b27600/0xdfc0fb14868867f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24d4 expref: 26647 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.570575:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132b27600/0xdfc0fb14868867f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24d4 expref: 26647 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.570585:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784454784:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.570599:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.570681:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.570742:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.570755:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882376192 00000100:00100000:3.0:1713481296.570757:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882376192 00000100:00100000:3.0:1713481296.570768:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882376320 00000100:00100000:3.0:1713481296.570769:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882376320 00000100:00100000:3.0:1713481296.570777:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485700 00000100:00100000:3.0:1713481296.570780:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2074:18805:x1796714882376192:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.570786:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.570792:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e4000/0xdfc0fb148a37d3b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47a2e expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.570846:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.570853:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570858:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570863:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.570867:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570871:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570910:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c599d40/0xdfc0fb148a37d50 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.570915:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c599d40/0xdfc0fb148a37d50 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570918:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c599d40/0xdfc0fb148a37d50 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000004:00200000:3.0:1713481296.570931:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cb0:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.570934:0:15577:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.570941:0:15577:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c599d40/0xdfc0fb148a37d50 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570945:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570949:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570955:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570958:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570961:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800833e5680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.570962:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570965:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570969:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009285f800) 00010000:00010000:3.0:1713481296.570970:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.570972:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570975:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e5680/0xdfc0fb148a37d42 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570986:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570989:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570992:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.570995:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800833e7840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.570996:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.571002:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.571006:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x37 (ffff8801225f6e00) 00010000:00010000:3.0:1713481296.571007:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.571008:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.571011:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e7840/0xdfc0fb148a37d49 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.571029:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800833e4000/0xdfc0fb148a37d3b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a2e expref: 2076 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.571040:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c599d40/0xdfc0fb148a37d50 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a2e expref: 2075 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.571043:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x0 (ffff8801322ecf00) 00010000:00010000:3.0:1713481296.571044:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713481296.571046:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c599d40, rc 0) 00000100:00100000:3.0:1713481296.571056:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2075:18805:x1796714882376192:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 275us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.571060:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485700 00000100:00100000:3.0:1713481296.571075:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485701 00000100:00100000:3.0:1713481296.571078:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2074:18753:x1796714882376320:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:3.0:1713481296.571089:0:15577:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.571096:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff29b00/0xdfc0fb148a37bd6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478bb expref: 2074 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.571113:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb5:0x0].0x0 (ffff88009d25cb00) 00010000:00010000:3.0:1713481296.571138:0:15577:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.571173:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.571178:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.571182:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000004:00010000:3.0:1713481296.571213:0:15577:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800921b9f80 reply state ffff880096902000 transno 4295107534 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.571218:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.571221:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb5:0x0].0x0 (ffff88009a8d0500) 00010000:00010000:3.0:1713481296.571222:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.571223:0:15577:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.571242:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2075:18753:x1796714882376320:12345-192.168.202.24@tcp:36:touch.0 Request processed in 163us (500us total) trans 4295107534 rc 0/0 00000100:00100000:3.0:1713481296.571245:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485701 00000100:00100000:3.0:1713481296.572840:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2401:18729:x1796714882374592:12345-192.168.202.24@tcp:37:rm.0 Request processed in 13529us (13590us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.572848:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125641 00000100:00100000:3.0:1713481296.572942:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078377b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000-mdtlov_UUID:15512:1796714784454400:0@lo:403:mdt_io00_007.0 00010000:00010000:3.0:1713481296.574507:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a3b6d00/0xdfc0fb148a37ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574516:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a3b6d00/0xdfc0fb148a37ce0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574519:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a3b6d00/0xdfc0fb148a37ce0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574522:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a3b6d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.574524:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a3b6d00/0xdfc0fb148a37ce0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574527:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a3b6d00/0xdfc0fb148a37ce0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574533:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f8:0x0].0x0 (ffff88009c077200) 00010000:00010000:3.0:1713481296.574534:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.574536:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a3b6d00/0xdfc0fb148a37ce0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574539:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a3b6d00/0xdfc0fb148a37ce0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574560:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f0b40/0xdfc0fb148a37cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51a8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574563:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f0b40/0xdfc0fb148a37cd9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x51a8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574567:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f0b40/0xdfc0fb148a37cd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574569:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a8f0b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.574571:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f0b40/0xdfc0fb148a37cd9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574576:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f0b40/0xdfc0fb148a37cd9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x51a8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574581:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a8:0x0].0x0 (ffff88013054d900) 00010000:00010000:3.0:1713481296.574582:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1713481296.574584:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f0b40/0xdfc0fb148a37cd9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51a8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574586:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f0b40/0xdfc0fb148a37cd9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x51a8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574613:0:15512:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574616:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574618:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574621:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574623:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a8f18c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.574625:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574629:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574633:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.574634:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.574635:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574639:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f18c0/0xdfc0fb148a37cc4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574651:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574654:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574657:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574660:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a8f3a80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.574661:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574664:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.574682:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x34 (ffff880096ca1a00) 00010000:00010000:3.0:1713481296.574683:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.574686:0:15512:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37d26 expref: 19 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574691:0:15512:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a37d26 expref: 19 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574696:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a37d26 expref: 19 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574709:0:15512:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800833e6ac0/0xdfc0fb148a37d2d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37d26 expref: 19 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.574719:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15512:1796714784455488:0@lo:105: 00000100:00100000:3.0:1713481296.574747:0:15512:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.574760:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.574776:0:6917:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1713481296.574781:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784455488 00000100:00100000:3.0:1713481296.574783:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784455488 00000100:00100000:3.0:1713481296.574795:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20390 00000100:00100000:3.0:1713481296.574798:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089ada850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:15512:x1796714784455488:12345-0@lo:105: 00010000:00010000:3.0:1713481296.574803:0:6917:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574808:0:6917:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574812:0:6917:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574816:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 5/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574819:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 6/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574823:0:6917:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 6/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574833:0:6917:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800833e4900) 00000100:00100000:3.0:1713481296.574847:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089ada850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:15512:x1796714784455488:12345-0@lo:105: Request processed in 48us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.574851:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20390 00010000:00010000:3.0:1713481296.574928:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.574932:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.574942:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:3.0:1713481296.574961:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078376a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784455552:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.574974:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.574983:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.574992:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784455552 00000100:00100000:3.0:1713481296.574994:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784455552 00000100:00100000:3.0:1713481296.575006:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82842 00000100:00100000:3.0:1713481296.575009:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:15514:x1796714784455552:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.575041:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:15514:x1796714784455552:12345-0@lo:1000:mdt_io00_009.0 Request processed in 32us (66us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.575045:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82842 00000100:00100000:3.0:1713481296.575065:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078376a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784455552:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.575095:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078376a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784455744:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.575109:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.575134:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092a4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.575154:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82843 00000100:00100000:3.0:1713481296.575158:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+21:8077:x1796714784455680:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713481296.575337:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+21:8077:x1796714784455680:12345-0@lo:1000:osp_up0-1.0 Request processed in 178us (268us total) trans 4295105878 rc 0/0 00000100:00100000:3.0:1713481296.575345:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82843 00000100:00100000:3.0:1713481296.575364:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784455808 00000100:00100000:3.0:1713481296.575366:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784455808 00000100:00100000:3.0:1713481296.575374:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82845 00000100:00100000:3.0:1713481296.575376:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+21:15514:x1796714784455808:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.575416:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+21:15514:x1796714784455808:12345-0@lo:1000:mdt_io00_009.0 Request processed in 38us (59us total) trans 0 rc 1/1 00000100:00100000:3.0:1713481296.575420:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82845 00000100:00100000:3.0:1713481296.575443:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0000_UUID:15512:1796714784455488:0@lo:105: 00010000:00010000:3.0:1713481296.575456:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575460:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f3a80/0xdfc0fb148a37ccb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575476:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f2880/0xdfc0fb148a37cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575480:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f2880/0xdfc0fb148a37cd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575483:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f2880/0xdfc0fb148a37cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575486:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a8f2880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.575488:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f2880/0xdfc0fb148a37cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575491:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f2880/0xdfc0fb148a37cd2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575501:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff880094282800) 00010000:00010000:3.0:1713481296.575503:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.575505:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f2880/0xdfc0fb148a37cd2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575508:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a8f2880/0xdfc0fb148a37cd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:3.0:1713481296.575538:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713481296.575542:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880135cd0900/0xdfc0fb148a37d9d lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a37da4 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.575546:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135cd0900 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:3.0:1713481296.575549:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880135cd0900/0xdfc0fb148a37d9d lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a37da4 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713481296.575554:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880135cd0900/0xdfc0fb148a37d9d lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a37da4 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.575566:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880135cd0900/0xdfc0fb148a37d9d lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a37da4 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.575570:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713481296.575577:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880135cd0900/0xdfc0fb148a37d9d lrc: 1/0,0 mode: --/EX res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a37da4 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.575581:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880135cd0900/0xdfc0fb148a37d9d lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a37da4 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.575602:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.575604:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.575605:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713481296.575611:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800918c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784455872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.575624:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.575648:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784455872 00000100:00100000:3.0:1713481296.575650:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784455872 00000100:00100000:3.0:1713481296.575664:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98316 00000100:00100000:3.0:1713481296.575682:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+21:3492:x1796714784455872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.575687:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.575694:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008405f840/0xdfc0fb148a37da4 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c5b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a37d9d expref: 21 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.575704:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c5b:0x0].0x0 (ffff8800915bfb00) 00010000:00010000:3.0:1713481296.575710:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.575729:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+20:3492:x1796714784455872:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.575733:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98316 00000100:00100000:3.0:1713481296.575757:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800918c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784455872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.575767:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.575771:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012002ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784455936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.575781:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.575798:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784455936 00000100:00100000:3.0:1713481296.575800:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784455936 00000100:00100000:3.0:1713481296.575810:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98317 00000100:00100000:3.0:1713481296.575812:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3492:x1796714784455936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.575816:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.575823:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009de74240/0xdfc0fb148a37d88 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a37d81 expref: 20 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.575840:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88009c41d700) 00010000:00010000:3.0:1713481296.575852:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.575872:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+19:3492:x1796714784455936:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.575875:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98317 00000100:00100000:3.0:1713481296.575891:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012002ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784455936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.575915:0:15512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2182:18852:x1796714882375872:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 8671us (8715us total) trans 0 rc -39/-39 00000100:00100000:3.0:1713481296.575920:0:15512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26095 00000100:00100000:3.0:1713481296.576040:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.576061:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.576069:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882376832 00000100:00100000:3.0:1713481296.576070:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882376832 00010000:00010000:3.0:1713481296.576079:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083a686c0/0xdfc0fb1489cef8e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21e36 expref: 20916 pid: 16505 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.576087:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882376896 00000100:00100000:3.0:1713481296.576089:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882376896 00010000:00010000:3.0:1713481296.576096:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007833e1c0/0xdfc0fb148688632 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2472 expref: 26646 pid: 16452 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.576105:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819971 00000100:00100000:3.0:1713481296.576108:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20916:1959:x1796714882376832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.576113:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.576115:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083a686c0/0xdfc0fb1489cef8e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21e36 expref: 20916 pid: 16505 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.576137:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083a686c0/0xdfc0fb1489cef8e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21e36 expref: 20916 pid: 16505 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.576153:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083a686c0/0xdfc0fb1489cef8e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x8768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21e36 expref: 20916 pid: 16505 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.576165:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.576166:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.576169:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932e7cc0/0xdfc0fb148a37c07 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x8768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479d3 expref: 16440 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576174:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e7cc0/0xdfc0fb148a37c07 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479d3 expref: 16440 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576186:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800932e7cc0/0xdfc0fb148a37c07 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479d3 expref: 16440 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.576192:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784456064:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.576204:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff880133c83f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.576215:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819972 00000100:00100000:3.0:1713481296.576218:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26646:1959:x1796714882376896:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.576222:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.576225:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007833e1c0/0xdfc0fb148688632 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2472 expref: 26646 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.576238:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007833e1c0/0xdfc0fb148688632 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2472 expref: 26646 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.576255:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007833e1c0/0xdfc0fb148688632 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2472 expref: 26646 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.576266:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.576267:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.576270:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576277:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576296:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.576310:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26645:1959:x1796714882376896:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.576316:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819972 00010000:00010000:3.0:1713481296.576336:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576343:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576350:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576360:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576366:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576371:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095ec73c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.576374:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576380:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576396:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.576402:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ec73c0/0xdfc0fb148a37c00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.576560:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2635:3492:x1796714784452928:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17686us (17713us total) trans 4295960571 rc 0/0 00000100:00100000:3.0:1713481296.576566:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561925 00000004:00080000:3.0:1713481296.576617:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fe3d880/2, rc 0, transno 993275 00000100:00100000:3.0:1713481296.576636:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fe3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784452928:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.578148:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2073:18578:x1796714882375680:12345-192.168.202.24@tcp:37:rm.0 Request processed in 15072us (15135us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.578156:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125642 00000100:00100000:3.0:1713481296.578241:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882377664 00000100:00100000:3.0:1713481296.578245:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882377664 00000100:00100000:3.0:1713481296.578270:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125644 00000100:00100000:3.0:1713481296.578275:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800771eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2181:18880:x1796714882377664:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:3.0:1713481296.578393:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800771eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2182:18880:x1796714882377664:12345-192.168.202.24@tcp:35:touch.0 Request processed in 115us (171us total) trans 4295105879 rc 0/0 00000100:00100000:3.0:1713481296.578400:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125644 00000100:00100000:3.0:1713481296.579962:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561949 00000100:00100000:3.0:1713481296.579969:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16439:17935:x1796714882377920:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.579978:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.579991:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c5986c0/0xdfc0fb148a37e0d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47a74 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.580008:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.580019:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.580021:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.580025:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c5986c0/0xdfc0fb148a37e0d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a74 expref: 16440 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.580036:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c5986c0/0xdfc0fb148a37e0d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a74 expref: 16440 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.580045:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c5986c0, rc 0) 00000100:00100000:3.0:1713481296.580067:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16440:17935:x1796714882377920:12345-192.168.202.24@tcp:101:dd.0 Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.580074:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561949 00000100:00100000:3.0:1713481296.580167:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.580208:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882378496 00000100:00100000:3.0:1713481296.580212:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882378496 00000100:00100000:3.0:1713481296.580242:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485706 00000100:00100000:3.0:1713481296.580249:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2074:18805:x1796714882378496:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.580258:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.580267:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a37e14 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47a82 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.580357:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.580367:0:15484:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880092e8a400/0xdfc0fb148a37b19 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47947 expref: 2401 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.580375:0:15484:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 4/0,1 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.580393:0:15484:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880092e8a400/0xdfc0fb148a37b19 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47947 expref: 2401 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.580402:0:15484:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880092e8a400/0xdfc0fb148a37b19 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47947 expref: 2401 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.580411:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec53480 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796714784456512:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.580450:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009837e540 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.580570:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.580608:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784454144:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.580633:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.580917:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784454784:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.580936:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800833e5440/0xdfc0fb148a37d34 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.580994:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784456064:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.581006:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.581020:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20914:1959:x1796714882376832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4911us (4980us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.581027:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819971 00000100:00100000:3.0:1713481296.581133:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880136150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784454848:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.581155:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009de77a80/0xdfc0fb148a37d6c lrc: 3/0,0 mode: --/PW res: [0x280000407:0xc172:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a43 expref: 20913 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.581163:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009de77a80, rc 0) 00000100:00100000:3.0:1713481296.581180:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007965aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20913:14753:x1796714882376512:12345-192.168.202.24@tcp:101:dd.0 Request processed in 9016us (9078us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.581185:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561943 00000100:00100000:3.0:1713481296.581218:0:16460:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007956f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784455040:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.581232:0:16460:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.581255:0:15522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099199180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:15522:1796714784456192:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.581271:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008405df80/0xdfc0fb148a37dc7 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37dc0 expref: 21 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.581276:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff8801237a3200) 00010000:00010000:3.0:1713481296.581278:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.581281:0:15522:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008405df80/0xdfc0fb148a37dc7 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a37dc0 expref: 21 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.581285:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008405df80, rc 0) 00000100:00100000:3.0:1713481296.581306:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+21:15514:x1796714784456128:12345-0@lo:101:mdt_io00_009.0 Request processed in 5001us (5049us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.581310:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82847 00000100:00100000:3.0:1713481296.581332:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784456320:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.581343:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.582870:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.582885:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882379072 00000100:00100000:3.0:1713481296.582888:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882379072 00000100:00100000:3.0:1713481296.582917:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561950 00000100:00100000:3.0:1713481296.582923:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26645:18817:x1796714882379072:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.582933:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.582944:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a2ad200/0xdfc0fb148a37e3e lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47a90 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.582967:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d7f180/0xdfc0fb1489cf0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21ea6 expref: 24470 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.582974:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.582975:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.582978:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a2ad200/0xdfc0fb148a37e3e lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a90 expref: 26646 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.582997:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d7f180/0xdfc0fb1489cf0c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21ea6 expref: 24470 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.583006:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d7f180/0xdfc0fb1489cf0c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21ea6 expref: 24470 pid: 16490 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.583017:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784456576:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.583038:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134d69c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.583068:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.583088:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882379968 00000100:00100000:3.0:1713481296.583092:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882379968 00000100:00100000:3.0:1713481296.583109:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882379008 00000100:00100000:3.0:1713481296.583112:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882379008 00000100:00100000:3.0:1713481296.583149:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485708 00000100:00100000:3.0:1713481296.583154:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2181:18578:x1796714882379968:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.583169:0:6932:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.583180:0:6932:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d4a400/0xdfc0fb148a37e45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ae4 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.583265:0:6932:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385d:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.583328:0:6932:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d4a400/0xdfc0fb148a37e45 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ae4 expref: 2183 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.583336:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d4a400/0xdfc0fb148a37e45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ae4 expref: 2183 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.583353:0:6932:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d4a400, rc 0) 00000100:00100000:3.0:1713481296.583374:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2182:18578:x1796714882379968:12345-192.168.202.24@tcp:101:rm.0 Request processed in 219us (543us total) trans 4295105880 rc 301/301 00000100:00100000:3.0:1713481296.583380:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485708 00000100:00100000:3.0:1713481296.583520:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.583562:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.583620:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.583635:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882379264 00000100:00100000:3.0:1713481296.583639:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882379264 00000100:00100000:3.0:1713481296.583658:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561952 00000100:00100000:3.0:1713481296.583664:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16442:17009:x1796714882379264:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.583688:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.583702:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d34240/0xdfc0fb148a37e76 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47aa5 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.583715:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.583725:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.583727:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.583732:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d34240/0xdfc0fb148a37e76 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aa5 expref: 16443 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.583743:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d34240/0xdfc0fb148a37e76 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aa5 expref: 16443 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.583751:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d34240, rc 0) 00000100:00100000:3.0:1713481296.583773:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16443:17009:x1796714882379264:12345-192.168.202.24@tcp:101:dd.0 Request processed in 108us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.583780:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561952 00000100:00100000:3.0:1713481296.583820:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.583837:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882379328 00000100:00100000:3.0:1713481296.583840:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882379328 00000100:00100000:3.0:1713481296.583859:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485711 00000100:00100000:3.0:1713481296.583864:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2079:18678:x1796714882379328:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.583873:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.583882:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096d34000/0xdfc0fb148a37e84 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47aac expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.583946:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.583955:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.583962:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.583973:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.583982:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.583987:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584031:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2f40/0xdfc0fb148a37ea0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.584038:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2f40/0xdfc0fb148a37ea0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584044:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2f40/0xdfc0fb148a37ea0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000004:00200000:3.0:1713481296.584064:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3463:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.584066:0:15577:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.584076:0:15577:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2f40/0xdfc0fb148a37ea0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584083:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584089:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584094:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584100:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584104:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834d3a80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.584107:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584113:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584143:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x0 (ffff88007ab6ad00) 00010000:00010000:3.0:1713481296.584146:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.584150:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 3/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584155:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3a80/0xdfc0fb148a37e8b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584173:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584180:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584185:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584190:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834d3600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.584192:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584198:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584204:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x3631 (ffff88009a8d0b00) 00010000:00010000:3.0:1713481296.584206:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.584209:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584214:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d3600/0xdfc0fb148a37e92 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.584249:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096d34000/0xdfc0fb148a37e84 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aac expref: 2080 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584271:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2f40/0xdfc0fb148a37ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aac expref: 2079 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584277:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:3.0:1713481296.584279:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.584282:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800834d2f40, rc 0) 00000100:00100000:3.0:1713481296.584304:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2079:18678:x1796714882379328:12345-192.168.202.24@tcp:101:rm.0 Request processed in 440us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.584311:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485711 00000100:00100000:3.0:1713481296.584407:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.584450:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.584493:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.584512:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882378240 00000100:00100000:3.0:1713481296.584515:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882378240 00010000:00010000:3.0:1713481296.584529:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007833db00/0xdfc0fb148688671 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24b8 expref: 26647 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.584553:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819977 00000100:00100000:3.0:1713481296.584558:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20912:1959:x1796714882378432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.584566:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.584581:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121cb8900/0xdfc0fb148916d52 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6530 expref: 20912 pid: 16536 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.584596:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121cb8900/0xdfc0fb148916d52 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6530 expref: 20912 pid: 16536 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.584614:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121cb8900/0xdfc0fb148916d52 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6530 expref: 20912 pid: 16536 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.584630:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.584631:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.584635:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801320e9b00/0xdfc0fb148a37d0a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a20 expref: 20911 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584643:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801320e9b00/0xdfc0fb148a37d0a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a20 expref: 20911 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584663:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801320e9b00/0xdfc0fb148a37d0a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a20 expref: 20911 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.584689:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784456896:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.584712:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009996a540 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.584733:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882379584 00000100:00100000:3.0:1713481296.584736:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882379584 00000100:00100000:3.0:1713481296.584760:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485712 00000100:00100000:3.0:1713481296.584765:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2403:18752:x1796714882379584:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.584773:0:6932:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.584783:0:6932:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2400/0xdfc0fb148a37eae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x34d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ac1 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584809:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2400/0xdfc0fb148a37eae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x34d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ac1 expref: 2404 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584818:0:6932:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2400/0xdfc0fb148a37eae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x34d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ac1 expref: 2404 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584831:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d2:0x0].0x0 (ffff88009a57c000) 00010000:00010000:3.0:1713481296.584833:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713481296.584835:0:6932:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800834d2400, rc 0) 00000100:00100000:3.0:1713481296.584852:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2404:18752:x1796714882379584:12345-192.168.202.24@tcp:101:touch.0 Request processed in 86us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.584859:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485712 00010000:00010000:3.0:1713481296.584885:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584893:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584901:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584907:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584915:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584926:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079656400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.584929:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584936:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584954:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.584960:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079656400/0xdfc0fb148a37cb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.585201:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801209b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2637:3490:x1796714784454016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 19034us (19134us total) trans 4295960573 rc 0/0 00000100:00100000:3.0:1713481296.585220:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561936 00000004:00080000:3.0:1713481296.585274:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086f70a80/2, rc 0, transno 993276 00000100:00100000:3.0:1713481296.585283:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784453696:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.585309:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801209b6a00/2, rc 0, transno 993277 00000100:00100000:3.0:1713481296.585314:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801209b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784454016:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.585391:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.585401:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784456960:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.585426:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.585874:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585887:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585895:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585902:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585908:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585915:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009de76d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.585917:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585925:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585941:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.585947:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de76d00/0xdfc0fb148a37d73 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.586080:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16445:1959:x1796714882378048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.586084:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.586092:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800768f3180/0xdfc0fb148959b4f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb44 expref: 16445 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586098:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800768f3180/0xdfc0fb148959b4f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb44 expref: 16445 pid: 16491 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.586106:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2639:3490:x1796714784454912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12767us (12855us total) trans 4295960575 rc 0/0 00010000:00010000:0.0:1713481296.586111:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800768f3180/0xdfc0fb148959b4f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb44 expref: 16445 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586137:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586138:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.586139:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561944 00010000:00010000:0.0:1713481296.586141:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880079412d00/0xdfc0fb148a37c77 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a04 expref: 16444 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586146:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079412d00/0xdfc0fb148a37c77 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a04 expref: 16444 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586158:0:16520:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880079412d00/0xdfc0fb148a37c77 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a04 expref: 16444 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.586163:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:16520:1796714784457344:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.586165:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561958 00000100:00100000:3.0:1713481296.586170:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012002d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2638:3492:x1796714784457280:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.586174:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099b06180 going to sleep for 11 seconds 00002000:00080000:3.0:1713481296.586185:0:16460:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43194 count 1 00000100:00100000:0.0:1713481296.586194:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.586197:0:16460:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800834d33c0/0xdfc0fb148a37ec3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.586206:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882378176 00000100:00100000:0.0:1713481296.586207:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882378176 00010000:00010000:3.0:1713481296.586209:0:16460:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080381f80/0xdfc0fb1486886f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2528 expref: 26643 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.586215:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880078283180/0xdfc0fb148688608 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24aa expref: 26644 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.586215:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.586217:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.586220:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800834d33c0/0xdfc0fb148a37ec3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.586225:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819983 00000100:00100000:0.0:1713481296.586228:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26644:1959:x1796714882378176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.586233:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.586235:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880078283180/0xdfc0fb148688608 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24aa expref: 26644 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.586239:0:16460:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080381f80/0xdfc0fb1486886f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2528 expref: 26643 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.586240:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880078283180/0xdfc0fb148688608 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24aa expref: 26643 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.586248:0:16460:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080381f80/0xdfc0fb1486886f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2528 expref: 26643 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586250:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078283180/0xdfc0fb148688608 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24aa expref: 26643 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586257:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586258:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586259:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586259:0:16460:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784457408:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.586264:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586275:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.586278:0:16460:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800821876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.586284:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26642:1959:x1796714882378176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.586287:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819983 00010000:00010000:0.0:1713481296.586302:0:16508:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586306:0:16508:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.586306:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801209b5f80/2, rc 0, transno 993279 00010000:00010000:0.0:1713481296.586311:0:16508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586314:0:16508:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586315:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801209b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784454912:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.586318:0:16508:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586321:0:16508:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206edb00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.586323:0:16508:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586327:0:16508:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586334:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784457216 00010000:00010000:0.0:1713481296.586336:0:16508:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586337:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784457216 00010000:00010000:0.0:1713481296.586340:0:16508:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206edb00/0xdfc0fb148a37ca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586359:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20391 00000100:00100000:3.0:1713481296.586364:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8074:x1796714784457216:12345-0@lo:105: 00010000:00010000:3.0:1713481296.586373:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586381:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586388:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586395:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586402:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586409:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586429:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88008405cb40) 00000100:00100000:0.0:1713481296.586445:0:16508:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0001-mdtlov_UUID+2640:3492:x1796714784453824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21508us (21553us total) trans 4295960577 rc 0/0 00000100:00100000:0.0:1713481296.586449:0:16508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561935 00000100:00100000:3.0:1713481296.586467:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8074:x1796714784457216:12345-0@lo:105: Request processed in 101us (452us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.586469:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586474:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586474:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20391 00010000:00010000:0.0:1713481296.586495:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.586501:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350bba80/0xdfc0fb148a37c62 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479f6 expref: 2078 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586505:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.586516:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801350bba80/0xdfc0fb148a37c62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479f6 expref: 2078 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586520:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350bba80/0xdfc0fb148a37c62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479f6 expref: 2078 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.586526:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15514:1796714784457600:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.586538:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012cb92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.586538:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.586552:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882378304 00000100:00100000:0.0:1713481296.586554:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882378304 00010000:00010000:0.0:1713481296.586562:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007833d440/0xdfc0fb148688678 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24c6 expref: 26642 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.586582:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819984 00000100:00100000:0.0:1713481296.586585:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26642:1959:x1796714882378304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.586589:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.586592:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007833d440/0xdfc0fb148688678 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24c6 expref: 26642 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586597:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007833d440/0xdfc0fb148688678 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24c6 expref: 26642 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.586599:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.586608:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007833d440/0xdfc0fb148688678 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24c6 expref: 26642 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586615:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586616:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586618:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586618:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882378560 00000100:00100000:3.0:1713481296.586621:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882378560 00010000:00010000:0.0:1713481296.586622:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586630:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.586634:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121e30b40/0xdfc0fb148a15fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397e2 expref: 20912 pid: 16534 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.586640:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26641:1959:x1796714882378304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.586643:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819984 00000100:00100000:0.0:1713481296.586657:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819985 00000100:00100000:0.0:1713481296.586660:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20912:1959:x1796714882378560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.586664:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.586679:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121e30b40/0xdfc0fb148a15fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397e2 expref: 20912 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586685:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121e30b40/0xdfc0fb148a15fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397e2 expref: 20912 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586698:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121e30b40/0xdfc0fb148a15fb0 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397e2 expref: 20912 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586707:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586708:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586710:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880084abe400/0xdfc0fb148a37d11 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a27 expref: 20911 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586714:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084abe400/0xdfc0fb148a37d11 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a27 expref: 20911 pid: 16537 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586724:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.586725:0:16553:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880084abe400/0xdfc0fb148a37d11 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a27 expref: 20911 pid: 16537 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.586733:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784457792:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.586752:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092347480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.586767:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.586772:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819986 00000100:00100000:0.0:1713481296.586777:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20912:1959:x1796714882378688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.586784:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.586794:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123688b40/0xdfc0fb148a13ddd lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc172:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f3f expref: 20912 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586804:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123688b40/0xdfc0fb148a13ddd lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc172:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f3f expref: 20912 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586822:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123688b40/0xdfc0fb148a13ddd lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc172:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f3f expref: 20912 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.586829:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.586835:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586837:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586841:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009de77a80/0xdfc0fb148a37d6c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc172:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a43 expref: 20911 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586842:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882378944 00000100:00100000:3.0:1713481296.586845:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882378944 00010000:00010000:0.0:1713481296.586848:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009de77a80/0xdfc0fb148a37d6c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc172:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a43 expref: 20911 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586858:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880078282ac0/0xdfc0fb1486886da lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24fe expref: 26641 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586867:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009de77a80/0xdfc0fb148a37d6c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc172:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a43 expref: 20911 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.586875:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784457856:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.586876:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819988 00000100:00100000:3.0:1713481296.586882:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26641:1959:x1796714882378944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.586889:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.586891:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801330eae40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.586894:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880078282ac0/0xdfc0fb1486886da lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24fe expref: 26640 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.586903:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880078282ac0/0xdfc0fb1486886da lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24fe expref: 26640 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586905:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586916:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586919:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078282ac0/0xdfc0fb1486886da lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d24fe expref: 26640 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.586921:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586928:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586931:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.586933:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.586934:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586936:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586940:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206ee400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.586943:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586943:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586949:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.586960:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.586963:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.586966:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206ee400/0xdfc0fb148a37cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.586978:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26639:1959:x1796714882378944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.586985:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819988 00010000:00010000:3.0:1713481296.587013:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587021:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587028:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587036:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587042:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587049:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d39ed00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.587052:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587060:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587082:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.587087:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801209b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2641:3490:x1796714784454080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 20904us (20986us total) trans 4295960579 rc 0/0 00010000:00010000:3.0:1713481296.587088:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d39ed00/0xdfc0fb148a37dd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.587092:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561937 00000100:00100000:3.0:1713481296.587273:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2643:3490:x1796714784456256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10304us (10574us total) trans 4295960580 rc 0/0 00000100:00100000:3.0:1713481296.587281:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561946 00000004:00080000:3.0:1713481296.587322:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880133a71f80/2, rc 0, transno 993284 00000100:00100000:3.0:1713481296.587330:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784456256:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.587398:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8074:1796714784457216:0@lo:105: 00000100:00100000:3.0:1713481296.587406:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.587413:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.587425:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2181:1959:x1796714882378880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1489us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.587431:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819981 00000100:00100000:3.0:1713481296.587446:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.587459:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784458176 00000100:00100000:0.0:1713481296.587462:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784458176 00000100:00100000:0.0:1713481296.587472:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882379712 00000100:00100000:0.0:1713481296.587474:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882379712 00000100:00100000:0.0:1713481296.587489:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561963 00000100:00100000:0.0:1713481296.587493:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2643:3491:x1796714784458176:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.587500:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43199 count 1 00000100:00100000:3.0:1713481296.587500:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561964 00000100:00100000:3.0:1713481296.587506:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16445:8499:x1796714882379712:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.587509:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587514:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.587516:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cf18b40/0xdfc0fb148688720 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d256e expref: 26638 pid: 15541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.587520:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.587521:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.587524:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.587524:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800834d0900/0xdfc0fb148a37f02 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47acf expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.587538:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cf18b40/0xdfc0fb148688720 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d256e expref: 26638 pid: 15541 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.587539:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800869a6640/0xdfc0fb1488e7dff lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54bc expref: 16446 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.587546:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.587547:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.587551:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cf18b40/0xdfc0fb148688720 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d256e expref: 26638 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.587551:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800834d0900/0xdfc0fb148a37f02 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47acf expref: 16446 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.587559:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784458240:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.587568:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800869a6640/0xdfc0fb1488e7dff lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54bc expref: 16446 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.587576:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c5d600 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.587577:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800869a6640/0xdfc0fb1488e7dff lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54bc expref: 16446 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.587586:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784458304:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.587604:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880133c83f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.588243:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.588269:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.588280:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.588291:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.588316:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2561965 00000100:00100000:0.0:1713481296.588393:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16447:18844:x1796714882379776:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.588401:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.588411:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083a7e1c0/0xdfc0fb148a37f17 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ad6 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.588421:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.588429:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.588430:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.588434:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083a7e1c0/0xdfc0fb148a37f17 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ad6 expref: 16448 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.588443:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880083a7e1c0/0xdfc0fb148a37f17 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ad6 expref: 16448 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.588449:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083a7e1c0, rc 0) 00000100:00100000:0.0:1713481296.588466:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16448:18844:x1796714882379776:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.588471:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561965 00000100:00100000:3.0:1713481296.588539:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec53480 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001_UUID:15484:1796714784456512:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.588560:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485715 00000100:00100000:0.0:1713481296.588565:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2182:18861:x1796714882380032:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.588570:0:15484:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.588573:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.588583:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099bec480/0xdfc0fb148a37f2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47af2 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.588631:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099becfc0/0xdfc0fb148a37f41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.588639:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099becfc0/0xdfc0fb148a37f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.588645:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099becfc0/0xdfc0fb148a37f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00000004:00200000:0.0:1713481296.588680:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51a6:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.588683:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.588792:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099bec480/0xdfc0fb148a37f2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x51a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47af2 expref: 2186 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.588808:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099becfc0/0xdfc0fb148a37f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47af2 expref: 2184 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.588814:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff88009a8d0700) 00010000:00010000:0.0:1713481296.588816:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713481296.588819:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099becfc0, rc 0) 00000100:00100000:0.0:1713481296.588837:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2183:18861:x1796714882380032:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 272us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.588844:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485715 00000100:00100000:0.0:1713481296.588880:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.588996:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.589016:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784458368 00000100:00100000:0.0:1713481296.589019:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784458368 00000100:00100000:0.0:1713481296.589037:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784458432 00000100:00100000:0.0:1713481296.589039:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784458432 00000100:00100000:0.0:1713481296.589049:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784458496 00000100:00100000:0.0:1713481296.589051:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784458496 00000100:00100000:0.0:1713481296.589172:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784458560 00000100:00100000:0.0:1713481296.589175:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784458560 00000100:00100000:0.0:1713481296.589190:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784458624 00000100:00100000:0.0:1713481296.589192:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784458624 00000100:00100000:0.0:1713481296.589202:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784458688 00000100:00100000:0.0:1713481296.589204:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784458688 00000100:00100000:0.0:1713481296.589278:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561968 00000100:00100000:0.0:1713481296.589283:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+27:3492:x1796714784458432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.589294:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9852 count 1 00010000:00010000:0.0:1713481296.589350:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bed680/0xdfc0fb148a37f72 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x267c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.589362:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aac5440/0xdfc0fb148802012 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x267c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96246e expref: 20911 pid: 16465 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.589368:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.589369:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.589371:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bed680/0xdfc0fb148a37f72 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x267c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.589387:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aac5440/0xdfc0fb148802012 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x267c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96246e expref: 20911 pid: 16465 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.589395:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aac5440/0xdfc0fb148802012 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x267c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96246e expref: 20911 pid: 16465 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.589403:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a922680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784458816:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.589420:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800803ec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.589439:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561971 00000100:00100000:0.0:1713481296.589443:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009435a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+27:3490:x1796714784458624:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.589528:0:16452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9855 count 1 00010000:00010000:0.0:1713481296.589537:0:16452:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bed8c0/0xdfc0fb148a37f87 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x267f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.589585:0:16452:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086990fc0/0xdfc0fb148802027 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x267f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962498 expref: 20911 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.589591:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.589592:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.589595:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bed8c0/0xdfc0fb148a37f87 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x267f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.589612:0:16452:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086990fc0/0xdfc0fb148802027 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x267f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962498 expref: 20911 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.589620:0:16452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086990fc0/0xdfc0fb148802027 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x267f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962498 expref: 20911 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.589635:0:16452:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a921f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784459072:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.589651:0:16452:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc49180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.589684:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882381376 00000100:00100000:0.0:1713481296.589687:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882381376 00000100:00100000:0.0:1713481296.589709:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485716 00000100:00100000:0.0:1713481296.589713:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2079:18678:x1796714882381376:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:0.0:1713481296.589731:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.589738:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099bec000/0xdfc0fb148a37f95 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47b1c expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713481296.589797:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3463:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.589847:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bec000/0xdfc0fb148a37f95 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b1c expref: 2081 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.589925:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099bec000/0xdfc0fb148a37f95 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b1c expref: 2081 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.589935:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099bec000, rc 0) 00000100:00100000:0.0:1713481296.589948:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2080:18678:x1796714882381376:12345-192.168.202.24@tcp:101:rm.0 Request processed in 234us (952us total) trans 4295107537 rc 301/301 00000100:00100000:0.0:1713481296.589954:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485716 00000100:00100000:0.0:1713481296.590015:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.590081:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.590100:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882382400 00000100:00100000:0.0:1713481296.590103:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882382400 00000100:00100000:0.0:1713481296.590140:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485717 00000100:00100000:0.0:1713481296.590145:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2405:18896:x1796714882382400:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:0.0:1713481296.590152:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.590154:0:15475:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1713481296.590163:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079998900/0xdfc0fb148a379a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa478f3 expref: 2405 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.590177:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:0.0:1713481296.590180:0:15475:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.590185:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099befa80/0xdfc0fb148a37fb1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47b31 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.590247:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bed200/0xdfc0fb148a37fd4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.590254:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099bed200/0xdfc0fb148a37fd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.590260:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099bed200/0xdfc0fb148a37fd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.590269:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x347f:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.590274:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.590279:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.590396:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135847b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784459392:0@lo:1000:mdt00_011.0 00000100:00100000:0.0:1713481296.590454:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.590469:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084223cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.590617:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882380416 00000100:00100000:0.0:1713481296.590621:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882380416 00010000:00010000:0.0:1713481296.590633:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092e8a400/0xdfc0fb148a37b19 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47947 expref: 2406 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.590651:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819989 00000100:00100000:0.0:1713481296.590656:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2406:1959:x1796714882380416:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.590659:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882380608 00010000:00010000:0.0:1713481296.590662:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.590662:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882380608 00010000:00010000:0.0:1713481296.590680:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880092e8a400/0xdfc0fb148a37b19 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47947 expref: 2406 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.590688:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880092e8a400/0xdfc0fb148a37b19 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47947 expref: 2406 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.590692:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882382912 00000100:00100000:3.0:1713481296.590693:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882382912 00010000:00010000:0.0:1713481296.590700:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092e8a400/0xdfc0fb148a37b19 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47947 expref: 2407 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.590701:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882380672 00000100:00100000:3.0:1713481296.590703:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882380672 00000100:00100000:3.0:1713481296.590714:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485718 00010000:00010000:0.0:1713481296.590717:0:8074:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x0 (ffff8801322ecf00) 00000100:00100000:3.0:1713481296.590717:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2082:18895:x1796714882380608:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:0.0:1713481296.590721:0:8074:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.590728:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.590733:0:8074:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.590736:0:15577:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.590743:0:15577:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8801350bba80/0xdfc0fb148a37c62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479f6 expref: 2082 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.590747:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.590753:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00010000:00010000:3.0:1713481296.590757:0:15577:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.590760:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2406:1959:x1796714882380416:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 103us (197us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.590762:0:15577:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.590765:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.590769:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819989 00010000:00010000:3.0:1713481296.590774:0:15577:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.590783:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.590786:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.590790:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.590805:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485719 00000100:00100000:0.0:1713481296.590811:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2405:18729:x1796714882382912:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:0.0:1713481296.590819:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.590827:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099bee640/0xdfc0fb148a37ff7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47b54 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713481296.590875:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3480:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.590924:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bee640/0xdfc0fb148a37ff7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b54 expref: 2407 pid: 15479 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713481296.590929:0:15577:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x9a:0x0].1982, 376 off1627232 00010000:00010000:0.0:1713481296.590932:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099bee640/0xdfc0fb148a37ff7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b54 expref: 2407 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.590943:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099bee640, rc 0) 00000040:00080000:3.0:1713481296.590958:0:15577:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xa5:0x0].857, 456 off793864 00000004:00080000:3.0:1713481296.590961:0:15577:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009837e540 with version 16897 00000100:00100000:0.0:1713481296.590962:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2406:18729:x1796714882382912:12345-192.168.202.24@tcp:101:rm.0 Request processed in 151us (348us total) trans 4295107538 rc 301/301 00000100:00100000:0.0:1713481296.590968:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485719 00000100:00100000:3.0:1713481296.590985:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882380736 00000100:00100000:3.0:1713481296.590987:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882380736 00000004:00080000:0.0:1713481296.590993:0:8077:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a5738e40 version 16897 rpc_version 16897 00000100:00100000:3.0:1713481296.591005:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125645 00000020:00100000:0.0:1713481296.591009:0:8077:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713481296.591009:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012002c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2406:18897:x1796714882380736:12345-192.168.202.24@tcp:33:lfs.0 00000100:00100000:0.0:1713481296.591015:0:8077:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880135846d80 x1796714784459520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713481296.591025:0:8077:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135846d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784459520:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713481296.591047:0:8077:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.591065:0:8077:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092a4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.591079:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882380800 00000100:00100000:0.0:1713481296.591083:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882380800 00010000:00010000:0.0:1713481296.591095:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d7f180/0xdfc0fb1489cf0c2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21ea6 expref: 24474 pid: 16490 timeout: 815 lvb_type: 0 00000004:00200000:3.0:1713481296.591107:0:15535:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2aaf:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.591110:0:15535:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1713481296.591112:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882381056 00000100:00100000:3.0:1713481296.591162:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012002c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2406:18897:x1796714882380736:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 151us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.591167:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125645 00000100:00100000:3.0:1713481296.591184:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882380992 00000100:00100000:3.0:1713481296.591186:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882380992 00000100:00100000:0.0:1713481296.591195:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882381056 00000100:00100000:3.0:1713481296.591199:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125646 00000100:00100000:3.0:1713481296.591201:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2184:18578:x1796714882380992:12345-192.168.202.24@tcp:37:rm.0 00010000:00010000:0.0:1713481296.591208:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b3d7600/0xdfc0fb14891a9ce lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8054:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c86a8 expref: 20913 pid: 16504 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.591227:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819990 00000100:00100000:0.0:1713481296.591232:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012002c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24474:1959:x1796714882380800:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.591239:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.591242:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095d7f180/0xdfc0fb1489cf0c2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21ea6 expref: 24474 pid: 16490 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.591304:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095d7f180/0xdfc0fb1489cf0c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21ea6 expref: 24475 pid: 16490 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.591321:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591323:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591326:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a2ad200/0xdfc0fb148a37e3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a90 expref: 26639 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.591333:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a2ad200/0xdfc0fb148a37e3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a90 expref: 26639 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.591350:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007a2ad200/0xdfc0fb148a37e3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a90 expref: 26639 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.591364:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135847b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784459584:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.591381:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092a4f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.591406:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800918c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784456768:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.591417:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078377100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784456832:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.591442:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013460ba80/0xdfc0fb148a37ea7 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aba expref: 24475 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.591452:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013460ba80, rc 0) 00000100:00100000:0.0:1713481296.591465:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24475:10409:x1796714882379520:12345-192.168.202.24@tcp:101:dd.0 Request processed in 7306us (7372us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.591471:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561954 00000100:00100000:0.0:1713481296.591498:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882381952 00000100:00100000:0.0:1713481296.591501:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882381952 00010000:00010000:0.0:1713481296.591512:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080381f80/0xdfc0fb1486886f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2528 expref: 26641 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.591525:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882381824 00000100:00100000:0.0:1713481296.591527:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882381824 00010000:00010000:0.0:1713481296.591535:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800965e8d80/0xdfc0fb1486886cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2560 expref: 26644 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.591545:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882381440 00000100:00100000:0.0:1713481296.591547:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882381440 00010000:00010000:0.0:1713481296.591556:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b9f86c0/0xdfc0fb148942236 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e0093 expref: 20914 pid: 16514 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.591573:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819991 00000100:00100000:0.0:1713481296.591578:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20914:1960:x1796714882381056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.591584:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.591588:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b3d7600/0xdfc0fb14891a9ce lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8054:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c86a8 expref: 20914 pid: 16504 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.591596:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b3d7600/0xdfc0fb14891a9ce lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8054:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c86a8 expref: 20914 pid: 16504 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.591614:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b3d7600/0xdfc0fb14891a9ce lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8054:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c86a8 expref: 20914 pid: 16504 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.591623:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591625:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591629:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801320e9440/0xdfc0fb148a37e6f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8054:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a9e expref: 16449 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.591637:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801320e9440/0xdfc0fb148a37e6f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8054:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a9e expref: 16449 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.591644:0:15484:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591648:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.591653:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801320e9440/0xdfc0fb148a37e6f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8054:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a9e expref: 16449 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.591658:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cb0:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.591662:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078377100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784459648:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.591662:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591680:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.591694:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092c2b000 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.591718:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784457792:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.591737:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.591749:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20913:1959:x1796714882378560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5087us (5150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.591755:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819985 00000100:00100000:0.0:1713481296.591780:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819995 00000100:00100000:0.0:1713481296.591785:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26645:1960:x1796714882381824:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.591792:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.591796:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800965e8d80/0xdfc0fb1486886cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2560 expref: 26644 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.591805:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800965e8d80/0xdfc0fb1486886cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2560 expref: 26644 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.591819:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591821:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591824:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008362ba80/0xdfc0fb148a37ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.591831:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008362ba80/0xdfc0fb148a37ee6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.591834:0:15484:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba50:0x0], index 1: 0 00010000:00010000:0.0:1713481296.591840:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.591852:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26644:1960:x1796714882381824:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.591860:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819995 00000100:00100000:0.0:1713481296.591876:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 819998 00000100:00100000:0.0:1713481296.591879:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012caf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882381568:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.591884:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.591888:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800916d2640/0xdfc0fb14891d41b lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6bb expref: 24479 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.591895:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800916d2640/0xdfc0fb14891d41b lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6bb expref: 24479 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.591907:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800916d2640/0xdfc0fb14891d41b lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6bb expref: 24479 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.591907:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.591912:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591917:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.591918:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591919:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.591922:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013460ba80/0xdfc0fb148a37ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aba expref: 24478 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.591928:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013460ba80/0xdfc0fb148a37ea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aba expref: 24478 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.591931:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591935:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591938:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.591940:0:16553:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013460ba80/0xdfc0fb148a37ea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aba expref: 24478 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.591943:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591946:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d376f40 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.591948:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16553:1796714784459904:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.591948:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591951:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591956:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x0 (ffff8801322ecf00) 00010000:00010000:3.0:1713481296.591958:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.591960:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092347480 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.591960:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591962:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a37e1b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000004:00010000:3.0:1713481296.591974:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880129e7a850 reply state ffff88011ef70000 transno 4295107541 ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.591979:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.591982:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:16520:1796714784457344:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.591982:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x37 (ffff88009c687e00) 00010000:00010000:3.0:1713481296.591984:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.591985:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.591999:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.592009:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16449:1959:x1796714882378048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5928us (5955us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.592011:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a37e14 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2084 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.592015:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819982 00010000:00010000:3.0:1713481296.592026:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2083 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.592033:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb7:0x0].0x0 (ffff88009c077100) 00000100:00100000:0.0:1713481296.592034:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820001 00010000:00010000:3.0:1713481296.592035:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.592036:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f816d00, rc 0) 00000100:00100000:0.0:1713481296.592038:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26643:1960:x1796714882381696:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.592045:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.592049:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007833c240/0xdfc0fb1486886e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d250c expref: 26642 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.592050:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2084:18805:x1796714882378496:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 11802us (11884us total) trans 4295107541 rc 0/0 00010000:00010000:0.0:1713481296.592055:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007833c240/0xdfc0fb1486886e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d250c expref: 26642 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.592055:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485706 00010000:00010000:0.0:1713481296.592064:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007833c240/0xdfc0fb1486886e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d250c expref: 26642 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.592071:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.592072:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.592073:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a37ebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592077:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a37ebc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592091:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.592099:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26640:1960:x1796714882381696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.592103:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820001 00010000:00010000:0.0:1713481296.592144:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf18b40/0xdfc0fb148688720 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d256e expref: 26638 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.592154:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784458240:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.592165:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592170:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592173:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592177:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592181:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592185:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592192:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a7e640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.592193:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592197:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592204:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592208:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083a7e640/0xdfc0fb148a37ef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.592323:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2645:3491:x1796714784458176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4828us (4933us total) trans 4295960582 rc 0/0 00000100:00100000:0.0:1713481296.592329:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561963 00000100:00100000:0.0:1713481296.592358:0:15472:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882382528 00000100:00100000:0.0:1713481296.592362:0:15472:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882382528 00000100:00100000:0.0:1713481296.592380:0:15472:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125647 00000100:00100000:0.0:1713481296.592385:0:15472:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2084:18755:x1796714882382528:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:0.0:1713481296.592493:0:15472:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2085:18755:x1796714882382528:12345-192.168.202.24@tcp:35:touch.0 Request processed in 107us (675us total) trans 4295107542 rc 0/0 00000100:00100000:0.0:1713481296.592499:0:15472:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125647 00010000:00010000:0.0:1713481296.592541:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b9f86c0/0xdfc0fb148942236 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6970:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e0093 expref: 20913 pid: 16514 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.592557:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800918c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784456704:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.592572:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b41440/0xdfc0fb148a37e99 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ab3 expref: 16448 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.592579:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b41440, rc 0) 00000100:00100000:0.0:1713481296.592591:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16448:11388:x1796714882379392:12345-192.168.202.24@tcp:101:dd.0 Request processed in 8605us (8641us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.592596:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561953 00010000:00010000:0.0:1713481296.592639:0:15514:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.202.24@tcp) returned -22 from blocking AST (req@ffff8800728eea00 x1796714784457600) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8801350bba80/0xdfc0fb148a37c62 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479f6 expref: 2084 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.592649:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350bba80/0xdfc0fb148a37c62 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479f6 expref: 2084 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.592663:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15514:1796714784457600:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.592699:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00010000:00010000:0.0:1713481296.592704:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.592710:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.592715:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.592747:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784460288:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.592772:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.592789:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013431b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.592807:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784459520 00000100:00100000:0.0:1713481296.592810:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784459520 00000100:00100000:0.0:1713481296.592826:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784460288 00000100:00100000:0.0:1713481296.592828:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784460288 00000100:00100000:0.0:1713481296.592840:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82851 00000100:00100000:0.0:1713481296.592844:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:8077:x1796714784459520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713481296.592964:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:8077:x1796714784459520:12345-0@lo:1000:osp_up0-1.0 Request processed in 118us (1915us total) trans 4295105881 rc 0/0 00000100:00100000:0.0:1713481296.592971:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82851 00000100:00100000:0.0:1713481296.592990:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82852 00000100:00100000:0.0:1713481296.592994:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:15514:x1796714784460288:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.593042:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:15514:x1796714784460288:12345-0@lo:1000:mdt_io00_009.0 Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.593048:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82852 00000100:00100000:0.0:1713481296.593096:0:8077:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135846d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784459520:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713481296.593138:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080382d00/0xdfc0fb1486886e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d251a expref: 26634 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.593150:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a921180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784457088:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.593169:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593177:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593188:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593195:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593201:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593205:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593209:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013460a880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.593211:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593214:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593225:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.593229:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013460a880/0xdfc0fb148a37eb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.593323:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2649:3493:x1796714784457024:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7903us (7942us total) trans 4295960588 rc 0/0 00000100:00100000:0.0:1713481296.593330:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561955 00000100:00100000:0.0:1713481296.593365:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784460288:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.593880:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784461120:0@lo:403:mdt_io00_009.0 00000100:00100000:0.0:1713481296.593905:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.593919:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a780 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.593935:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82854 00000100:00100000:0.0:1713481296.593939:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:15514:x1796714784461120:12345-0@lo:403:mdt_io00_009.0 00000100:00100000:0.0:1713481296.597169:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078377100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784459648:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.597186:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.597204:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20908:1960:x1796714882381056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5625us (6139us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.597211:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819991 00000100:00100000:0.0:1713481296.597248:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a921f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784459072:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.597269:0:16452:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099bed8c0/0xdfc0fb148a37f87 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x267f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.597355:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16553:1796714784459904:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.597368:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.597483:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012caf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1960:x1796714882381568:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5600us (5959us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.597490:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819998 00000004:00010000:0.0:1713481296.597557:0:15577:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880078024700 reply state ffff88008839f000 transno 4295107539 ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.597571:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.597576:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00010000:00010000:0.0:1713481296.597579:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1713481296.597581:0:15577:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1713481296.597586:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c3:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.597609:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2086:18895:x1796714882380608:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 6891us (7019us total) trans 4295107539 rc 0/0 00000100:00100000:0.0:1713481296.597615:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485718 00000100:00100000:0.0:1713481296.597651:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135847b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784459584:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.597674:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.597689:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012002c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:1959:x1796714882380800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6456us (6842us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.597693:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 819990 00000100:00100000:0.0:1713481296.597770:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:15514:x1796714784461120:12345-0@lo:403:mdt_io00_009.0 Request processed in 3831us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.597774:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82854 00000100:00100000:0.0:1713481296.597795:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784461120:0@lo:403:mdt_io00_009.0 00010000:00010000:0.0:1713481296.599239:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599245:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599250:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599258:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a7c480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.599261:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599266:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599274:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00010000:00010000:0.0:1713481296.599276:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.599278:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599283:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083a7c480/0xdfc0fb148a37ed1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599300:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599306:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599312:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405cb40/0xdfc0fb148a37dc0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37dc7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599332:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713481296.599339:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x51f8:0x0] 00010000:00010000:0.0:1713481296.599343:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405d8c0/0xdfc0fb148a37db2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37db9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599350:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405d8c0/0xdfc0fb148a37db2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37db9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599360:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008405d8c0/0xdfc0fb148a37db2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51f8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37db9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599370:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713481296.599377:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713481296.599380:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d1f expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599387:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37d1f expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599393:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4d80/0xdfc0fb148a37d18 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37d1f expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599402:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713481296.599404:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713481296.599407:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599413:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599418:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800833e4900/0xdfc0fb148a37d26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a37d2d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599425:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1713481296.599429:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599438:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599443:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096f6f600/0xdfc0fb148a378a3 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a378aa expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599450:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1713481296.599471:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2407:18831:x1796714882367744:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 67118us (67255us total) trans 0 rc -39/-39 00000100:00100000:0.0:1713481296.599476:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26094 00000100:00100000:0.0:1713481296.599587:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882380928 00000100:00100000:0.0:1713481296.599590:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882380928 00000100:00100000:0.0:1713481296.599605:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384768 00000100:00100000:0.0:1713481296.599606:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384768 00000100:00100000:0.0:1713481296.599616:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26096 00000100:00100000:0.0:1713481296.599620:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2407:18800:x1796714882380928:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:0.0:1713481296.599635:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713481296.599643:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134b41200/0xdfc0fb148a37e68 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a89 expref: 2407 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599657:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff88009c687900) 00010000:00010000:0.0:1713481296.599681:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121ed2880/0xdfc0fb148a37c93 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a12 expref: 2406 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599694:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88011f854b00) 00010000:00010000:0.0:1713481296.599696:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.599710:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.599715:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599719:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599727:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.599730:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599734:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599741:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.599747:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599752:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599805:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.599814:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4779c expref: 2084 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599819:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 4/0,1 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.599838:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4779c expref: 2084 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.599846:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880120642d00/0xdfc0fb148a375e7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4779c expref: 2084 pid: 15475 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.599855:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15514:1796714784462912:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.599954:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.600066:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485724 00000100:00100000:0.0:1713481296.600071:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2406:18896:x1796714882385280:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:0.0:1713481296.600089:0:15577:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.600099:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095e946c0/0xdfc0fb148a38091 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b31 expref: 2406 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.600113:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d3:0x0].0x0 (ffff880080255200) 00010000:00010000:0.0:1713481296.600141:0:15577:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.600191:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x34d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:0.0:1713481296.600198:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.600205:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000004:00010000:0.0:1713481296.600256:0:15577:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122bac380 reply state ffff88011e0b7000 transno 4295107544 ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.600268:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.600273:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d3:0x0].0x0 (ffff8800848b7100) 00010000:00010000:0.0:1713481296.600275:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.600277:0:15577:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.600304:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2407:18896:x1796714882385280:12345-192.168.202.24@tcp:36:touch.0 Request processed in 233us (446us total) trans 4295107544 rc 0/0 00000100:00100000:0.0:1713481296.600309:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485724 00000100:00100000:0.0:1713481296.600433:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.600469:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.600489:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.600504:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.600520:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882385728 00000100:00100000:0.0:1713481296.600524:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882385728 00000100:00100000:0.0:1713481296.600544:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562011 00000100:00100000:0.0:1713481296.600548:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16451:8499:x1796714882385536:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.600555:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.600563:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009737a1c0/0xdfc0fb148a381a2 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47baf expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.600577:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991dcd80/0xdfc0fb1488e7e37 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54c3 expref: 16453 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.600583:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.600584:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.600587:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009737a1c0/0xdfc0fb148a381a2 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47baf expref: 16453 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.600660:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991dcd80/0xdfc0fb1488e7e37 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54c3 expref: 16452 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.600685:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991dcd80/0xdfc0fb1488e7e37 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54c3 expref: 16452 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.600695:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784463168:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.600711:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.600744:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.600760:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384256 00000100:00100000:0.0:1713481296.600763:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384256 00010000:00010000:0.0:1713481296.600775:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d2ac6c0/0xdfc0fb148a13d4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f46 expref: 24479 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.600794:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820015 00000100:00100000:0.0:1713481296.600799:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882384256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.600805:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.600814:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d2ac6c0/0xdfc0fb148a13d4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f46 expref: 24479 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.600821:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d2ac6c0/0xdfc0fb148a13d4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f46 expref: 24479 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.600836:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d2ac6c0/0xdfc0fb148a13d4a lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f46 expref: 24479 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.600845:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.600846:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.600849:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801320ef180/0xdfc0fb148a38059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b46 expref: 24478 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.600856:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801320ef180/0xdfc0fb148a38059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b46 expref: 24478 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.600870:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801320ef180/0xdfc0fb148a38059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b46 expref: 24478 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.600877:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098232d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784463296:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.600890:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.600921:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.600934:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384384 00000100:00100000:0.0:1713481296.600936:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384384 00010000:00010000:0.0:1713481296.600944:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf186c0/0xdfc0fb148688727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d257c expref: 26636 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.600955:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820016 00000100:00100000:0.0:1713481296.600958:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26636:1960:x1796714882384384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.600962:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.600964:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cf186c0/0xdfc0fb148688727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d257c expref: 26636 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.600973:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cf186c0/0xdfc0fb148688727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d257c expref: 26636 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.600985:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf186c0/0xdfc0fb148688727 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d257c expref: 26636 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.600996:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.600998:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.601000:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095e95200/0xdfc0fb148a38067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601007:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095e95200/0xdfc0fb148a38067 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601024:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.601037:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26635:1960:x1796714882384384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 77us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.601043:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820016 00000100:00100000:0.0:1713481296.601079:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.601090:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384640 00000100:00100000:0.0:1713481296.601092:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384640 00010000:00010000:0.0:1713481296.601100:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c230fc0/0xdfc0fb148688758 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25a6 expref: 26635 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.601112:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820017 00000100:00100000:0.0:1713481296.601116:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26635:1960:x1796714882384640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.601137:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.601140:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007c230fc0/0xdfc0fb148688758 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25a6 expref: 26635 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601147:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c230fc0/0xdfc0fb148688758 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25a6 expref: 26635 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601160:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c230fc0/0xdfc0fb148688758 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25a6 expref: 26635 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601171:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.601172:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.601174:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601178:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601190:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.601199:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26634:1960:x1796714882384640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 83us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.601203:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820017 00010000:00010000:0.0:1713481296.601218:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601222:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601230:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601234:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601237:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601241:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c48900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.601242:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601246:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601256:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601259:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c48900/0xdfc0fb148a38075 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.601391:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dda0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2653:3490:x1796714784460480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8343us (8445us total) trans 4295960591 rc 0/0 00000100:00100000:0.0:1713481296.601397:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561988 00000100:00100000:0.0:1713481296.601433:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.601448:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.601458:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384832 00000100:00100000:0.0:1713481296.601460:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384832 00010000:00010000:0.0:1713481296.601469:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d370d80/0xdfc0fb148688774 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25c2 expref: 26634 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.601482:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820018 00000100:00100000:0.0:1713481296.601486:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26634:1960:x1796714882384832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.601491:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.601494:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d370d80/0xdfc0fb148688774 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25c2 expref: 26634 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601501:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d370d80/0xdfc0fb148688774 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25c2 expref: 26634 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601516:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d370d80/0xdfc0fb148688774 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25c2 expref: 26634 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601525:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.601526:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.601529:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095e97cc0/0xdfc0fb148a3808a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601535:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095e97cc0/0xdfc0fb148a3808a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601547:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.601557:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26633:1960:x1796714882384832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.601562:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820018 00000100:00100000:0.0:1713481296.601590:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.601599:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384960 00000100:00100000:0.0:1713481296.601601:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384960 00010000:00010000:0.0:1713481296.601609:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d370b40/0xdfc0fb148688790 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25de expref: 26633 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.601620:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820019 00000100:00100000:0.0:1713481296.601624:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26633:1960:x1796714882384960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.601631:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.601633:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d370b40/0xdfc0fb148688790 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25de expref: 26633 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601638:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d370b40/0xdfc0fb148688790 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25de expref: 26633 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601651:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d370b40/0xdfc0fb148688790 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25de expref: 26633 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.601658:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.601659:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.601660:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601677:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601695:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.601707:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26632:1960:x1796714882384960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.601712:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820019 00010000:00010000:0.0:1713481296.601733:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601740:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601747:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601753:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601759:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601765:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cddf840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.601768:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601774:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601795:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.601802:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cddf840/0xdfc0fb148a380ad lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.601923:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2655:3490:x1796714784461184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7397us (7459us total) trans 4295960593 rc 0/0 00000100:00100000:0.0:1713481296.601929:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561993 00000100:00100000:0.0:1713481296.601960:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.601971:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384320 00000100:00100000:0.0:1713481296.601973:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384320 00010000:00010000:0.0:1713481296.601982:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf19b00/0xdfc0fb14868872e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d258a expref: 26632 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.601994:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820020 00000100:00100000:0.0:1713481296.601998:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26632:1960:x1796714882384320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.602004:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.602007:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cf19b00/0xdfc0fb14868872e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d258a expref: 26632 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.602015:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cf19b00/0xdfc0fb14868872e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d258a expref: 26632 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.602031:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf19b00/0xdfc0fb14868872e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d258a expref: 26632 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.602047:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602049:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602052:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602059:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602076:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.602088:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26631:1960:x1796714882384320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 88us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.602093:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820020 00000100:00100000:0.0:1713481296.602110:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784463808 00000100:00100000:0.0:1713481296.602113:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784463808 00000100:00100000:0.0:1713481296.602144:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562016 00000100:00100000:0.0:1713481296.602148:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2655:3490:x1796714784463808:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.602158:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43211 count 1 00010000:00010000:0.0:1713481296.602168:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602177:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009329a880/0xdfc0fb1486887c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2616 expref: 26630 pid: 15541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.602183:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602185:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602187:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602206:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009329a880/0xdfc0fb1486887c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2616 expref: 26630 pid: 15541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.602213:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009329a880/0xdfc0fb1486887c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2616 expref: 26630 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.602221:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784463872:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.602233:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a300 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.602244:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602250:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602256:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602261:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602267:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602272:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079920900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.602274:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602280:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602293:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602299:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a38060 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.602425:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2656:3492:x1796714784460224:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9592us (9704us total) trans 4295960594 rc 0/0 00000100:00100000:0.0:1713481296.602430:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561985 00000100:00100000:0.0:1713481296.602460:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.602469:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384512 00000100:00100000:0.0:1713481296.602471:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384512 00010000:00010000:0.0:1713481296.602478:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf18480/0xdfc0fb148688735 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2598 expref: 26631 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.602490:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820021 00000100:00100000:0.0:1713481296.602494:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26631:1960:x1796714882384512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.602500:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.602504:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cf18480/0xdfc0fb148688735 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2598 expref: 26631 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.602511:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cf18480/0xdfc0fb148688735 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2598 expref: 26631 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.602525:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf18480/0xdfc0fb148688735 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2598 expref: 26631 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.602535:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602537:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602540:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c4ba80/0xdfc0fb148a3806e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602546:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c4ba80/0xdfc0fb148a3806e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602564:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.602576:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26630:1960:x1796714882384512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.602582:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820021 00000100:00100000:0.0:1713481296.602604:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784463936 00000100:00100000:0.0:1713481296.602607:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784463936 00000100:00100000:0.0:1713481296.602622:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562017 00000100:00100000:0.0:1713481296.602626:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2656:3492:x1796714784463936:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.602636:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43212 count 1 00010000:00010000:0.0:1713481296.602646:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.602646:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d7f180/0xdfc0fb1489cf0c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21ea6 expref: 24478 pid: 16490 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.602655:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093298b40/0xdfc0fb1486887cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2624 expref: 26629 pid: 15541 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.602662:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784456576:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.602679:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602680:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.602683:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602700:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093298b40/0xdfc0fb1486887cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2624 expref: 26629 pid: 15541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.602708:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093298b40/0xdfc0fb1486887cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2624 expref: 26629 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.602708:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a2ad200/0xdfc0fb148a37e3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a90 expref: 26629 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.602716:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a2ad200, rc 0) 00000100:00100000:0.0:1713481296.602718:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012caf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784464064:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.602796:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26629:18817:x1796714882379072:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 19871us (19926us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.602798:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.602804:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2561950 00000100:00100000:0.0:1713481296.602819:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784464000 00000100:00100000:0.0:1713481296.602821:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784464000 00000100:00100000:0.0:1713481296.602842:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98325 00000100:00100000:0.0:1713481296.602846:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008318df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+18:3492:x1796714784464000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.602854:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.602862:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135be1f80/0xdfc0fb148a38186 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3815c expref: 18 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.602875:0:16553:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff88009b231000) 00010000:00010000:0.0:1713481296.602885:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.602915:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008318df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+17:3492:x1796714784464000:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.602921:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98325 00000100:00100000:0.0:1713481296.602967:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.602980:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384704 00000100:00100000:0.0:1713481296.602982:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384704 00010000:00010000:0.0:1713481296.602992:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d370240/0xdfc0fb14868875f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25b4 expref: 26629 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.603004:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820022 00000100:00100000:0.0:1713481296.603008:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26629:1960:x1796714882384704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.603013:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.603016:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d370240/0xdfc0fb14868875f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25b4 expref: 26629 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603023:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d370240/0xdfc0fb14868875f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25b4 expref: 26629 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603034:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d370240/0xdfc0fb14868875f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25b4 expref: 26629 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603042:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603043:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603045:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603051:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603065:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.603075:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26628:1960:x1796714882384704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.603081:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820022 00010000:00010000:0.0:1713481296.603140:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603147:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603154:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603160:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603166:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603171:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134e39f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.603174:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603180:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603193:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603199:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134e39f80/0xdfc0fb148a38083 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.603331:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2658:3491:x1796714784460736:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10002us (10056us total) trans 4295960596 rc 0/0 00000100:00100000:0.0:1713481296.603336:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561990 00000100:00100000:0.0:1713481296.603355:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882384896 00000100:00100000:0.0:1713481296.603358:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882384896 00010000:00010000:0.0:1713481296.603368:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d371440/0xdfc0fb14868877b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25d0 expref: 26628 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.603381:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820023 00000100:00100000:0.0:1713481296.603385:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26628:1960:x1796714882384896:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.603391:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.603395:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d371440/0xdfc0fb14868877b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25d0 expref: 26628 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603404:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d371440/0xdfc0fb14868877b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25d0 expref: 26628 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603418:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d371440/0xdfc0fb14868877b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d25d0 expref: 26628 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603429:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603431:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603434:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800737318c0/0xdfc0fb148a380a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603440:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737318c0/0xdfc0fb148a380a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603456:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.603468:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26627:1960:x1796714882384896:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.603474:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820023 00000100:00100000:0.0:1713481296.603592:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.603607:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882385984 00000100:00100000:0.0:1713481296.603609:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882385984 00010000:00010000:0.0:1713481296.603618:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121df0240/0xdfc0fb148802043 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624d0 expref: 20902 pid: 16465 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.603631:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820024 00000100:00100000:0.0:1713481296.603634:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012caf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20902:1957:x1796714882385984:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.603640:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.603643:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121df0240/0xdfc0fb148802043 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624d0 expref: 20902 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603650:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121df0240/0xdfc0fb148802043 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624d0 expref: 20902 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.603679:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603681:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603683:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c879f80/0xdfc0fb148a380d0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603689:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c879f80/0xdfc0fb148a380d0 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603704:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.603715:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012caf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20902:1957:x1796714882385984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 79us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.603720:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820024 00000100:00100000:0.0:1713481296.603757:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.603776:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.603790:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.603801:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386240 00000100:00100000:0.0:1713481296.603804:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386240 00000100:00100000:0.0:1713481296.603819:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562019 00000100:00100000:0.0:1713481296.603824:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26627:17935:x1796714882386240:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.603830:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.603840:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fe17840/0xdfc0fb148a381e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47bbd expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.603852:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb78a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.603862:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603863:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.603867:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe17840/0xdfc0fb148a381e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bbd expref: 26628 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603876:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007fe17840/0xdfc0fb148a381e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bbd expref: 26628 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.603884:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fe17840, rc 0) 00000100:00100000:0.0:1713481296.603897:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26628:17935:x1796714882386240:12345-192.168.202.24@tcp:101:dd.0 Request processed in 73us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.603903:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562019 00000100:00100000:0.0:1713481296.603936:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.603965:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386304 00000100:00100000:0.0:1713481296.603966:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386176 00000100:00100000:0.0:1713481296.603968:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386176 00000100:00100000:3.0:1713481296.603971:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386304 00000100:00100000:0.0:1713481296.603983:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125653 00000100:00100000:0.0:1713481296.603987:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2183:18578:x1796714882386176:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:3.0:1713481296.603997:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485725 00000100:00100000:3.0:1713481296.604003:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2183:18854:x1796714882386304:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.604014:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.604027:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f815d40/0xdfc0fb148a381e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47bc4 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.604059:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2185:18578:x1796714882386176:12345-192.168.202.24@tcp:35:rm.0 Request processed in 71us (282us total) trans 4295105882 rc 0/0 00000100:00100000:0.0:1713481296.604065:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125653 00010000:00010000:3.0:1713481296.604091:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.604102:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604105:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.604111:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604138:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.604150:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604153:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386432 00000100:00100000:0.0:1713481296.604156:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386432 00010000:00010000:3.0:1713481296.604157:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.604164:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604166:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb14880204a lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624de expref: 20902 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.604182:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820025 00000100:00100000:0.0:1713481296.604187:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20902:1959:x1796714882386432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.604193:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.604197:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb14880204a lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624de expref: 20902 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.604205:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb14880204a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624de expref: 20902 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.604222:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814d80/0xdfc0fb148a381fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604224:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.604225:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.604228:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cddc240/0xdfc0fb148a380d7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.604230:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814d80/0xdfc0fb148a381fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604234:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cddc240/0xdfc0fb148a380d7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.604237:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814d80/0xdfc0fb148a381fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604246:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.604258:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20902:1959:x1796714882386432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000004:00200000:3.0:1713481296.604261:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51f4:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.604264:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820025 00000004:00200000:3.0:1713481296.604264:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.604275:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814d80/0xdfc0fb148a381fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.604284:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604290:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386368 00010000:00010000:3.0:1713481296.604290:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604293:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386368 00010000:00010000:3.0:1713481296.604295:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.604301:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.604306:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f814000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.604309:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604311:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562020 00000100:00100000:0.0:1713481296.604315:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20902:18792:x1796714882386368:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.604315:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604322:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.604324:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.604327:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.604331:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604333:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fe16f40/0xdfc0fb148a38204 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc503:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47bcb expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.604336:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814000/0xdfc0fb148a381ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00002000:00010000:0.0:1713481296.604345:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc503:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.604351:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604354:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.604355:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.604356:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604360:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe16f40/0xdfc0fb148a38204 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bcb expref: 20903 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.604361:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.604366:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f816ac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.604369:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007fe16f40/0xdfc0fb148a38204 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc503:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bcb expref: 20903 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.604369:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.604374:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.604376:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fe16f40, rc 0) 00010000:00010000:3.0:1713481296.604380:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88009629fd00) 00010000:00010000:3.0:1713481296.604383:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.604385:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604387:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20903:18792:x1796714882386368:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 71us (281us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.604390:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f816ac0/0xdfc0fb148a381f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.604392:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562020 00010000:00010000:3.0:1713481296.604432:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f815d40/0xdfc0fb148a381e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bc4 expref: 2185 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.604445:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f814d80/0xdfc0fb148a381fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bc4 expref: 2184 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.604452:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff880120969300) 00010000:00010000:3.0:1713481296.604454:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.604456:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f814d80, rc 0) 00000100:00100000:3.0:1713481296.604474:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2184:18854:x1796714882386304:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 471us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.604481:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485725 00000100:00100000:0.0:1713481296.604491:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.604507:0:15472:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386496 00000100:00100000:0.0:1713481296.604510:0:15472:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386496 00000001:00080000:3.0:1713481296.604512:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040687 00000100:00100000:0.0:1713481296.604523:0:15472:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125654 00000100:00100000:0.0:1713481296.604527:0:15472:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2084:18909:x1796714882386496:12345-192.168.202.24@tcp:33:lfs.0 00000004:00200000:0.0:1713481296.604589:0:15472:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3474:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.604592:0:15472:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713481296.604618:0:15472:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2084:18909:x1796714882386496:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 90us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.604624:0:15472:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125654 00002000:00080000:3.0:1713481296.604659:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 55122 00000100:00100000:0.0:1713481296.605611:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784464640 00000100:00100000:0.0:1713481296.605615:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784464640 00000100:00100000:0.0:1713481296.605755:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562024 00000100:00100000:0.0:1713481296.605760:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+40:3490:x1796714784464640:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.605771:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9868 count 1 00010000:00010000:0.0:1713481296.605782:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fe15440/0xdfc0fb148a38220 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x268c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.605792:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b0b600/0xdfc0fb148802082 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x268c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96254e expref: 20900 pid: 16465 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.605803:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.605804:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.605807:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe15440/0xdfc0fb148a38220 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x268c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.605822:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135b0b600/0xdfc0fb148802082 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x268c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96254e expref: 20900 pid: 16465 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.605830:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135b0b600/0xdfc0fb148802082 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x268c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96254e expref: 20900 pid: 16465 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.605838:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800918c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784464704:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.605855:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc49180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.605875:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.605889:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386624 00000100:00100000:0.0:1713481296.605891:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386624 00000100:00100000:0.0:1713481296.605903:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125655 00000100:00100000:0.0:1713481296.605907:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2084:18895:x1796714882386624:12345-192.168.202.24@tcp:35:lfs.0 00000040:00080000:0.0:1713481296.606025:0:15535:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x9a:0x0].1983, 344 off1627576 00000040:00080000:0.0:1713481296.606054:0:15535:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xa5:0x0].858, 424 off794288 00000004:00080000:0.0:1713481296.606058:0:15535:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880134fb6780 with version 16898 00000100:00100000:0.0:1713481296.606422:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.606441:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.606504:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820027 00000100:00100000:0.0:1713481296.606510:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20902:1960:x1796714882386816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.606517:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.606521:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094395f80/0xdfc0fb148802051 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624ec expref: 20902 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.606530:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094395f80/0xdfc0fb148802051 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624ec expref: 20901 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.606543:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.606544:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.606547:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.606553:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.606565:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.606578:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20900:1960:x1796714882386816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.606583:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820027 00000100:00100000:0.0:1713481296.606614:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.606626:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386944 00000100:00100000:0.0:1713481296.606628:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386944 00010000:00010000:0.0:1713481296.606636:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800961aaf40/0xdfc0fb148802058 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2686:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624fa expref: 20900 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.606648:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820028 00000100:00100000:0.0:1713481296.606651:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f91f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20900:1960:x1796714882386944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.606658:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.606662:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800961aaf40/0xdfc0fb148802058 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624fa expref: 20900 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.606684:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800961aaf40/0xdfc0fb148802058 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624fa expref: 20900 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.606697:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.606698:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.606700:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c878480/0xdfc0fb148a380e5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.606707:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c878480/0xdfc0fb148a380e5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.606719:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.606738:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f91f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20900:1960:x1796714882386944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.606744:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820028 00000100:00100000:0.0:1713481296.606800:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.606817:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386752 00000100:00100000:0.0:1713481296.606820:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386752 00010000:00010000:0.0:1713481296.606831:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097308240/0xdfc0fb14891ac98 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x8055:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c87ce expref: 20899 pid: 16465 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.606846:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820029 00000100:00100000:0.0:1713481296.606849:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20899:1960:x1796714882386752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.606857:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.606861:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097308240/0xdfc0fb14891ac98 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x8055:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c87ce expref: 20899 pid: 16465 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.606868:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097308240/0xdfc0fb14891ac98 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8055:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c87ce expref: 20899 pid: 16465 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.606881:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097308240/0xdfc0fb14891ac98 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8055:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c87ce expref: 20899 pid: 16465 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.606891:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.606892:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.606895:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e88900/0xdfc0fb148a380fa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8055:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b7e expref: 16452 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.606902:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e88900/0xdfc0fb148a380fa lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8055:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b7e expref: 16452 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.606917:0:16553:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092e88900/0xdfc0fb148a380fa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8055:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b7e expref: 16452 pid: 16502 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.606923:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d09a300/2, rc 0, transno 1073404 00000100:00100000:0.0:1713481296.606925:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800786d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784464896:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.606934:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d09a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784461824:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.606943:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012cb92cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.606947:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d098a80/2, rc 0, transno 1073405 00000100:00100000:3.0:1713481296.606951:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784461632:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.607010:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784464960:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.607021:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.607046:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.607098:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784464832 00000100:00100000:0.0:1713481296.607101:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784464832 00000100:00100000:0.0:1713481296.607138:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82857 00000100:00100000:0.0:1713481296.607142:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:8077:x1796714784464832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713481296.607243:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:8077:x1796714784464832:12345-0@lo:1000:osp_up0-1.0 Request processed in 98us (1004us total) trans 4295105883 rc 0/0 00000100:00100000:0.0:1713481296.607249:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82857 00010000:00010000:0.0:1713481296.607285:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094395f80/0xdfc0fb148802051 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9624ec expref: 20898 pid: 16465 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.607297:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784461696:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.607310:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607317:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607322:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607328:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607334:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607339:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607348:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011f9ed680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.607351:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607356:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607366:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607371:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f9ed680/0xdfc0fb148a380de lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.607477:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2085:18895:x1796714882386624:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 1567us (1599us total) trans 4295107547 rc 0/0 00000100:00100000:0.0:1713481296.607483:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125655 00000004:00080000:0.0:1713481296.607573:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f99bb80/2, rc 0, transno 1073406 00000100:00100000:0.0:1713481296.607580:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784461568:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.607602:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882386880 00000100:00100000:0.0:1713481296.607604:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882386880 00010000:00010000:0.0:1713481296.607615:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094396400/0xdfc0fb148802066 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962516 expref: 20898 pid: 16465 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.607633:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820030 00000100:00100000:0.0:1713481296.607637:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20898:1960:x1796714882386880:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.607645:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.607649:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094396400/0xdfc0fb148802066 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962516 expref: 20898 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.607657:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094396400/0xdfc0fb148802066 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962516 expref: 20898 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.607687:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094396400/0xdfc0fb148802066 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962516 expref: 20898 pid: 16465 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.607698:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.607700:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.607703:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607710:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607725:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.607745:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20897:1960:x1796714882386880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.607751:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820030 00010000:00010000:0.0:1713481296.607784:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607790:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607803:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607809:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607815:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607821:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092e8b600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.607823:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607830:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607843:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.607849:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e8b600/0xdfc0fb148a38101 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.607984:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dda2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+44:3492:x1796714784462080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9229us (9274us total) trans 4296040703 rc 0/0 00000100:00100000:0.0:1713481296.607990:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562003 00000100:00100000:0.0:1713481296.608095:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784465344 00000100:00100000:0.0:1713481296.608099:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784465344 00000100:00100000:0.0:1713481296.608141:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562028 00000100:00100000:0.0:1713481296.608145:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+44:3490:x1796714784465344:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.608156:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9872 count 1 00010000:00010000:0.0:1713481296.608167:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5f80/0xdfc0fb148a3823c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2690:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.608178:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880079b30b40/0xdfc0fb14880209e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2690:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962586 expref: 20896 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.608184:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.608185:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.608188:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5f80/0xdfc0fb148a3823c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2690:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.608204:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880079b30b40/0xdfc0fb14880209e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2690:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962586 expref: 20896 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.608212:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880079b30b40/0xdfc0fb14880209e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2690:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962586 expref: 20896 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.608221:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800786d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784465408:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.608243:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013431b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.609006:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.609027:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.609038:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.609048:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.609197:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.609222:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882387264 00000100:00100000:3.0:1713481296.609227:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882387264 00000100:00100000:3.0:1713481296.609250:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485726 00000100:00100000:3.0:1713481296.609256:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2408:18896:x1796714882387264:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.609267:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.609273:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.609277:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f815d40/0xdfc0fb148a3825f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x34d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47bee expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.609308:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f815d40/0xdfc0fb148a3825f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x34d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bee expref: 2409 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.609313:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.609319:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f815d40/0xdfc0fb148a3825f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x34d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bee expref: 2409 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.609332:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d3:0x0].0x0 (ffff8800848b7100) 00010000:00010000:3.0:1713481296.609335:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1713481296.609336:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882387456 00010000:00010000:3.0:1713481296.609338:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f815d40, rc 0) 00000100:00100000:3.0:1713481296.609367:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2409:18896:x1796714882387264:12345-192.168.202.24@tcp:101:touch.0 Request processed in 110us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.609374:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485726 00000100:00100000:3.0:1713481296.609394:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882387392 00000100:00100000:0.0:1713481296.609398:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882387456 00000100:00100000:3.0:1713481296.609398:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882387392 00000100:00100000:3.0:1713481296.609415:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485727 00000100:00100000:0.0:1713481296.609419:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562033 00000100:00100000:3.0:1713481296.609420:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2085:18604:x1796714882387392:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.609423:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16453:18844:x1796714882387456:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.609430:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.609438:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5440/0xdfc0fb148a38266 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47bf5 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.609444:0:15577:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1713481296.609448:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.609455:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.609457:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.609457:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880135be0b40/0xdfc0fb148a38178 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b85 expref: 2085 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.609460:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5440/0xdfc0fb148a38266 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bf5 expref: 16454 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.609469:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5440/0xdfc0fb148a38266 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47bf5 expref: 16454 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.609476:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e3d5440, rc 0) 00010000:00010000:3.0:1713481296.609484:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098e5e640/0xdfc0fb148a01815 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa319e9 expref: 2084 pid: 15591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.609494:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16454:18844:x1796714882387456:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.609500:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562033 00010000:00010000:3.0:1713481296.609504:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c1d:0x0].0x0 (ffff880081d3cd00) 00010000:00010000:3.0:1713481296.609518:0:15577:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.609534:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15514:1796714784462912:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.609534:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.609541:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609548:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.609556:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.609558:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1d5:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.609564:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609568:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609610:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.609617:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609626:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.609641:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784463168:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.609678:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009737a1c0/0xdfc0fb148a381a2 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47baf expref: 16453 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.609687:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009737a1c0, rc 0) 00000100:00100000:0.0:1713481296.609705:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16453:8499:x1796714882385536:12345-192.168.202.24@tcp:101:dd.0 Request processed in 9157us (9237us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.609710:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562011 00000040:00080000:3.0:1713481296.609798:0:15577:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31880, 64 off2048512 00010000:00010000:3.0:1713481296.609855:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.609862:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609869:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609875:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609880:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609885:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609890:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609894:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dd96d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.609897:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609902:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609908:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c1d:0x0].0x0 (ffff88009a8c3700) 00000100:00100000:0.0:1713481296.609911:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882387776 00010000:00010000:3.0:1713481296.609911:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.609914:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 3/0,0 mode: --/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.609915:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882387776 00010000:00010000:3.0:1713481296.609919:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a3829e lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2c1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.609934:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562034 00000100:00100000:0.0:1713481296.609937:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16453:18817:x1796714882387776:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.609943:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.609944:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.609948:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.609951:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5680/0xdfc0fb148a382a5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c03 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.609953:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609958:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dd94fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.609960:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.609964:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094316f40/0xdfc0fb1489cf1da lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21f1d expref: 20901 pid: 16458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.609965:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.609969:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.609970:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.609972:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c1d:0x0].0x0 (ffff88009a8c3700) 00010000:00010000:0.0:1713481296.609973:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5680/0xdfc0fb148a382a5 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c03 expref: 16454 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.609974:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.609977:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.609981:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd94fc0/0xdfc0fb148a3827b lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.609985:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094316f40/0xdfc0fb1489cf1da lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21f1d expref: 20901 pid: 16458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.609993:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094316f40/0xdfc0fb1489cf1da lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21f1d expref: 20901 pid: 16458 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.610001:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784465600:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.610020:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098746d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.610045:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784463872:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.610059:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.610084:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012caf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784464064:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.610101:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.610105:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.610112:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.610141:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.610148:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.610153:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f816ac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.610155:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.610161:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.610169:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x0 (ffff880120969f00) 00010000:00010000:3.0:1713481296.610171:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.610174:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 3/0,0 mode: --/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.610179:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a3826d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.610190:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820032 00000100:00100000:0.0:1713481296.610195:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16455:1957:x1796714882388032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00010000:3.0:1713481296.610200:0:15577:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880083794700 reply state ffff88009dec8000 transno 4295107549 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.610202:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.610206:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991dcd80/0xdfc0fb1488e7e37 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54c3 expref: 16455 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.610209:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.610214:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991dcd80/0xdfc0fb1488e7e37 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54c3 expref: 16455 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.610215:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x37 (ffff88009ca4bb00) 00010000:00010000:3.0:1713481296.610217:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.610219:0:15577:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.610227:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991dcd80/0xdfc0fb1488e7e37 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54c3 expref: 16455 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.610235:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.610237:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.610240:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009737a1c0/0xdfc0fb148a381a2 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47baf expref: 16454 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.610246:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009737a1c0/0xdfc0fb148a381a2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47baf expref: 16454 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.610250:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2089:18604:x1796714882387392:12345-192.168.202.24@tcp:36:rm.0 Request processed in 829us (976us total) trans 4295107549 rc 0/0 00010000:00010000:0.0:1713481296.610260:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009737a1c0/0xdfc0fb148a381a2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47baf expref: 16454 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.610261:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485727 00000100:00100000:0.0:1713481296.610267:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784465664:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.610283:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.610310:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098232d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784463296:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.610330:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.610347:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24474:1960:x1796714882384256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 9547us (9603us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.610353:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820015 00010000:00010000:0.0:1713481296.610414:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610420:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610431:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.610441:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610446:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610491:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610496:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610501:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610505:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e3d6640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.610507:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610511:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610517:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff8800848b7300) 00010000:00010000:0.0:1713481296.610519:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713481296.610521:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610525:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d6640/0xdfc0fb148a382b3 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610540:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610544:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610549:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610553:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009aac5b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.610555:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610559:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610564:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88011f854b00) 00010000:00010000:0.0:1713481296.610566:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1713481296.610568:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610572:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac5b00/0xdfc0fb148a3814e lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610594:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610597:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610600:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610603:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610605:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bef3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.610607:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610612:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610617:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:0.0:1713481296.610618:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.610619:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610622:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef3c0/0xdfc0fb148a38124 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610633:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610636:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610640:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610644:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801361f5440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.610647:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610651:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610657:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff88009d505000) 00010000:00010000:0.0:1713481296.610659:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.610661:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610679:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801361f5440/0xdfc0fb148a3812b lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610794:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610800:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610805:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610809:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009aac4fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.610811:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610816:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610822:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88009d505e00) 00010000:00010000:0.0:1713481296.610824:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.610826:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.610830:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac4fc0/0xdfc0fb148a38139 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.610919:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2408:18800:x1796714882380928:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 11296us (20028us total) trans 0 rc -39/-39 00000100:00100000:0.0:1713481296.610926:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26096 00000004:00080000:0.0:1713481296.610981:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007dda3480/2, rc 0, transno 1073409 00000100:00100000:0.0:1713481296.610989:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dda3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784462208:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.611006:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820039 00000100:00100000:0.0:1713481296.611010:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24474:1960:x1796714882388096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.611018:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.611022:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096bad440/0xdfc0fb14891d13c lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6c2 expref: 24474 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.611031:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096bad440/0xdfc0fb14891d13c lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6c2 expref: 24474 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.611044:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096bad440/0xdfc0fb14891d13c lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6c2 expref: 24474 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.611056:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.611069:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24473:1960:x1796714882388096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.611075:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820039 00010000:00010000:0.0:1713481296.611094:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611100:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611106:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611112:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611117:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611140:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097378480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.611144:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611150:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.611157:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882389888 00000100:00100000:3.0:1713481296.611161:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882389888 00010000:00010000:0.0:1713481296.611163:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611170:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097378480/0xdfc0fb148a381cc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.611180:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485730 00000100:00100000:3.0:1713481296.611185:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2184:18578:x1796714882389888:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.611199:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.611209:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dd958c0/0xdfc0fb148a382c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c2d expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.611281:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079920900/0xdfc0fb148a382d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.611291:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079920900/0xdfc0fb148a382d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.611298:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079920900/0xdfc0fb148a382d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00000004:00200000:3.0:1713481296.611306:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385d:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.611372:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dd958c0/0xdfc0fb148a382c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c2d expref: 2187 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.611387:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880079920900/0xdfc0fb148a382d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c2d expref: 2186 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.611394:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88011f854800) 00010000:00010000:3.0:1713481296.611396:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1713481296.611399:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079920900, rc 0) 00000100:00100000:3.0:1713481296.611417:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2186:18578:x1796714882389888:12345-192.168.202.24@tcp:101:rm.0 Request processed in 230us (576us total) trans 4295105884 rc 0/0 00000100:00100000:3.0:1713481296.611424:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485730 00000100:00100000:0.0:1713481296.611496:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2661:3490:x1796714784463808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9346us (9525us total) trans 4295960600 rc 0/0 00000100:00100000:0.0:1713481296.611502:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562016 00010000:00010000:0.0:1713481296.611531:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611537:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611544:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611549:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611628:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611632:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132246880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.611634:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611693:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611707:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611713:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132246880/0xdfc0fb148a381d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.611879:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2663:3492:x1796714784463936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9252us (9373us total) trans 4295960601 rc 0/0 00000100:00100000:0.0:1713481296.611885:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562017 00000100:00100000:0.0:1713481296.611900:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882388736 00000100:00100000:0.0:1713481296.611903:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882388736 00000100:00100000:0.0:1713481296.611915:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562039 00000100:00100000:0.0:1713481296.611919:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16455:11552:x1796714882388736:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.611925:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.611933:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e3d7180/0xdfc0fb148a382f9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c11 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611949:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5680/0xdfc0fb148959afb lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb67 expref: 16456 pid: 16476 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.611954:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.611956:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.611958:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3d7180/0xdfc0fb148a382f9 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c11 expref: 16456 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.611971:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5680/0xdfc0fb148959afb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb67 expref: 16456 pid: 16476 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.611978:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cbd5680/0xdfc0fb148959afb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb67 expref: 16456 pid: 16476 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.611987:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784466304:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.611999:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a300 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.612018:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800918c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784464704:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.612031:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fe15440/0xdfc0fb148a38220 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x268c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.612103:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882390528 00000100:00100000:0.0:1713481296.612107:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882390528 00000100:00100000:0.0:1713481296.612208:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82858 00000100:00100000:0.0:1713481296.612212:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091227c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2408:1957:x1796714882390528:12345-192.168.202.24@tcp:63:ll_sa.0 00010000:00010000:0.0:1713481296.612234:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.612241:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d4b40/0xdfc0fb148a38307 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c49 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.612367:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612375:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612382:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612390:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612397:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612402:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612440:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf840/0xdfc0fb148a3831c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612447:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf840/0xdfc0fb148a3831c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612453:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf840/0xdfc0fb148a3831c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00000004:00200000:0.0:1713481296.612471:0:8640:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713481296.612481:0:8640:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf840/0xdfc0fb148a3831c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612488:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf840/0xdfc0fb148a3831c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612495:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612500:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612504:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612508:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aaef40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.612511:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612516:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612522:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:0.0:1713481296.612523:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.612526:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612530:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaef40/0xdfc0fb148a3830e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612543:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612547:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612552:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612555:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aad8c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.612558:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612562:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612567:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x32 (ffff880090b3be00) 00010000:00010000:0.0:1713481296.612569:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.612571:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612575:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aad8c0/0xdfc0fb148a38315 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612603:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e3d4b40/0xdfc0fb148a38307 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c49 expref: 2410 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.612617:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf840/0xdfc0fb148a3831c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c49 expref: 2409 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.612622:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d3:0x0].0x0 (ffff8800848b7100) 00010000:00010000:0.0:1713481296.612624:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713481296.612626:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aaf840, rc 0) 00010000:00010000:0.0:1713481296.612629:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.612635:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac900/0xdfc0fb148a38323 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c57 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.612649:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612655:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612664:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612687:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612692:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612697:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612725:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092929200/0xdfc0fb148a38338 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x348e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612732:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092929200/0xdfc0fb148a38338 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x348e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612738:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092929200/0xdfc0fb148a38338 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x348e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00000004:00200000:0.0:1713481296.612757:0:8640:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x348e:0x0]: returning size 0 00000004:00200000:0.0:1713481296.612759:0:8640:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713481296.612766:0:8640:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880092929200/0xdfc0fb148a38338 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x348e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612772:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092929200/0xdfc0fb148a38338 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x348e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612777:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612781:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612789:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612793:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aac240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.612795:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612799:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612804:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:0.0:1713481296.612806:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.612808:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612812:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac240/0xdfc0fb148a3832a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612821:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612826:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612830:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612834:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aaf180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.612837:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612842:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612851:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x35 (ffff8800a2676400) 00010000:00010000:0.0:1713481296.612852:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.612853:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612856:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aaf180/0xdfc0fb148a38331 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612882:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aac900/0xdfc0fb148a38323 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c57 expref: 2411 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.612889:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092929200/0xdfc0fb148a38338 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x348e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c57 expref: 2410 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.612893:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x348e:0x0].0x0 (ffff88012ce8da00) 00010000:00010000:0.0:1713481296.612894:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713481296.612895:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092929200, rc 0) 00010000:00010000:0.0:1713481296.612898:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.612902:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092929b00/0xdfc0fb148a3833f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c5e expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.612913:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612917:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612920:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612926:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.612930:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.612933:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613001:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad5d40/0xdfc0fb148a38354 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.613006:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad5d40/0xdfc0fb148a38354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613010:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad5d40/0xdfc0fb148a38354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00000004:00200000:0.0:1713481296.613024:0:8640:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c2:0x0]: returning size 0 00000004:00200000:0.0:1713481296.613026:0:8640:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713481296.613031:0:8640:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad5d40/0xdfc0fb148a38354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613035:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad5d40/0xdfc0fb148a38354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613038:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613041:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613044:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613047:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009292a640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.613049:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613052:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613056:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:0.0:1713481296.613057:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.613058:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613061:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009292a640/0xdfc0fb148a38346 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613071:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613074:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613077:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613079:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009292b3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.613081:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613083:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613086:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x39 (ffff88009f9a1800) 00010000:00010000:0.0:1713481296.613087:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.613088:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613091:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009292b3c0/0xdfc0fb148a3834d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613114:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092929b00/0xdfc0fb148a3833f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c5e expref: 2412 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613141:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad5d40/0xdfc0fb148a38354 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34c2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c5e expref: 2411 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613145:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c2:0x0].0x0 (ffff880093305600) 00010000:00010000:0.0:1713481296.613146:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713481296.613148:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ad5d40, rc 0) 00010000:00010000:0.0:1713481296.613150:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.613154:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a38362 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c65 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613166:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.613173:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613178:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613187:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.613193:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613198:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613227:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850b40/0xdfc0fb148a3837e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.613234:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850b40/0xdfc0fb148a3837e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613239:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850b40/0xdfc0fb148a3837e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00000004:00200000:0.0:1713481296.613258:0:8640:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c84:0x0]: returning size 0 00000004:00200000:0.0:1713481296.613260:0:8640:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713481296.613268:0:8640:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850b40/0xdfc0fb148a3837e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613275:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850b40/0xdfc0fb148a3837e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613280:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613285:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613290:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613294:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f852640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.613297:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613302:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613309:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:0.0:1713481296.613311:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.613313:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613318:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f852640/0xdfc0fb148a38369 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613331:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613336:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613342:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613346:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f850480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.613348:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613352:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613358:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x37 (ffff88009c664a00) 00010000:00010000:0.0:1713481296.613360:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.613362:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613367:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38370 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613403:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a38362 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c65 expref: 2413 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613419:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850b40/0xdfc0fb148a3837e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c65 expref: 2412 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613429:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c84:0x0].0x0 (ffff880124d79000) 00010000:00010000:0.0:1713481296.613431:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713481296.613433:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f850b40, rc 0) 00010000:00010000:0.0:1713481296.613437:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.613444:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a38393 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c6c expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613461:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.613468:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613475:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613485:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.613490:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613496:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613524:0:8640:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cdf80/0xdfc0fb148a383af lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8640 initiator: MDT0 00010000:00010000:0.0:1713481296.613532:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cdf80/0xdfc0fb148a383af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613538:0:8640:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cdf80/0xdfc0fb148a383af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00000004:00200000:0.0:1713481296.613554:0:8640:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c1:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.613556:0:8640:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713481296.613564:0:8640:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cdf80/0xdfc0fb148a383af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613571:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613576:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613581:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613586:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f851200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.613588:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613593:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613600:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:0.0:1713481296.613602:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.613604:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613608:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a383a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613620:0:8640:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613625:0:8640:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613631:0:8640:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613635:0:8640:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801305cc000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.613637:0:8640:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613642:0:8640:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613648:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x3331 (ffff88009c664100) 00010000:00010000:0.0:1713481296.613650:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.613651:0:8640:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613656:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a383a8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8640 initiator: MDT1 00010000:00010000:0.0:1713481296.613705:0:8640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a38393 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c6c expref: 2414 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613721:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cdf80/0xdfc0fb148a383af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34c1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c6c expref: 2413 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.613727:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c1:0x0].0x0 (ffff88009a9e1d00) 00010000:00010000:0.0:1713481296.613729:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713481296.613731:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305cdf80, rc 0) 00000100:00100000:0.0:1713481296.613754:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091227c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2413:1957:x1796714882390528:12345-192.168.202.24@tcp:63:ll_sa.0 Request processed in 1541us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.613762:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82858 00000100:00100000:3.0:1713481296.613782:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882389440 00000100:00100000:3.0:1713481296.613787:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882389440 00000100:00100000:3.0:1713481296.613822:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485732 00000100:00100000:3.0:1713481296.613829:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2186:18580:x1796714882389440:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.613848:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713481296.613861:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f876880/0xdfc0fb148a30ff0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3815:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4377d expref: 2186 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.613886:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d22fcc0/0xdfc0fb1489f0a25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3815:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2be80 expref: 2185 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.613898:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3815:0x0].0x0 (ffff8800795e8f00) 00010000:00010000:3.0:1713481296.613917:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.613931:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.613938:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.613945:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.613955:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x380a:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.613960:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.613965:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614003:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614009:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614014:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000040:00080000:3.0:1713481296.614160:0:15484:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13925, 64 off899392 00010000:00010000:3.0:1713481296.614196:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614204:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614210:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614216:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614221:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614226:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614231:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614236:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a7c480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.614239:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614245:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614252:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3815:0x0].0x0 (ffff880081d3cd00) 00010000:00010000:3.0:1713481296.614255:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.614257:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 3/0,0 mode: --/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614263:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083a7c480/0xdfc0fb148a383ee lrc: 0/0,0 mode: --/PW res: [0x200000404:0x3815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614282:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614287:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614292:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614297:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134b41200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.614300:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614305:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614312:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3815:0x0].0x0 (ffff880081d3cd00) 00010000:00010000:3.0:1713481296.614314:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.614316:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614322:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b41200/0xdfc0fb148a383e0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614441:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614449:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614454:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614459:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614464:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098e5e640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.614467:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614472:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614480:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380a:0x0].0x0 (ffff8801345a4400) 00010000:00010000:3.0:1713481296.614482:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.614485:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614490:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098e5e640/0xdfc0fb148a383d2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x380a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000004:00010000:3.0:1713481296.614508:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009c4b1c00 reply state ffff88009d4ac000 transno 4295105885 ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614516:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.614521:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380a:0x0].0x3131 (ffff8801345a4f00) 00010000:00010000:3.0:1713481296.614524:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.614526:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.614553:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2186:18580:x1796714882389440:12345-192.168.202.24@tcp:36:rm.0 Request processed in 723us (790us total) trans 4295105885 rc 0/0 00000100:00100000:3.0:1713481296.614561:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485732 00000100:00100000:3.0:1713481296.614843:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007556ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+46:3492:x1796714784465216:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7192us (7221us total) trans 4296040711 rc 0/0 00000100:00100000:3.0:1713481296.614851:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562027 00000100:00100000:3.0:1713481296.614888:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882390144 00000100:00100000:3.0:1713481296.614891:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882390144 00000100:00100000:3.0:1713481296.614907:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485734 00000100:00100000:3.0:1713481296.614912:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2186:18862:x1796714882390144:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.614921:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.614930:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013460a880/0xdfc0fb148a383fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c34 expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.614989:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.614997:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615004:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615013:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615019:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615024:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615043:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615048:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615053:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615058:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615062:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cddf840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.615065:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615070:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615077:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.615080:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.615082:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615087:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddf840/0xdfc0fb148a3840a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615101:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615107:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615112:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615141:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cddc240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.615144:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615150:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615158:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3431 (ffff88009b231000) 00010000:00010000:3.0:1713481296.615160:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.615162:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615166:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cddc240/0xdfc0fb148a38411 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.615208:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013460a880/0xdfc0fb148a383fc lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c34 expref: 2191 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.615215:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013460a880/0xdfc0fb148a383fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c34 expref: 2191 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.615227:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013460a880, rc 0) 00000100:00100000:0.0:1713481296.615234:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784465600:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.615245:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18862:x1796714882390144:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 332us (444us total) trans 0 rc 301/301 00010000:00010000:0.0:1713481296.615251:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5680/0xdfc0fb148a382a5 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c03 expref: 16459 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.615252:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485734 00010000:00010000:0.0:1713481296.615258:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e3d5680, rc 0) 00000100:00100000:0.0:1713481296.615270:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16459:18817:x1796714882387776:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 5331us (5376us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.615276:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562034 00000100:00100000:0.0:1713481296.615307:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784465664:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.615325:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.615338:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16458:1957:x1796714882388032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5142us (5304us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.615345:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820032 00000100:00100000:0.0:1713481296.615377:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882390592 00000100:00100000:0.0:1713481296.615380:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882390592 00010000:00010000:0.0:1713481296.615392:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094316f40/0xdfc0fb1489cf1da lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21f1d expref: 20897 pid: 16458 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.615415:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820054 00000100:00100000:0.0:1713481296.615419:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20897:1959:x1796714882390592:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.615425:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.615428:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094316f40/0xdfc0fb1489cf1da lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21f1d expref: 20897 pid: 16458 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.615436:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094316f40/0xdfc0fb1489cf1da lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21f1d expref: 20897 pid: 16458 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.615454:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094316f40/0xdfc0fb1489cf1da lrc: 0/0,0 mode: --/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa21f1d expref: 20897 pid: 16458 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.615464:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.615465:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.615467:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5680/0xdfc0fb148a382a5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c03 expref: 16457 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.615472:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5680/0xdfc0fb148a382a5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c03 expref: 16457 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.615485:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011e3d5680/0xdfc0fb148a382a5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c03 expref: 16457 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.615493:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784467328:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.615509:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.615524:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882390848 00000100:00100000:0.0:1713481296.615527:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882390848 00000100:00100000:0.0:1713481296.615553:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562051 00000100:00100000:0.0:1713481296.615558:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16458:8499:x1796714882390848:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.615565:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.615574:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305ce400/0xdfc0fb148a38426 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c73 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.615587:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dfaef40/0xdfc0fb1488e7e06 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ca expref: 16459 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.615594:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.615595:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.615598:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801305ce400/0xdfc0fb148a38426 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c73 expref: 16459 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.615613:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dfaef40/0xdfc0fb1488e7e06 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ca expref: 16459 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.615621:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dfaef40/0xdfc0fb1488e7e06 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ca expref: 16459 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.615630:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784467392:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.615647:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.615801:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784467584:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.615822:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.615834:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784467584 00000100:00100000:3.0:1713481296.615838:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784467584 00000100:00100000:3.0:1713481296.615859:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562054 00000100:00100000:3.0:1713481296.615864:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+48:3490:x1796714784467584:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.615882:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9876 count 1 00010000:00010000:3.0:1713481296.615897:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.615910:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d121d40/0xdfc0fb1488020ba lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2694:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625be expref: 20895 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.615917:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.615918:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.615921:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.615934:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d1bfb80/2, rc 0, transno 1073416 00000100:00100000:0.0:1713481296.615939:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009d1bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784465344:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.615944:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d121d40/0xdfc0fb1488020ba lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2694:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625be expref: 20895 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.615955:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d121d40/0xdfc0fb1488020ba lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2694:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625be expref: 20895 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.615967:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784467776:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.615989:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784467904:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.615994:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008437a180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.616008:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.616013:0:16508:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784467840 00000100:00100000:3.0:1713481296.616016:0:16508:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784467840 00000100:00100000:3.0:1713481296.616034:0:16508:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784467904 00000100:00100000:3.0:1713481296.616036:0:16508:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784467904 00000100:00100000:0.0:1713481296.616044:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.616049:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784467968:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.616053:0:16508:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562056 00000100:00100000:3.0:1713481296.616057:0:16508:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0001-mdtlov_UUID+50:3492:x1796714784467904:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.616068:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713481296.616069:0:16508:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9878 count 1 00010000:00010000:3.0:1713481296.616083:0:16508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.616093:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784467968 00010000:00010000:3.0:1713481296.616094:0:16508:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b1121c0/0xdfc0fb1488020c8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2696:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625da expref: 20894 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.616097:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784467968 00010000:00010000:3.0:1713481296.616100:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.616101:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.616104:0:16508:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.616144:0:16508:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b1121c0/0xdfc0fb1488020c8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2696:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625da expref: 20894 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.616153:0:16508:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b1121c0/0xdfc0fb1488020c8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2696:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625da expref: 20894 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.616163:0:16508:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16508:1796714784468096:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.616187:0:16508:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800961539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.616213:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882390912 00000100:00100000:0.0:1713481296.616216:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882390912 00000100:00100000:0.0:1713481296.616282:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562059 00000100:00100000:0.0:1713481296.616287:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16461:17009:x1796714882390912:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.616293:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.616301:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305cf3c0/0xdfc0fb148a3845e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c7a expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.616312:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.616321:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.616323:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.616327:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801305cf3c0/0xdfc0fb148a3845e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c7a expref: 16463 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.616336:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305cf3c0/0xdfc0fb148a3845e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c7a expref: 16463 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.616344:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305cf3c0, rc 0) 00000100:00100000:0.0:1713481296.616358:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16463:17009:x1796714882390912:12345-192.168.202.24@tcp:101:dd.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.616367:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562059 00000100:00100000:0.0:1713481296.616491:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784468224:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.616513:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.616539:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784468224 00000100:00100000:3.0:1713481296.616543:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784468224 00000100:00100000:3.0:1713481296.616563:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562060 00000100:00100000:3.0:1713481296.616568:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+52:3490:x1796714784468224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.616579:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9880 count 1 00010000:00010000:3.0:1713481296.616590:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.616601:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d122880/0xdfc0fb1488020d6 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2698:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625f6 expref: 20893 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.616608:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.616610:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.616613:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.616631:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d122880/0xdfc0fb1488020d6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2698:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625f6 expref: 20893 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.616639:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784466304:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.616640:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d122880/0xdfc0fb1488020d6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2698:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9625f6 expref: 20893 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.616651:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784468288:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.616661:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e3d7180/0xdfc0fb148a382f9 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c11 expref: 16461 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.616686:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096153c00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.616774:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e3d7180, rc 0) 00000100:00100000:0.0:1713481296.616790:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16461:11552:x1796714882388736:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4869us (4991us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.616797:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562039 00000100:00100000:0.0:1713481296.616893:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.616901:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784468352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.616923:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.617005:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784468352 00000100:00100000:0.0:1713481296.617009:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784468352 00000100:00100000:3.0:1713481296.617019:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882391232 00000100:00100000:3.0:1713481296.617023:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882391232 00000100:00100000:0.0:1713481296.617034:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562061 00000100:00100000:0.0:1713481296.617039:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+53:3490:x1796714784468352:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.617043:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485736 00000100:00100000:3.0:1713481296.617048:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18578:x1796714882391232:12345-192.168.202.24@tcp:101:rm.0 00002000:00080000:0.0:1713481296.617051:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9881 count 1 00010000:00010000:3.0:1713481296.617056:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.617061:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617066:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098366ac0/0xdfc0fb148a38473 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47c8f expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617071:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6b3c0/0xdfc0fb1488020dd lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2699:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962604 expref: 20893 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.617077:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.617078:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.617080:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617094:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb6b3c0/0xdfc0fb1488020dd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2699:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962604 expref: 20893 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.617106:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6b3c0/0xdfc0fb1488020dd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2699:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962604 expref: 20893 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.617114:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077960000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784468416:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.617143:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a300 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.617145:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617154:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617164:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617175:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617181:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617187:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.617189:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c4b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784467008:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.617210:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617220:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d7f180/0xdfc0fb148a3848f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x385e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617228:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d7f180/0xdfc0fb148a3848f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617233:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d7f180/0xdfc0fb148a3848f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.617242:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882391360 00000100:00100000:0.0:1713481296.617245:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882391360 00000004:00200000:3.0:1713481296.617251:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385e:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.617254:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.617258:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ce880/0xdfc0fb1486887eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d265c expref: 26617 pid: 15541 timeout: 815 lvb_type: 1 00000004:00010000:3.0:1713481296.617263:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095d7f180/0xdfc0fb148a3848f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617270:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.617274:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820056 00010000:00010000:3.0:1713481296.617276:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.617278:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26618:1959:x1796714882391360:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.617281:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.617284:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.617287:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c0ce880/0xdfc0fb1486887eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d265c expref: 26618 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.617291:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.617294:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c0ce880/0xdfc0fb1486887eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d265c expref: 26618 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.617296:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098367600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.617299:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617304:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.617308:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ce880/0xdfc0fb1486887eb lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d265c expref: 26618 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.617312:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88011f854800) 00010000:00010000:3.0:1713481296.617315:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.617317:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.617317:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.617319:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.617321:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617322:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098367600/0xdfc0fb148a3847a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.617327:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617336:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.617339:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.617341:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617346:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.617351:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26616:1959:x1796714882391360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (128us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.617351:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098364b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.617353:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.617356:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820056 00010000:00010000:3.0:1713481296.617359:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617370:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x38 (ffff88009d505e00) 00010000:00010000:3.0:1713481296.617372:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.617373:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617374:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.617378:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098364b40/0xdfc0fb148a38488 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.617380:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617385:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617391:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617396:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617406:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834d3600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.617408:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617413:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098366ac0/0xdfc0fb148a38473 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c8f expref: 2190 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617414:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617424:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617427:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d7f180/0xdfc0fb148a3848f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c8f expref: 2189 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617429:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800834d3600/0xdfc0fb148a382e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.617434:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x0 (ffff8800897e3f00) 00010000:00010000:3.0:1713481296.617436:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.617438:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d7f180, rc 0) 00000100:00100000:3.0:1713481296.617456:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2189:18578:x1796714882391232:12345-192.168.202.24@tcp:101:rm.0 Request processed in 407us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.617462:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485736 00000100:00100000:0.0:1713481296.617559:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d09ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2668:3492:x1796714784465920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6182us (6236us total) trans 4295960607 rc 0/0 00000100:00100000:0.0:1713481296.617565:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562036 00000004:00080000:0.0:1713481296.617599:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d09b480/2, rc 0, transno 993311 00000100:00100000:0.0:1713481296.617605:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784465920:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.617641:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d09aa00/2, rc 0, transno 993310 00000100:00100000:0.0:1713481296.617645:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d09aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784466112:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.617743:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617750:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617761:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617767:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617772:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617777:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099becfc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.617779:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617784:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.617795:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1713481296.617799:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040697 00010000:00010000:0.0:1713481296.617800:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099becfc0/0xdfc0fb148a38385 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.617897:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 55250 00000100:00100000:0.0:1713481296.617930:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2669:3491:x1796714784466688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4714us (4738us total) trans 4295960608 rc 0/0 00000100:00100000:0.0:1713481296.617936:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562043 00000100:00100000:0.0:1713481296.617951:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784468608 00000100:00100000:0.0:1713481296.617954:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784468608 00000100:00100000:0.0:1713481296.617965:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784468544 00000100:00100000:0.0:1713481296.617967:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784468544 00000100:00100000:0.0:1713481296.617988:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562064 00000100:00100000:0.0:1713481296.617992:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2669:3493:x1796714784468544:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.618003:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43224 count 1 00010000:00010000:0.0:1713481296.618013:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.618024:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206f06c0/0xdfc0fb1486888bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26d3 expref: 26612 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.618030:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.618032:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.618034:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.618049:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801206f06c0/0xdfc0fb1486888bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26d3 expref: 26612 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.618057:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801206f06c0/0xdfc0fb1486888bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26d3 expref: 26612 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.618067:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784468736:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.618081:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097e18b40 going to sleep for 11 seconds 00000004:00080000:0.0:1713481296.618107:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008daa4e00/2, rc 0, transno 993313 00000100:00100000:0.0:1713481296.618111:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008daa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784466560:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.618154:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784468864:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.618173:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.620313:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.620338:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882393472 00000100:00100000:3.0:1713481296.620342:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882393472 00000100:00100000:0.0:1713481296.620349:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.620365:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485737 00000100:00100000:3.0:1713481296.620371:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2414:18729:x1796714882393472:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.620403:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.620413:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a384b2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47cdc expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.620494:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.620495:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd958c0/0xdfc0fb148a384b9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x3480:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.620504:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd958c0/0xdfc0fb148a384b9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3480:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.620508:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882391680 00000100:00100000:0.0:1713481296.620511:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882391680 00010000:00010000:3.0:1713481296.620512:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd958c0/0xdfc0fb148a384b9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3480:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000004:00200000:3.0:1713481296.620519:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3480:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.620521:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080382640/0xdfc0fb148688862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26c5 expref: 26612 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.620579:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816ac0/0xdfc0fb148a384b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cdc expref: 2417 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.620591:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820063 00010000:00010000:3.0:1713481296.620593:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd958c0/0xdfc0fb148a384b9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x3480:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cdc expref: 2416 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.620596:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26612:1959:x1796714882391680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.620599:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3480:0x0].0x0 (ffff880078e52900) 00010000:00010000:3.0:1713481296.620602:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1713481296.620603:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.620605:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dd958c0, rc 0) 00010000:00010000:0.0:1713481296.620608:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080382640/0xdfc0fb148688862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26c5 expref: 26612 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.620615:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080382640/0xdfc0fb148688862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26c5 expref: 26613 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.620627:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2416:18729:x1796714882393472:12345-192.168.202.24@tcp:101:rm.0 Request processed in 256us (315us total) trans 4295107553 rc 0/0 00010000:00010000:0.0:1713481296.620630:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080382640/0xdfc0fb148688862 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26c5 expref: 26613 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.620634:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485737 00010000:00010000:0.0:1713481296.620640:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.620642:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.620645:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f233c0/0xdfc0fb148a38377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620652:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f233c0/0xdfc0fb148a38377 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620688:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.620704:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26611:1959:x1796714882391680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 108us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.620709:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820063 00010000:00010000:0.0:1713481296.620728:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620733:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620737:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620741:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620744:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620748:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bed8c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.620749:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620753:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620763:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.620819:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099bed8c0/0xdfc0fb148a3838c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.621049:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2672:3492:x1796714784466624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7714us (7758us total) trans 4295960612 rc 0/0 00000100:00100000:0.0:1713481296.621055:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562044 00000004:00080000:0.0:1713481296.621088:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135baf480/2, rc 0, transno 993316 00000100:00100000:0.0:1713481296.621095:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784466624:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.621104:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d099180/2, rc 0, transno 993314 00000100:00100000:0.0:1713481296.621107:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784465984:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.621166:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784469568:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.621183:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.621201:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784469504 00000100:00100000:0.0:1713481296.621203:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784469504 00000100:00100000:0.0:1713481296.621219:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784469568 00000100:00100000:0.0:1713481296.621221:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784469568 00000100:00100000:0.0:1713481296.621228:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562069 00000100:00100000:0.0:1713481296.621231:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2674:3493:x1796714784469504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.621238:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43229 count 1 00010000:00010000:0.0:1713481296.621246:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.621256:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080382400/0xdfc0fb1486888b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2719 expref: 26609 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.621260:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.621261:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.621262:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.621272:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080382400/0xdfc0fb1486888b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2719 expref: 26609 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.621277:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080382400/0xdfc0fb1486888b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2719 expref: 26609 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.621282:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784469632:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.621297:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009837ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.621362:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.621377:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.621394:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.621397:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882392640 00000100:00100000:3.0:1713481296.621401:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882392640 00000100:00100000:0.0:1713481296.621413:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882392832 00000100:00100000:0.0:1713481296.621416:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882392832 00000100:00100000:3.0:1713481296.621422:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485740 00000100:00100000:3.0:1713481296.621428:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2189:18604:x1796714882392640:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.621436:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26098 00000100:00100000:0.0:1713481296.621441:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2190:18866:x1796714882392832:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.621449:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713481296.621461:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713481296.621463:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013306bcc0/0xdfc0fb148a3718e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3833:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4764c expref: 2190 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.621472:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38dd40/0xdfc0fb148a30bb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x50b7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa43634 expref: 2189 pid: 15591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.621488:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007feb8000/0xdfc0fb148a36e69 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3833:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa474f5 expref: 2188 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.621496:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f8eac0/0xdfc0fb148a2f984 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42fdc expref: 2187 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.621511:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88008fd42700) 00010000:00010000:0.0:1713481296.621514:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.621514:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3833:0x0].0x0 (ffff88009c535800) 00010000:00010000:3.0:1713481296.621533:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.621540:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076879180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784469760:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.621562:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.621564:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.621569:0:15484:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.621576:0:15484:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.621582:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007c1ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.621590:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-mdtlov_UUID:15484:1796714784469824:0@lo:101:mdt00_020.0 00000100:00100000:0.0:1713481296.621596:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784469760 00000100:00100000:0.0:1713481296.621598:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784469760 00000100:00100000:3.0:1713481296.621621:0:15484:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.621645:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096153a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.621676:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882392896 00000100:00100000:3.0:1713481296.621680:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882392896 00000100:00100000:3.0:1713481296.621701:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485741 00000100:00100000:3.0:1713481296.621707:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007812d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2416:18552:x1796714882392896:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.621714:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.621723:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a38529 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47cb9 expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.621727:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784469824 00000100:00100000:0.0:1713481296.621730:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784469824 00000100:00100000:0.0:1713481296.621749:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82859 00000100:00100000:0.0:1713481296.621754:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+34:15514:x1796714784469760:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.621779:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.621789:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621796:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621808:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00000100:00100000:0.0:1713481296.621809:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+34:15514:x1796714784469760:12345-0@lo:1000:mdt_io00_009.0 Request processed in 55us (244us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.621814:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.621817:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82859 00010000:00010000:3.0:1713481296.621820:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.621837:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82860 00010000:00010000:3.0:1713481296.621838:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.621841:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15484:x1796714784469824:12345-0@lo:101:mdt00_020.0 00010000:00010000:3.0:1713481296.621843:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.621848:0:6936:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.621848:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621854:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.621858:0:6936:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe3b840/0xdfc0fb148a3853e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a38522 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.621858:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d376f40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.621861:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621866:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.621872:0:6936:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe3b840/0xdfc0fb148a3853e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a38522 expref: 34 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.621874:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.621876:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.621880:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.621885:0:6936:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe3b840/0xdfc0fb148a3853e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38522 expref: 34 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.621885:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d376f40/0xdfc0fb148a38530 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.621891:0:6936:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:0.0:1713481296.621893:0:6936:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.621895:0:6936:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fe3b840, rc 0) 00010000:00010000:3.0:1713481296.621896:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621901:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621906:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621910:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c59b3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.621913:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621918:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621924:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x34 (ffff880120969f00) 00010000:00010000:3.0:1713481296.621926:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.621929:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+34:15484:x1796714784469824:12345-0@lo:101:mdt00_020.0 Request processed in 86us (308us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.621929:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.621933:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c59b3c0/0xdfc0fb148a38537 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.621934:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82860 00010000:00010000:3.0:1713481296.621974:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a38529 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cb9 expref: 2417 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.621975:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784467392:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.621982:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd96d00/0xdfc0fb148a38529 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cb9 expref: 2417 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.621993:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305ce400/0xdfc0fb148a38426 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c73 expref: 16461 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.621997:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dd96d00, rc 0) 00010000:00010000:0.0:1713481296.622003:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305ce400, rc 0) 00000100:00100000:3.0:1713481296.622014:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007812d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2416:18552:x1796714882392896:12345-192.168.202.24@tcp:101:rm.0 Request processed in 307us (523us total) trans 0 rc 301/301 00000100:00100000:0.0:1713481296.622019:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16461:8499:x1796714882390848:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6460us (6627us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.622021:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485741 00000100:00100000:0.0:1713481296.622026:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562051 00000100:00100000:0.0:1713481296.622057:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784467328:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.622071:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.622072:0:15484:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-mdtlov_UUID:15484:1796714784469824:0@lo:101:mdt00_020.0 00000100:00100000:0.0:1713481296.622082:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20892:1959:x1796714882390592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6662us (6723us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.622084:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.622087:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820054 00010000:00010000:3.0:1713481296.622093:0:15484:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.622111:0:15484:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000404:0x3474:0x0] 00010000:00010000:3.0:1713481296.622149:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009e69c240/0xdfc0fb148a38553 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.622155:0:15484:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009e69c240/0xdfc0fb148a38553 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.622162:0:15484:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009e69c240/0xdfc0fb148a38553 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.622169:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882393088 00000100:00100000:0.0:1713481296.622173:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882393088 00000100:00100000:3.0:1713481296.622173:0:15484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800921baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-mdtlov_UUID:15484:1796714784469952:0@lo:101:mdt00_020.0 00010000:00010000:0.0:1713481296.622183:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dfaef40/0xdfc0fb1488e7e06 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ca expref: 16461 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.622195:0:15484:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.622198:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820067 00000100:00100000:0.0:1713481296.622203:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16461:1960:x1796714882393088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.622209:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.622213:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dfaef40/0xdfc0fb1488e7e06 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ca expref: 16461 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.622217:0:15484:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096153a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.622221:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dfaef40/0xdfc0fb1488e7e06 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ca expref: 16461 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.622239:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dfaef40/0xdfc0fb1488e7e06 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ca expref: 16461 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.622252:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.622254:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.622257:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801305ce400/0xdfc0fb148a38426 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c73 expref: 16460 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.622265:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801305ce400/0xdfc0fb148a38426 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c73 expref: 16460 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.622282:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801305ce400/0xdfc0fb148a38426 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c73 expref: 16460 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.622291:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784470208:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.622310:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c6d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.622335:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076879180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784469760:0@lo:1000:mdt_io00_009.0 00010000:00010000:0.0:1713481296.622381:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fe38fc0/0xdfc0fb148a3856f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.622386:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007fe38fc0/0xdfc0fb148a3856f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.622391:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fe38fc0/0xdfc0fb148a3856f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.622411:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fe3b180/0xdfc0fb148a38576 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.622416:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fe3b180/0xdfc0fb148a38576 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.622423:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fe3b180/0xdfc0fb148a38576 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.622433:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470336:0@lo:101:mdt_io00_009.0 00000100:00100000:0.0:1713481296.622453:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.622481:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007c1eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.622497:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470336 00000100:00100000:0.0:1713481296.622501:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470336 00000100:00100000:0.0:1713481296.622529:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82862 00000100:00100000:0.0:1713481296.622533:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+35:15514:x1796714784470336:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.622539:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.622548:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe39680/0xdfc0fb148a38584 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a38576 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.622565:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe39680/0xdfc0fb148a38584 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a38576 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.622573:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe39680/0xdfc0fb148a38584 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38576 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.622578:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:0.0:1713481296.622580:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.622582:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fe39680, rc 0) 00000100:00100000:0.0:1713481296.622608:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784470336:12345-0@lo:101:mdt_io00_009.0 Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.622613:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82862 00000100:00100000:0.0:1713481296.622639:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470336:0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.622647:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fe3b180/0xdfc0fb148a38576 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a38584 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.622654:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007fe3b180/0xdfc0fb148a38576 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a38584 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.622683:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882393536 00000100:00100000:3.0:1713481296.622687:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882393536 00000004:00080000:0.0:1713481296.622688:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:0.0:1713481296.622702:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011f92c480/0xdfc0fb148a3858b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.622706:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011f92c480/0xdfc0fb148a3858b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.622707:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882393728 00000100:00100000:3.0:1713481296.622709:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882393728 00010000:00010000:0.0:1713481296.622710:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011f92c480/0xdfc0fb148a3858b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.622719:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470400:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.622724:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485742 00000100:00100000:3.0:1713481296.622730:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2086:18678:x1796714882393536:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:0.0:1713481296.622733:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.622741:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.622745:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007c1eda80 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.622750:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094316f40/0xdfc0fb148a38592 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ce3 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.622755:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470400 00000100:00100000:0.0:1713481296.622757:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470400 00000100:00100000:0.0:1713481296.622769:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470464 00000100:00100000:0.0:1713481296.622771:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470464 00000100:00100000:0.0:1713481296.622777:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82863 00000100:00100000:0.0:1713481296.622780:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784470400:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.622784:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.622791:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880135968fc0/0xdfc0fb148a38599 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3858b expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.622802:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880135968fc0/0xdfc0fb148a38599 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3858b expref: 38 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.622807:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.622811:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880135968fc0/0xdfc0fb148a38599 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3858b expref: 38 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.622815:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.622816:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x33 (ffff880094275300) 00010000:00010000:0.0:1713481296.622818:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.622820:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135968fc0, rc 0) 00010000:00010000:3.0:1713481296.622822:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.622832:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.622838:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.622843:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.622850:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784470400:12345-0@lo:101:mdt_io00_009.0 Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.622855:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82863 00010000:00010000:3.0:1713481296.622885:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a385ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.622893:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a385ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.622899:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a385ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000004:00200000:3.0:1713481296.622921:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3464:0x0]: returning size 5 00000004:00200000:3.0:1713481296.622924:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.622933:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a385ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.622935:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562080 00000100:00100000:0.0:1713481296.622940:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882393664:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.622940:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a385ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.622946:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.622948:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.622951:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.622956:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135969d40/0xdfc0fb148a385c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafdc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47cf1 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.622956:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.622962:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00002000:00010000:0.0:1713481296.622967:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafdc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.622967:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801305cc000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.622970:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.622975:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.622976:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.622976:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.622980:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135969d40/0xdfc0fb148a385c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cf1 expref: 24480 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.622983:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:3.0:1713481296.622986:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.622988:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.622989:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135969d40/0xdfc0fb148a385c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cf1 expref: 24480 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.622993:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cc000/0xdfc0fb148a385a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.622996:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135969d40, rc 0) 00000100:00100000:0.0:1713481296.623007:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1960:x1796714882393664:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (172us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.623008:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.623012:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562080 00010000:00010000:3.0:1713481296.623018:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.623023:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.623027:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122ad6d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.623029:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.623035:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.623036:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470400:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.623041:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x3631 (ffff88009c664100) 00010000:00010000:0.0:1713481296.623044:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011f92c480/0xdfc0fb148a3858b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a38599 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623044:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.623046:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.623050:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011f92c480/0xdfc0fb148a3858b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a38599 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623051:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad6d00/0xdfc0fb148a385a7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000004:00080000:0.0:1713481296.623062:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:0.0:1713481296.623078:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470528:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.623083:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094316f40/0xdfc0fb148a38592 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ce3 expref: 2088 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.623097:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.623097:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a385ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ce3 expref: 2087 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623103:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3464:0x0].0x0 (ffff88008f80ae00) 00010000:00010000:3.0:1713481296.623105:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.623108:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8533c0, rc 0) 00000100:00100000:0.0:1713481296.623113:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007c1ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.623145:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470528 00000100:00100000:0.0:1713481296.623148:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470528 00000100:00100000:3.0:1713481296.623149:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2087:18678:x1796714882393536:12345-192.168.202.24@tcp:101:rm.0 Request processed in 417us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.623157:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485742 00000100:00100000:0.0:1713481296.623166:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82865 00000100:00100000:0.0:1713481296.623170:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784470528:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.623190:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470592 00000100:00100000:3.0:1713481296.623194:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470592 00000100:00100000:0.0:1713481296.623222:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784470528:12345-0@lo:1000:mdt_io00_009.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.623222:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20392 00000100:00100000:0.0:1713481296.623227:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82865 00000100:00100000:3.0:1713481296.623227:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6932:x1796714784470592:12345-0@lo:104: 00010000:00010000:3.0:1713481296.623237:0:6917:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880092add200/0xdfc0fb148a378b1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdfc0fb148a378b8 expref: -99 pid: 15512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.623257:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470528:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.623288:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470720:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.623290:0:6917:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1713481296.623295:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6932:x1796714784470592:12345-0@lo:104: Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.623302:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20392 00000100:00100000:0.0:1713481296.623324:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470656 00000100:00100000:0.0:1713481296.623326:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470656 00000100:00100000:0.0:1713481296.623336:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.623351:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784467776:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.623357:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.623365:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470720 00000100:00100000:0.0:1713481296.623367:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470720 00010000:00010000:3.0:1713481296.623376:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.623380:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82866 00000100:00100000:0.0:1713481296.623383:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+38:15514:x1796714784470720:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.623402:0:16508:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16508:1796714784468096:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.623418:0:16508:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.623437:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+38:15514:x1796714784470720:12345-0@lo:1000:mdt_io00_009.0 Request processed in 52us (100us total) trans 0 rc 1/1 00000100:00100000:3.0:1713481296.623437:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882395072 00000100:00100000:3.0:1713481296.623440:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882395072 00000100:00100000:0.0:1713481296.623442:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82866 00000100:00100000:3.0:1713481296.623459:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485744 00000100:00100000:3.0:1713481296.623464:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2417:18914:x1796714882395072:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:0.0:1713481296.623467:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470720:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.623472:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.623482:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a385ed lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d29 expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.623510:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470848:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.623535:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:3.0:1713481296.623550:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3487:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.623552:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007c1ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.623561:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470848 00000100:00100000:0.0:1713481296.623564:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470848 00000100:00100000:0.0:1713481296.623582:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82867 00000100:00100000:0.0:1713481296.623586:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+38:15514:x1796714784470848:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.623603:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a385ed lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d29 expref: 2419 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623611:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a385ed lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d29 expref: 2419 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623623:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f851200, rc 0) 00000100:00100000:3.0:1713481296.623640:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2418:18914:x1796714882395072:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 175us (357us total) trans 4295107555 rc 301/301 00000100:00100000:0.0:1713481296.623645:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+38:15514:x1796714784470848:12345-0@lo:1000:mdt_io00_009.0 Request processed in 57us (108us total) trans 0 rc 1/1 00000100:00100000:3.0:1713481296.623646:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485744 00000100:00100000:0.0:1713481296.623651:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82867 00000100:00100000:3.0:1713481296.623700:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800921b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784468288:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.623723:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623897:0:16508:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623906:0:16508:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623913:0:16508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623920:0:16508:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.623928:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077960000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784468416:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.623928:0:16508:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623934:0:16508:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098365680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.623937:0:16508:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.623945:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623945:0:16508:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623961:0:16508:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.623968:0:16508:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098365680/0xdfc0fb148a38449 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.624154:0:16508:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0001-mdtlov_UUID+57:3492:x1796714784467904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8094us (8143us total) trans 4296040715 rc 0/0 00000100:00100000:3.0:1713481296.624161:0:16508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562056 00000100:00100000:3.0:1713481296.624196:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82868 00000100:00100000:3.0:1713481296.624201:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+37:15484:x1796714784470656:12345-0@lo:1000:mdt00_020.0 00010000:00010000:0.0:1713481296.624327:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624333:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624337:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624341:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624363:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624369:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801305cf840 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.624370:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+37:15484:x1796714784470656:12345-0@lo:1000:mdt00_020.0 Request processed in 167us (1060us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.624371:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.624377:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82868 00010000:00010000:0.0:1713481296.624378:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624392:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624398:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801305cf840/0xdfc0fb148a3846c lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.624583:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784470976 00000100:00100000:3.0:1713481296.624587:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784470976 00000100:00100000:3.0:1713481296.624605:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82869 00000100:00100000:3.0:1713481296.624610:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+37:15484:x1796714784470976:12345-0@lo:1000:mdt00_020.0 00000100:00100000:3.0:1713481296.624685:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+37:15484:x1796714784470976:12345-0@lo:1000:mdt00_020.0 Request processed in 73us (126us total) trans 0 rc 1/1 00000100:00100000:3.0:1713481296.624692:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82869 00000100:00100000:0.0:1713481296.624734:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+57:3490:x1796714784468352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7694us (7809us total) trans 4296040719 rc 0/0 00000100:00100000:0.0:1713481296.624741:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562061 00000100:00100000:0.0:1713481296.624797:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784470848:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.624822:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882395200 00000100:00100000:3.0:1713481296.624825:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882395200 00010000:00010000:0.0:1713481296.624829:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013596a640/0xdfc0fb148a38609 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.624843:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485745 00000100:00100000:3.0:1713481296.624848:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18578:x1796714882395200:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.624856:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.624866:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f850480/0xdfc0fb148a38617 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d30 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.624912:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013596a640/0xdfc0fb148a38609 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.624918:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013596a640/0xdfc0fb148a38609 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000004:00200000:3.0:1713481296.624935:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385e:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.624936:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784471232:0@lo:101:mdt_io00_009.0 00000100:00100000:0.0:1713481296.624952:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.624966:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.624976:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784471232 00000100:00100000:0.0:1713481296.624993:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784471232 00010000:00010000:3.0:1713481296.624994:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f850480/0xdfc0fb148a38617 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d30 expref: 2190 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625002:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f850480/0xdfc0fb148a38617 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d30 expref: 2190 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.625006:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82871 00000100:00100000:0.0:1713481296.625009:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+39:15514:x1796714784471232:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.625013:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f850480, rc 0) 00010000:00010000:0.0:1713481296.625014:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.625021:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801243e3a80/0xdfc0fb148a3862c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a38609 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.625030:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801243e3a80/0xdfc0fb148a3862c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a38609 expref: 40 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.625032:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2189:18578:x1796714882395200:12345-192.168.202.24@tcp:101:rm.0 Request processed in 183us (236us total) trans 4295105888 rc 301/301 00010000:00010000:0.0:1713481296.625036:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801243e3a80/0xdfc0fb148a3862c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38609 expref: 40 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.625039:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485745 00010000:00010000:0.0:1713481296.625040:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e9:0x0].0x0 (ffff88009cf57500) 00010000:00010000:0.0:1713481296.625042:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.625043:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801243e3a80, rc 0) 00000100:00100000:0.0:1713481296.625068:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+40:15514:x1796714784471232:12345-0@lo:101:mdt_io00_009.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.625072:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82871 00000100:00100000:0.0:1713481296.625093:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784471232:0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.625100:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013596a640/0xdfc0fb148a38609 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3862c expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.625105:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013596a640/0xdfc0fb148a38609 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3862c expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.625111:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.625117:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801243e1f80/0xdfc0fb148a3863a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.625137:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801243e1f80/0xdfc0fb148a3863a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.625142:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801243e1f80/0xdfc0fb148a3863a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.625154:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.625155:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.625157:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.625161:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.625162:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.625167:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784471488:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.625168:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.625173:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c230fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.625176:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.625180:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.625181:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.625190:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e90c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.625190:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380a:0x0].0x3131 (ffff8801345a4f00) 00010000:00010000:3.0:1713481296.625193:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.625196:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.625200:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784471488 00010000:00010000:3.0:1713481296.625201:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a383d9 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x380a:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.625202:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784471488 00000100:00100000:0.0:1713481296.625212:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82872 00000100:00100000:0.0:1713481296.625215:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+40:15514:x1796714784471488:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.625219:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.625225:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a38641 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625226:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880133cd4480/0xdfc0fb148a384f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.625232:0:8640:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 2/0,1 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.625232:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133cd4480/0xdfc0fb148a384f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.625236:0:8640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 41 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625238:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133cd4480/0xdfc0fb148a384f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.625242:0:8640:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.625243:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133cd4480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.625245:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133cd4480/0xdfc0fb148a384f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.625252:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133cd4480/0xdfc0fb148a384f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x380a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT0 00080000:00080000:0.0:1713481296.625254:0:8640:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:3.0:1713481296.625259:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x380a:0x0].0x3031 (ffff8801344c4300) 00010000:00010000:3.0:1713481296.625261:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.625263:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133cd4480/0xdfc0fb148a384f1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x380a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.625268:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133cd4480/0xdfc0fb148a384f1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x380a:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.625289:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 41 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.625293:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880124cd1c00) 00010000:00010000:0.0:1713481296.625295:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.625296:0:8640:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 41 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.625300:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801216e8240, rc 0) 00000100:00100000:3.0:1713481296.625345:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.625368:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625375:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625383:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625390:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625397:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625401:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086909200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.625404:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625411:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625427:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625433:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086909200/0xdfc0fb148a3843b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.625575:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+60:3490:x1796714784467584:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9708us (9750us total) trans 4296040720 rc 0/0 00000100:00100000:3.0:1713481296.625583:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562054 00010000:00010000:3.0:1713481296.625612:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625620:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625628:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625635:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625642:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625653:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098364480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.625656:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625663:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625693:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.625701:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098364480/0xdfc0fb148a38465 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.625830:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+61:3490:x1796714784468224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9261us (9315us total) trans 4296040721 rc 0/0 00000100:00100000:3.0:1713481296.625838:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562060 00000100:00100000:3.0:1713481296.625975:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.626000:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.626021:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.626042:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.626062:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.626103:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784472064 00000100:00100000:3.0:1713481296.626106:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784472064 00000100:00100000:3.0:1713481296.626149:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562088 00000100:00100000:3.0:1713481296.626153:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+61:3491:x1796714784472064:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.626166:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9888 count 1 00010000:00010000:3.0:1713481296.626180:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.626192:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820079 00010000:00010000:3.0:1713481296.626192:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6bcc0/0xdfc0fb14880210e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962666 expref: 20887 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.626197:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26615:1958:x1796714882394688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.626200:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.626201:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.626205:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.626205:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.626210:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080380d80/0xdfc0fb14868889a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26ef expref: 26615 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.626218:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080380d80/0xdfc0fb14868889a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26ef expref: 26615 pid: 15541 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.626223:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb6bcc0/0xdfc0fb14880210e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962666 expref: 20886 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.626233:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6bcc0/0xdfc0fb14880210e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962666 expref: 20886 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.626237:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080380d80/0xdfc0fb14868889a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26ef expref: 26615 pid: 15541 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.626244:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784472128:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.626248:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.626250:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.626253:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc1e400/0xdfc0fb148a384a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.626262:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096153cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.626265:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc1e400/0xdfc0fb148a384a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.626282:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.626296:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26612:1958:x1796714882394688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 99us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.626302:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820079 00010000:00010000:0.0:1713481296.626401:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206f06c0/0xdfc0fb1486888bd lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d26d3 expref: 26608 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.627182:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c4b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784468736:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.627201:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627207:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627211:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627215:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627218:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627226:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627229:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fe3a1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.627231:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627234:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627241:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627245:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fe3a1c0/0xdfc0fb148a3849d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.627488:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2679:3493:x1796714784468544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9494us (9663us total) trans 4295960617 rc 0/0 00000100:00100000:0.0:1713481296.627494:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562064 00000100:00100000:0.0:1713481296.627579:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008daa6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784469120:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.627598:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.627616:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16461:1959:x1796714882391552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7217us (7266us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.627623:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820062 00000100:00100000:0.0:1713481296.627805:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882394944 00000100:00100000:0.0:1713481296.627808:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882394944 00000100:00100000:0.0:1713481296.627838:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562097 00000100:00100000:0.0:1713481296.627841:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16462:18844:x1796714882394944:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.627846:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.627853:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089bc4d80/0xdfc0fb148a386aa lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d22 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.627899:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.627908:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.627910:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.627913:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089bc4d80/0xdfc0fb148a386aa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d22 expref: 16463 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627920:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880089bc4d80/0xdfc0fb148a386aa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d22 expref: 16463 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.627927:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089bc4d80, rc 0) 00000100:00100000:0.0:1713481296.627944:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16463:18844:x1796714882394944:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 101us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.627949:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562097 00010000:00010000:3.0:1713481296.627951:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009914dd40/0xdfc0fb148a330ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x22c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.627959:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009914dd40/0xdfc0fb148a330ab lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x22c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.627965:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009914dd40/0xdfc0fb148a330ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x22c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.627970:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009914dd40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.627973:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009914dd40/0xdfc0fb148a330ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x22c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.627980:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009914dd40/0xdfc0fb148a330ab lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x22c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.627986:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800923206c0/0xdfc0fb148a34f52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.627990:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22c:0x0].0x39 (ffff880130446700) 00010000:00010000:0.0:1713481296.627993:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800923206c0/0xdfc0fb148a34f52 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.627993:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.627996:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009914dd40/0xdfc0fb148a330ab lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x22c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.627998:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800923206c0/0xdfc0fb148a34f52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628002:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009914dd40/0xdfc0fb148a330ab lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x22c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.628007:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800923206c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.628010:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923206c0/0xdfc0fb148a34f52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628016:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800923206c0/0xdfc0fb148a34f52 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628024:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x35 (ffff88009ab05700) 00010000:00010000:0.0:1713481296.628026:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.628029:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800923206c0/0xdfc0fb148a34f52 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3431:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628034:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800923206c0/0xdfc0fb148a34f52 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3431:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628051:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880089346640/0xdfc0fb148a330ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628057:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880089346640/0xdfc0fb148a330ff lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628059:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628063:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880089346640/0xdfc0fb148a330ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628065:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628067:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880089346640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628069:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880089346640/0xdfc0fb148a330ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628071:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628075:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098fbe400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628075:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880089346640/0xdfc0fb148a330ff lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628077:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628082:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628082:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c9:0x0].0x0 (ffff8800918d1a00) 00010000:00010000:3.0:1713481296.628085:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.628088:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88012ca0c100) 00010000:00010000:3.0:1713481296.628088:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880089346640/0xdfc0fb148a330ff lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628091:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.628093:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628093:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880089346640/0xdfc0fb148a330ff lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628098:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbe400/0xdfc0fb148a36f7a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628112:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628116:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628134:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628137:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098fbd680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.628139:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628142:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628143:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880077002640/0xdfc0fb148a331bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.628147:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88009d156700) 00010000:00010000:0.0:1713481296.628148:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628149:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880077002640/0xdfc0fb148a331bc lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.628150:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628152:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098fbd680/0xdfc0fb148a36f73 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628154:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880077002640/0xdfc0fb148a331bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.628159:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880077002640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628162:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880077002640/0xdfc0fb148a331bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.628164:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628167:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628168:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880077002640/0xdfc0fb148a331bc lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.628171:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.628173:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121d01200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.628175:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628176:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x225:0x0].0x30 (ffff880073418e00) 00010000:00010000:0.0:1713481296.628177:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.628178:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.628181:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880124cd1c00) 00010000:00010000:3.0:1713481296.628181:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880077002640/0xdfc0fb148a331bc lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x225:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.628182:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.628184:0:3476:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 40 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628186:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880077002640/0xdfc0fb148a331bc lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x225:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.628189:0:3476:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 40 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.628193:0:3476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 40 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.628204:0:3476:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 40 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.628210:0:3476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3476:1796714784473344:0@lo:105: 00010000:00010000:3.0:1713481296.628222:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880084279440/0xdfc0fb148a336cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628228:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084279440/0xdfc0fb148a336cb lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628233:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084279440/0xdfc0fb148a336cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00000100:00100000:0.0:1713481296.628234:0:3476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.628237:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084279440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628241:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084279440/0xdfc0fb148a336cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628246:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084279440/0xdfc0fb148a336cb lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x225:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628253:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x225:0x0].0x3931 (ffff8800968d5500) 00000100:00100000:0.0:1713481296.628255:0:3476:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e90c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.628256:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628259:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084279440/0xdfc0fb148a336cb lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x225:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628264:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084279440/0xdfc0fb148a336cb lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x225:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628298:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880134e83600/0xdfc0fb148a3380d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00000100:00100000:0.0:1713481296.628299:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.628304:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134e83600/0xdfc0fb148a3380d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628309:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134e83600/0xdfc0fb148a3380d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628313:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134e83600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628316:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134e83600/0xdfc0fb148a3380d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628322:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134e83600/0xdfc0fb148a3380d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34c9:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.628328:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c9:0x0].0x3231 (ffff88008173ff00) 00010000:00010000:3.0:1713481296.628330:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628333:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134e83600/0xdfc0fb148a3380d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34c9:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00000100:00100000:0.0:1713481296.628335:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784469632:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.628341:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134e83600/0xdfc0fb148a3380d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34c9:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.628359:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.628387:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.628395:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882395392 00000100:00100000:0.0:1713481296.628397:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882395392 00000100:00100000:0.0:1713481296.628407:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562098 00000100:00100000:0.0:1713481296.628410:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16463:17935:x1796714882395392:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.628415:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.628423:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099365680/0xdfc0fb148a386bf lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d45 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628475:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880120678d80/0xdfc0fb148a34c49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00002000:00010000:0.0:1713481296.628477:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.628481:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880120678d80/0xdfc0fb148a34c49 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628484:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.628485:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.628486:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880120678d80/0xdfc0fb148a34c49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628488:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099365680/0xdfc0fb148a386bf lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d45 expref: 16464 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628490:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120678d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628493:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120678d80/0xdfc0fb148a34c49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628495:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099365680/0xdfc0fb148a386bf lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d45 expref: 16464 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628498:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120678d80/0xdfc0fb148a34c49 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628501:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099365680, rc 0) 00010000:00010000:3.0:1713481296.628507:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88009cf00d00) 00010000:00010000:3.0:1713481296.628509:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628512:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880120678d80/0xdfc0fb148a34c49 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.628517:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16464:17935:x1796714882395392:12345-192.168.202.24@tcp:101:dd.0 Request processed in 105us (129us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.628517:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120678d80/0xdfc0fb148a34c49 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.628522:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562098 00010000:00010000:3.0:1713481296.628536:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880120678900/0xdfc0fb148a34c5e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628541:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880120678900/0xdfc0fb148a34c5e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628547:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880120678900/0xdfc0fb148a34c5e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628552:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120678900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628555:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120678900/0xdfc0fb148a34c5e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.628557:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.628560:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120678900/0xdfc0fb148a34c5e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628567:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34cb:0x0].0x0 (ffff88009cf00300) 00010000:00010000:3.0:1713481296.628569:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628571:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880120678900/0xdfc0fb148a34c5e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628577:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120678900/0xdfc0fb148a34c5e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.628581:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.628594:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882395584 00000100:00100000:0.0:1713481296.628596:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882395584 00000100:00100000:0.0:1713481296.628610:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562099 00000100:00100000:0.0:1713481296.628614:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:15045:x1796714882395584:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.628615:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007864d200/0xdfc0fb148a36310 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d9:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628621:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.628621:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007864d200/0xdfc0fb148a36310 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x1d9:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628627:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007864d200/0xdfc0fb148a36310 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d9:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628629:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099364240/0xdfc0fb148a386e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bdb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d4c expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628631:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007864d200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628634:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007864d200/0xdfc0fb148a36310 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d9:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00002000:00010000:0.0:1713481296.628638:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.628640:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007864d200/0xdfc0fb148a36310 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x1d9:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628644:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.628645:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.628647:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d9:0x0].0x3831 (ffff8801216ba400) 00010000:00010000:0.0:1713481296.628648:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099364240/0xdfc0fb148a386e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d4c expref: 24482 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628650:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628652:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007864d200/0xdfc0fb148a36310 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x1d9:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628654:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099364240/0xdfc0fb148a386e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d4c expref: 24482 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628657:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007864d200/0xdfc0fb148a36310 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x1d9:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.628658:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099364240, rc 0) 00000100:00100000:0.0:1713481296.628777:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:15045:x1796714882395584:12345-192.168.202.24@tcp:101:dd.0 Request processed in 161us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.628781:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562099 00000100:00100000:0.0:1713481296.628806:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.628818:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882395648 00000100:00100000:0.0:1713481296.628820:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882395648 00010000:00010000:3.0:1713481296.628822:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880085c5c480/0xdfc0fb148a36a5d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.628829:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880085c5c480/0xdfc0fb148a36a5d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.628833:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562100 00010000:00010000:3.0:1713481296.628834:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880085c5c480/0xdfc0fb148a36a5d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.628838:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20884:18792:x1796714882395648:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.628838:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085c5c480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628841:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880085c5c480/0xdfc0fb148a36a5d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.628844:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.628847:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880085c5c480/0xdfc0fb148a36a5d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.628854:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a35d40/0xdfc0fb148a386e9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc506:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d53 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.628855:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34cc:0x0].0x0 (ffff880079a3f900) 00010000:00010000:3.0:1713481296.628857:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628860:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880085c5c480/0xdfc0fb148a36a5d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00002000:00010000:0.0:1713481296.628865:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc506:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.628865:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085c5c480/0xdfc0fb148a36a5d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.628873:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.628874:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.628878:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35d40/0xdfc0fb148a386e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d53 expref: 20885 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.628887:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a35d40/0xdfc0fb148a386e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc506:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d53 expref: 20885 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.628895:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35d40, rc 0) 00010000:00010000:3.0:1713481296.628895:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801237ccd80/0xdfc0fb148a377d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.628900:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801237ccd80/0xdfc0fb148a377d1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2c42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.628905:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801237ccd80/0xdfc0fb148a377d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.628908:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20885:18792:x1796714882395648:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 70us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.628909:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801237ccd80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628912:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801237ccd80/0xdfc0fb148a377d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.628914:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562100 00010000:00010000:3.0:1713481296.628917:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801237ccd80/0xdfc0fb148a377d1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2c42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.628924:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c42:0x0].0x0 (ffff8801302d5a00) 00010000:00010000:3.0:1713481296.628926:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628928:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801237ccd80/0xdfc0fb148a377d1 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2c42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.628933:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801237ccd80/0xdfc0fb148a377d1 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2c42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.628961:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350ba1c0/0xdfc0fb148a37c38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628967:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801350ba1c0/0xdfc0fb148a37c38 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628971:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801350ba1c0/0xdfc0fb148a37c38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628976:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350ba1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.628978:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801350ba1c0/0xdfc0fb148a37c38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628983:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801350ba1c0/0xdfc0fb148a37c38 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.628992:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3487:0x0].0x33 (ffff880132ba2a00) 00010000:00010000:3.0:1713481296.628994:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.628996:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801350ba1c0/0xdfc0fb148a37c38 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3487:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.629001:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350ba1c0/0xdfc0fb148a37c38 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3487:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.629069:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.629101:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784472960 00000100:00100000:0.0:1713481296.629104:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784472960 00000100:00100000:0.0:1713481296.629140:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784473216 00000100:00100000:0.0:1713481296.629142:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784473216 00000100:00100000:0.0:1713481296.629154:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784473152 00010000:00010000:3.0:1713481296.629154:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880078278d80/0xdfc0fb148a37de3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.629156:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784473152 00010000:00010000:3.0:1713481296.629161:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880078278d80/0xdfc0fb148a37de3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.629167:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880078278d80/0xdfc0fb148a37de3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.629169:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98333 00010000:00010000:3.0:1713481296.629171:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078278d80 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.629173:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ddc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+13:3493:x1796714784472960:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1713481296.629174:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078278d80/0xdfc0fb148a37de3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.629179:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078278d80/0xdfc0fb148a37de3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.629180:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.629188:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d2:0x0].0x0 (ffff88009a57c000) 00010000:00010000:0.0:1713481296.629189:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd1f80/0xdfc0fb148a37d96 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x230:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a37d8f expref: 13 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629190:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.629193:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880078278d80/0xdfc0fb148a37de3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.629198:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078278d80/0xdfc0fb148a37de3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.629211:0:16553:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x36 (ffff880098714b00) 00010000:00010000:3.0:1713481296.629217:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.629219:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.629223:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.629229:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.629234:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bef840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629237:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.629242:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.629245:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ddc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+10:3493:x1796714784472960:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 71us (200us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.629250:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x32 (ffff880090b3be00) 00000100:00100000:0.0:1713481296.629251:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98333 00010000:00010000:3.0:1713481296.629252:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.629254:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.629260:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099bef840/0xdfc0fb148a37fdb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x347f:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.629286:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.629292:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.629294:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133a73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784470208:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.629297:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.629302:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009aac73c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629304:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.629310:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.629310:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.629318:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d3:0x0].0x0 (ffff8800848b7100) 00000100:00100000:0.0:1713481296.629319:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16463:1960:x1796714882393088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7116us (7206us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.629320:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.629322:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.629323:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820067 00010000:00010000:3.0:1713481296.629327:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aac73c0/0xdfc0fb148a3817f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.629344:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880086f28480/0xdfc0fb148a331df lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629349:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880086f28480/0xdfc0fb148a331df lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629354:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880086f28480/0xdfc0fb148a331df lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629358:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086f28480 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.629360:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882396032 00010000:00010000:3.0:1713481296.629361:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086f28480/0xdfc0fb148a331df lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6946 initiator: MDT1 00000100:00100000:0.0:1713481296.629362:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882396032 00010000:00010000:3.0:1713481296.629366:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086f28480/0xdfc0fb148a331df lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6946 initiator: MDT1 00010000:00010000:0.0:1713481296.629369:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080383a80/0xdfc0fb1486888c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2727 expref: 26609 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.629373:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88009d156700) 00010000:00010000:3.0:1713481296.629375:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.629378:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880086f28480/0xdfc0fb148a331df lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629383:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086f28480/0xdfc0fb148a331df lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6946 initiator: MDT1 00000100:00100000:0.0:1713481296.629386:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820082 00000100:00100000:0.0:1713481296.629389:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26609:1957:x1796714882396032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.629393:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.629395:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080383a80/0xdfc0fb1486888c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2727 expref: 26609 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.629401:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080383a80/0xdfc0fb1486888c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2727 expref: 26609 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.629413:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080383a80/0xdfc0fb1486888c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2727 expref: 26609 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.629414:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a125200/0xdfc0fb148a331e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6946 initiator: MDT1 00010000:00010000:0.0:1713481296.629420:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.629420:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007a125200/0xdfc0fb148a331e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6946 initiator: MDT1 00010000:00010000:0.0:1713481296.629421:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.629423:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629425:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007a125200/0xdfc0fb148a331e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6946 initiator: MDT1 00010000:00010000:0.0:1713481296.629427:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629430:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a125200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629433:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a125200/0xdfc0fb148a331e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6946 initiator: MDT1 00010000:00010000:0.0:1713481296.629437:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.629438:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a125200/0xdfc0fb148a331e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629445:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3431 (ffff88009d156000) 00010000:00010000:3.0:1713481296.629447:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.629448:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26608:1957:x1796714882396032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (95us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.629449:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007a125200/0xdfc0fb148a331e6 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6946 initiator: MDT1 00000100:00100000:0.0:1713481296.629453:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820082 00010000:00010000:3.0:1713481296.629455:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a125200/0xdfc0fb148a331e6 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629466:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009790c900/0xdfc0fb148a331ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629472:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009790c900/0xdfc0fb148a331ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629477:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009790c900/0xdfc0fb148a331ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629482:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009790c900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629485:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009790c900/0xdfc0fb148a331ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629490:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009790c900/0xdfc0fb148a331ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629497:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3487:0x0].0x0 (ffff88009d156300) 00010000:00010000:3.0:1713481296.629499:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1713481296.629502:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009790c900/0xdfc0fb148a331ed lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6946 initiator: MDT1 00010000:00010000:3.0:1713481296.629507:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009790c900/0xdfc0fb148a331ed lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6946 initiator: MDT1 00010000:00010000:0.0:1713481296.629508:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.629516:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.629522:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.629528:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629528:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099093180/0xdfc0fb148a350f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629533:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629533:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099093180/0xdfc0fb148a350f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629538:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099093180/0xdfc0fb148a350f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629543:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084200fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.629543:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099093180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629546:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099093180/0xdfc0fb148a350f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629547:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629551:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099093180/0xdfc0fb148a350f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629553:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629558:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3431 (ffff88009d156000) 00010000:00010000:3.0:1713481296.629560:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.629562:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099093180/0xdfc0fb148a350f6 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629568:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629570:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099093180/0xdfc0fb148a350f6 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629572:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084200fc0/0xdfc0fb148a384ff lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629593:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0db180/0xdfc0fb148a350ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629598:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0db180/0xdfc0fb148a350ef lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629602:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0db180/0xdfc0fb148a350ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629607:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b0db180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629609:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0db180/0xdfc0fb148a350ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629614:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0db180/0xdfc0fb148a350ef lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629621:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88009cf00d00) 00010000:00010000:3.0:1713481296.629623:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.629625:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0db180/0xdfc0fb148a350ef lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629630:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b0db180/0xdfc0fb148a350ef lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629654:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800990918c0/0xdfc0fb148a3510b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629659:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800990918c0/0xdfc0fb148a3510b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629681:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800990918c0/0xdfc0fb148a3510b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629687:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800990918c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629689:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800990918c0/0xdfc0fb148a3510b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.629690:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007687aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2680:3490:x1796714784469568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8446us (8505us total) trans 4295960618 rc 0/0 00000100:00100000:0.0:1713481296.629694:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562070 00010000:00010000:3.0:1713481296.629695:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800990918c0/0xdfc0fb148a3510b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629702:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3487:0x0].0x0 (ffff88009d156300) 00010000:00010000:3.0:1713481296.629704:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1713481296.629706:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800990918c0/0xdfc0fb148a3510b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629711:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800990918c0/0xdfc0fb148a3510b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.629715:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820086 00000100:00100000:0.0:1713481296.629717:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1959:x1796714882396160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.629723:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.629726:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120fd8000/0xdfc0fb148a16242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397f7 expref: 24483 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.629731:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120fd8000/0xdfc0fb148a16242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397f7 expref: 24483 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.629743:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629744:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120fd8000/0xdfc0fb148a16242 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397f7 expref: 24483 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.629749:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629754:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629755:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.629756:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.629758:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0d2f40/0xdfc0fb148a3855a lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xb35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cce expref: 24481 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629758:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083220b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629761:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629763:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0d2f40/0xdfc0fb148a3855a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cce expref: 24481 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629766:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629773:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff880091f06d00) 00010000:00010000:3.0:1713481296.629775:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.629778:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629779:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0d2f40/0xdfc0fb148a3855a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cce expref: 24481 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629783:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083220b40/0xdfc0fb148a3744a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.629788:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784473600:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.629803:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007c1ed840 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.629806:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629812:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629817:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629821:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d3f7840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.629822:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629823:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629829:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629829:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629835:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629836:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88012ca0c100) 00010000:00010000:3.0:1713481296.629838:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.629841:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629841:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629846:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d3f7840/0xdfc0fb148a3743c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629848:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.629854:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fe38000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.629857:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.629863:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629869:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629875:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629875:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629880:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.629881:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fe38000/0xdfc0fb148a384f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.629885:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090462400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629887:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629893:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629900:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff880091f06b00) 00010000:00010000:3.0:1713481296.629902:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1713481296.629904:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629909:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090462400/0xdfc0fb148a37458 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2c6f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629941:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880086b118c0/0xdfc0fb148a379f3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629947:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880086b118c0/0xdfc0fb148a379f3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629952:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880086b118c0/0xdfc0fb148a379f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629956:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086b118c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.629959:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086b118c0/0xdfc0fb148a379f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629965:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086b118c0/0xdfc0fb148a379f3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3431:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629974:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88011f854e00) 00010000:00010000:3.0:1713481296.629976:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1713481296.629979:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880086b118c0/0xdfc0fb148a379f3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3431:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:3.0:1713481296.629984:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086b118c0/0xdfc0fb148a379f3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3431:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.629986:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2681:3493:x1796714784469504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8754us (8814us total) trans 4295960620 rc 0/0 00000100:00100000:0.0:1713481296.629991:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562069 00000100:00100000:3.0:1713481296.630015:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784473344 00000100:00100000:3.0:1713481296.630019:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784473344 00000004:00080000:0.0:1713481296.630032:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800918c7800/2, rc 0, transno 993324 00000100:00100000:0.0:1713481296.630037:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800918c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784469504:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.630040:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20393 00000004:00080000:0.0:1713481296.630043:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008daa5880/2, rc 0, transno 993323 00000100:00100000:0.0:1713481296.630045:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008daa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784469312:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.630045:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3476:x1796714784473344:12345-0@lo:105: 00010000:00010000:3.0:1713481296.630054:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a38648 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.630062:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a38648 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.630070:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a38648 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.630075:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a38648 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.630078:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882396288 00010000:00010000:3.0:1713481296.630079:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a38648 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.630081:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882396288 00010000:00010000:3.0:1713481296.630083:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880099ff86c0/0xdfc0fb148a38641 lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a38648 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.630092:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe03180/0xdfc0fb1486888e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2735 expref: 26605 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.630101:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880099ff86c0) 00000100:00100000:0.0:1713481296.630108:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820090 00000100:00100000:0.0:1713481296.630112:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26605:1959:x1796714882396288:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.630138:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.630143:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe03180/0xdfc0fb1486888e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2735 expref: 26605 pid: 15509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.630148:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3476:x1796714784473344:12345-0@lo:105: Request processed in 102us (1914us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.630151:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe03180/0xdfc0fb1486888e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2735 expref: 26605 pid: 15509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.630153:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20393 00010000:00010000:0.0:1713481296.630170:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe03180/0xdfc0fb1486888e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2735 expref: 26605 pid: 15509 timeout: 815 lvb_type: 1 00000020:00080000:3.0:1713481296.630178:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 9044 committed batchid 9035 00010000:00010000:0.0:1713481296.630182:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.630184:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.630187:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d87c240/0xdfc0fb148a38568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.630193:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d87c240/0xdfc0fb148a38568 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.630208:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.630221:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26604:1959:x1796714882396288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 108us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.630228:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820090 00000004:00080000:3.0:1713481296.630237:0:8085:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880096153a80 with version 16899 00000020:00080000:3.0:1713481296.630243:0:8085:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 9034 cancel update log [0x200000401:0xa5:0x0].844: rc = 0 00000100:00100000:0.0:1713481296.630262:0:3476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3476:1796714784473344:0@lo:105: 00000020:00080000:3.0:1713481296.630265:0:8085:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 9034 cancel update log [0x240000400:0x9a:0x0].1970: rc = 0 00010000:00010000:0.0:1713481296.630280:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.630286:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121d01200/0xdfc0fb148a36f8f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15512 initiator: MDT1 00000004:00080000:3.0:1713481296.630296:0:8085:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008323e0c0 with version 16900 00000020:00080000:3.0:1713481296.630297:0:8085:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 9035 cancel update log [0x200000401:0xa5:0x0].845: rc = 0 00010000:00010000:0.0:1713481296.630303:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fee61c0/0xdfc0fb148a330ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1cd:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000020:00080000:3.0:1713481296.630306:0:8085:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 9035 cancel update log [0x240000400:0x9a:0x0].1971: rc = 0 00010000:00010000:0.0:1713481296.630308:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007fee61c0/0xdfc0fb148a330ce lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x1cd:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630314:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007fee61c0/0xdfc0fb148a330ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1cd:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630318:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fee61c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630320:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fee61c0/0xdfc0fb148a330ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1cd:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000020:00080000:3.0:1713481296.630320:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9035 00010000:00010000:0.0:1713481296.630325:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fee61c0/0xdfc0fb148a330ce lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x1cd:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630333:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x33 (ffff88011d3c4000) 00010000:00010000:0.0:1713481296.630335:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630338:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007fee61c0/0xdfc0fb148a330ce lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x1cd:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630401:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fee61c0/0xdfc0fb148a330ce lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x1cd:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630433:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012caa9200/0xdfc0fb148a33432 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630442:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012caa9200/0xdfc0fb148a33432 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630447:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012caa9200/0xdfc0fb148a33432 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630452:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012caa9200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630454:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012caa9200/0xdfc0fb148a33432 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630459:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012caa9200/0xdfc0fb148a33432 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630467:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6d:0x0].0x0 (ffff880120977900) 00010000:00010000:0.0:1713481296.630469:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1713481296.630471:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012caa9200/0xdfc0fb148a33432 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2c6d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630476:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012caa9200/0xdfc0fb148a33432 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2c6d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630491:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800881bd680/0xdfc0fb148a334be lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630495:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800881bd680/0xdfc0fb148a334be lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630499:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800881bd680/0xdfc0fb148a334be lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630503:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800881bd680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630506:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800881bd680/0xdfc0fb148a334be lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630511:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800881bd680/0xdfc0fb148a334be lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630517:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x35 (ffff880120538300) 00010000:00010000:0.0:1713481296.630519:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630520:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800881bd680/0xdfc0fb148a334be lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630523:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800881bd680/0xdfc0fb148a334be lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630548:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007803c480/0xdfc0fb148a33c66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630551:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007803c480/0xdfc0fb148a33c66 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630554:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007803c480/0xdfc0fb148a33c66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630557:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007803c480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630558:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007803c480/0xdfc0fb148a33c66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630561:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007803c480/0xdfc0fb148a33c66 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2c6d:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630565:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6d:0x0].0x3531 (ffff880092c9d200) 00010000:00010000:0.0:1713481296.630567:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630569:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007803c480/0xdfc0fb148a33c66 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2c6d:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630573:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007803c480/0xdfc0fb148a33c66 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2c6d:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713481296.630700:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206f9200/0xdfc0fb148a33c97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d3:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.630706:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801206f9200/0xdfc0fb148a33c97 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x1d3:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.630710:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801206f9200/0xdfc0fb148a33c97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d3:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.630714:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206f9200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630717:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801206f9200/0xdfc0fb148a33c97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d3:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.630721:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801206f9200/0xdfc0fb148a33c97 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x1d3:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.630727:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x38 (ffff880135399b00) 00010000:00010000:0.0:1713481296.630729:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630731:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801206f9200/0xdfc0fb148a33c97 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x1d3:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.630735:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801206f9200/0xdfc0fb148a33c97 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x1d3:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.630765:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880084209b00/0xdfc0fb148a34653 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630768:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084209b00/0xdfc0fb148a34653 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2cac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630771:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084209b00/0xdfc0fb148a34653 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630773:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084209b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630775:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084209b00/0xdfc0fb148a34653 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630778:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084209b00/0xdfc0fb148a34653 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2cac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630783:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cac:0x0].0x0 (ffff88007ab9c300) 00010000:00010000:0.0:1713481296.630784:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630786:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084209b00/0xdfc0fb148a34653 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2cac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630788:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084209b00/0xdfc0fb148a34653 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2cac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.630805:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009163a880/0xdfc0fb148a3465a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34ae:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15591 initiator: MDT1 00010000:00010000:0.0:1713481296.630808:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009163a880/0xdfc0fb148a3465a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34ae:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15591 initiator: MDT1 00010000:00010000:0.0:1713481296.630810:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009163a880/0xdfc0fb148a3465a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34ae:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15591 initiator: MDT1 00010000:00010000:0.0:1713481296.630813:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009163a880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630814:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009163a880/0xdfc0fb148a3465a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34ae:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15591 initiator: MDT1 00010000:00010000:0.0:1713481296.630817:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009163a880/0xdfc0fb148a3465a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34ae:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15591 initiator: MDT1 00010000:00010000:0.0:1713481296.630821:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34ae:0x0].0x0 (ffff88008230ca00) 00010000:00010000:0.0:1713481296.630822:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630823:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009163a880/0xdfc0fb148a3465a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34ae:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15591 initiator: MDT1 00010000:00010000:0.0:1713481296.630828:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009163a880/0xdfc0fb148a3465a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34ae:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15591 initiator: MDT1 00010000:00010000:0.0:1713481296.630844:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880132f59440/0xdfc0fb148a34978 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630848:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132f59440/0xdfc0fb148a34978 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630852:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132f59440/0xdfc0fb148a34978 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630856:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132f59440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630858:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132f59440/0xdfc0fb148a34978 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630863:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132f59440/0xdfc0fb148a34978 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630870:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff8800941fc300) 00010000:00010000:0.0:1713481296.630872:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630874:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132f59440/0xdfc0fb148a34978 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630878:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132f59440/0xdfc0fb148a34978 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630905:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880132f58900/0xdfc0fb148a349a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630911:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132f58900/0xdfc0fb148a349a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000020:00080000:3.0:1713481296.630914:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 9045 committed batchid 9035 00010000:00010000:0.0:1713481296.630916:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132f58900/0xdfc0fb148a349a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630920:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132f58900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630923:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132f58900/0xdfc0fb148a349a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630928:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132f58900/0xdfc0fb148a349a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00000020:00080000:3.0:1713481296.630930:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9035 00010000:00010000:0.0:1713481296.630934:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009285f800) 00010000:00010000:0.0:1713481296.630936:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.630938:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132f58900/0xdfc0fb148a349a9 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.630943:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132f58900/0xdfc0fb148a349a9 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000020:00080000:3.0:1713481296.630977:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 9046 committed batchid 9035 00010000:00010000:0.0:1713481296.630978:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880092321d40/0xdfc0fb148a34f67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.630984:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092321d40/0xdfc0fb148a34f67 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.630989:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092321d40/0xdfc0fb148a34f67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000020:00080000:3.0:1713481296.630991:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9035 00010000:00010000:0.0:1713481296.630993:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092321d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.630995:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092321d40/0xdfc0fb148a34f67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631001:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092321d40/0xdfc0fb148a34f67 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631007:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x37 (ffff8801225f6e00) 00010000:00010000:0.0:1713481296.631010:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631012:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092321d40/0xdfc0fb148a34f67 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631017:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092321d40/0xdfc0fb148a34f67 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000020:00080000:3.0:1713481296.631034:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 9047 committed batchid 9035 00010000:00010000:0.0:1713481296.631039:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880092320d80/0xdfc0fb148a34f75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631044:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092320d80/0xdfc0fb148a34f75 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000020:00080000:3.0:1713481296.631044:0:8085:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9035 00010000:00010000:0.0:1713481296.631048:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092320d80/0xdfc0fb148a34f75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631052:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092320d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631054:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092320d80/0xdfc0fb148a34f75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631059:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092320d80/0xdfc0fb148a34f75 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631065:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x0 (ffff8801322ecf00) 00010000:00010000:0.0:1713481296.631067:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631069:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092320d80/0xdfc0fb148a34f75 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631074:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092320d80/0xdfc0fb148a34f75 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631090:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009994ba80/0xdfc0fb148a3553a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631096:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009994ba80/0xdfc0fb148a3553a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631100:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009994ba80/0xdfc0fb148a3553a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631105:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009994ba80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631107:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009994ba80/0xdfc0fb148a3553a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631112:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009994ba80/0xdfc0fb148a3553a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631136:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x38 (ffff880079b05400) 00010000:00010000:0.0:1713481296.631139:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631143:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009994ba80/0xdfc0fb148a3553a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631147:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009994ba80/0xdfc0fb148a3553a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631183:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d268900/0xdfc0fb148a36acd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631188:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d268900/0xdfc0fb148a36acd lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631193:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d268900/0xdfc0fb148a36acd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631197:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d268900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631199:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d268900/0xdfc0fb148a36acd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631203:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d268900/0xdfc0fb148a36acd lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631211:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x39 (ffff8801304e5e00) 00010000:00010000:0.0:1713481296.631213:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631215:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d268900/0xdfc0fb148a36acd lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631220:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d268900/0xdfc0fb148a36acd lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631241:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631246:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631251:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631255:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ab49200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631257:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631262:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631269:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb3:0x0].0x0 (ffff88007c218b00) 00010000:00010000:0.0:1713481296.631270:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631273:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631277:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007ab49200/0xdfc0fb148a372fa lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2cb3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631297:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631303:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631307:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631312:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800991aa400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631314:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631319:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631325:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22e:0x0].0x0 (ffff88007c218500) 00010000:00010000:0.0:1713481296.631327:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631329:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631334:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800991aa400/0xdfc0fb148a37301 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.631352:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631356:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631361:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631364:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986b4240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631366:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631374:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631379:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x3831 (ffff88012bb55800) 00010000:00010000:0.0:1713481296.631381:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631383:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631387:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800986b4240/0xdfc0fb148a37833 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x1d5:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631413:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631417:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631421:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631425:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078c27840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631427:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631431:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631436:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c83:0x0].0x0 (ffff880092aae500) 00010000:00010000:0.0:1713481296.631438:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631440:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631444:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078c27840/0xdfc0fb148a37864 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2c83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.631446:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784474496 00000100:00100000:3.0:1713481296.631450:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784474496 00010000:00010000:0.0:1713481296.631463:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800961e46c0/0xdfc0fb148a37a9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c5b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631468:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800961e46c0/0xdfc0fb148a37a9b lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2c5b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00000100:00100000:3.0:1713481296.631469:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20394 00010000:00010000:0.0:1713481296.631472:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800961e46c0/0xdfc0fb148a37a9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c5b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00000100:00100000:3.0:1713481296.631474:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007812fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16520:x1796714784474496:12345-0@lo:105: 00010000:00010000:0.0:1713481296.631476:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800961e46c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631478:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800961e46c0/0xdfc0fb148a37a9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2c5b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631483:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800961e46c0/0xdfc0fb148a37a9b lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2c5b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.631483:0:6917:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880086f15b00/0xdfc0fb148a38610 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3833:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a38625 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.631489:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c5b:0x0].0x36 (ffff88007aa73700) 00010000:00010000:0.0:1713481296.631492:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631494:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800961e46c0/0xdfc0fb148a37a9b lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2c5b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.631496:0:6917:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880086f15b00/0xdfc0fb148a38610 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3833:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a38625 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.631499:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800961e46c0/0xdfc0fb148a37a9b lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2c5b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.631503:0:6917:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880086f15b00/0xdfc0fb148a38610 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x3833:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a38625 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.631509:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880086f15b00/0xdfc0fb148a38610 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3833:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a38625 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.631515:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880086f15b00/0xdfc0fb148a38610 lrc: 5/0,1 mode: EX/EX res: [0x200000404:0x3833:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a38625 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.631522:0:6917:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880086f15b00/0xdfc0fb148a38610 lrc: 5/0,1 mode: EX/EX res: [0x200000404:0x3833:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a38625 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.631523:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013224c240/0xdfc0fb148a37ada lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631528:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013224c240/0xdfc0fb148a37ada lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631532:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013224c240/0xdfc0fb148a37ada lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.631534:0:6917:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880086f15b00) 00010000:00010000:0.0:1713481296.631535:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013224c240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631538:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013224c240/0xdfc0fb148a37ada lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631542:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013224c240/0xdfc0fb148a37ada lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631548:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x39 (ffff8801304e5e00) 00010000:00010000:0.0:1713481296.631549:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631551:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013224c240/0xdfc0fb148a37ada lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631555:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013224c240/0xdfc0fb148a37ada lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x3474:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00000100:00100000:3.0:1713481296.631571:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007812fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16520:x1796714784474496:12345-0@lo:105: Request processed in 96us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.631578:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20394 00000100:00100000:3.0:1713481296.631620:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007812df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001_UUID:16520:1796714784474496:0@lo:105: 00010000:00010000:0.0:1713481296.631640:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631646:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.631649:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.631650:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631654:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800980cf3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631656:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631660:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631679:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x39 (ffff88009c06c300) 00000100:00100000:3.0:1713481296.631680:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:1959:x1796714882396672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 338us (805us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.631681:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631683:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.631689:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820092 00010000:00010000:0.0:1713481296.631691:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800980cf3c0/0xdfc0fb148a379d7 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2caf:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631789:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631795:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631800:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631805:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ff298c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631807:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631812:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.631817:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+64:3493:x1796714784470912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7176us (7216us total) trans 4296040723 rc 0/0 00010000:00010000:0.0:1713481296.631820:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb6:0x0].0x0 (ffff880073419300) 00010000:00010000:0.0:1713481296.631822:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631824:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.631825:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562082 00010000:00010000:0.0:1713481296.631829:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007ff298c0/0xdfc0fb148a37c2a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2cb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.631852:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.631857:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.631862:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.631866:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c598b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631869:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00000100:00100000:3.0:1713481296.631869:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485750 00010000:00010000:0.0:1713481296.631873:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00000100:00100000:3.0:1713481296.631875:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007812f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2010:18678:x1796714882396864:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:0.0:1713481296.631879:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb5:0x0].0x0 (ffff88009a8d0500) 00010000:00010000:0.0:1713481296.631881:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631883:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.631886:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c598b40/0xdfc0fb148a37d57 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2cb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.631897:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713481296.631909:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8533c0/0xdfc0fb148a385ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ce3 expref: 2009 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.631912:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88007db9a400/0xdfc0fb148a38013 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631917:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007db9a400/0xdfc0fb148a38013 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631922:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007db9a400/0xdfc0fb148a38013 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631926:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007db9a400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.631926:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3464:0x0].0x0 (ffff88008f80ae00) 00010000:00010000:0.0:1713481296.631928:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007db9a400/0xdfc0fb148a38013 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631933:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007db9a400/0xdfc0fb148a38013 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.631936:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d2f40/0xdfc0fb148a37ea0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47aac expref: 2008 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.631940:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x3631 (ffff88009b330100) 00010000:00010000:0.0:1713481296.631943:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.631945:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007db9a400/0xdfc0fb148a38013 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x1d5:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.631950:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007db9a400/0xdfc0fb148a38013 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x1d5:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.631954:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:3.0:1713481296.631957:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.631968:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.631976:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.631977:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.631982:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.631984:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.631987:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.631991:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834d0fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.631994:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.631994:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880094316f40/0xdfc0fb148a3874b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3463:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.631999:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.632000:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094316f40/0xdfc0fb148a3874b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.632006:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x37 (ffff88009c687e00) 00010000:00010000:3.0:1713481296.632006:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094316f40/0xdfc0fb148a3874b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.632008:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.632011:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.632016:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d0fc0/0xdfc0fb148a3802f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.632044:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.632053:0:15479:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880085efa880/0xdfc0fb1489f7413 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2e5 expref: 2369 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632060:0:15479:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.632076:0:15479:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880085efa880/0xdfc0fb1489f7413 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2e5 expref: 2369 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632085:0:15479:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880085efa880/0xdfc0fb1489f7413 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2e5 expref: 2369 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.632094:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796714784474624:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.632144:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800921f8f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.632149:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632155:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632161:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632164:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834d1200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.632167:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632171:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632178:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00010000:00010000:0.0:1713481296.632179:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1713481296.632181:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632185:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800834d1200/0xdfc0fb148a37ff0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632202:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632206:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632210:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632214:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f814000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.632216:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632220:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632225:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d5:0x0].0x37 (ffff88009ca4bb00) 00010000:00010000:0.0:1713481296.632227:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.632229:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.632233:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f814000/0xdfc0fb148a38274 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x1d5:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00000100:00100000:3.0:1713481296.632248:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800796dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+63:3490:x1796714784471040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7521us (7558us total) trans 4296040724 rc 0/0 00000100:00100000:3.0:1713481296.632255:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562083 00000100:00100000:0.0:1713481296.632266:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008daa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784473920:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.632289:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.632310:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784473920 00000100:00100000:3.0:1713481296.632314:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784473920 00000100:00100000:3.0:1713481296.632333:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562104 00000100:00100000:3.0:1713481296.632337:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2681:3493:x1796714784473920:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.632350:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43238 count 1 00010000:00010000:3.0:1713481296.632364:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632376:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe006c0/0xdfc0fb14868892d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2797 expref: 26603 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.632388:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.632390:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.632392:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.632394:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784474304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.632410:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe006c0/0xdfc0fb14868892d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2797 expref: 26603 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.632414:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.632420:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe006c0/0xdfc0fb14868892d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2797 expref: 26603 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.632431:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784474688:192.168.202.24@tcp:104: 00000004:00080000:0.0:1713481296.632443:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ec56680/2, rc 0, transno 1073427 00000100:00100000:0.0:1713481296.632450:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784470912:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.632452:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800921f8540 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.632456:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1713481296.632461:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784473856:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.632475:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.632495:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008318e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784474240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.632500:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784473856 00000100:00100000:3.0:1713481296.632503:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784473856 00000100:00100000:0.0:1713481296.632509:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.632522:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562105 00000100:00100000:3.0:1713481296.632527:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2682:3493:x1796714784473856:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.632537:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43237 count 1 00000100:00100000:0.0:1713481296.632545:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784474176 00000100:00100000:0.0:1713481296.632547:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784474176 00010000:00010000:3.0:1713481296.632548:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632559:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880078282640/0xdfc0fb148688926 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2789 expref: 26603 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.632565:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.632567:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.632570:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632585:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880078282640/0xdfc0fb148688926 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2789 expref: 26603 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.632593:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880078282640/0xdfc0fb148688926 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2789 expref: 26603 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.632602:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784474816:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.632622:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c5d600 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.632623:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784474112 00000100:00100000:0.0:1713481296.632627:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784474112 00000100:00100000:0.0:1713481296.632640:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784474304 00000100:00100000:0.0:1713481296.632641:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784474304 00000100:00100000:3.0:1713481296.632643:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784474240 00000100:00100000:3.0:1713481296.632647:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784474240 00000100:00100000:0.0:1713481296.632654:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98336 00000100:00100000:0.0:1713481296.632659:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008493b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+40:3491:x1796714784474176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.632680:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.632687:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98337 00010000:00010000:0.0:1713481296.632691:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801243e3a80/0xdfc0fb148a3862c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a38609 expref: 40 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.632693:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+40:3491:x1796714784474112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.632703:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.632704:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e9:0x0].0x0 (ffff88009cf57500) 00010000:00010000:0.0:1713481296.632714:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.632715:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801216e8240/0xdfc0fb148a38648 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a38641 expref: 39 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632737:0:16520:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880124cd1c00) 00000100:00100000:0.0:1713481296.632740:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008493b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+37:3491:x1796714784474176:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.632745:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98336 00010000:00010000:3.0:1713481296.632756:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.632762:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98339 00000100:00100000:0.0:1713481296.632766:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+36:3493:x1796714784474240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.632771:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.632780:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe39680/0xdfc0fb148a38584 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a38576 expref: 35 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.632787:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+34:3491:x1796714784474112:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (382us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.632792:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:0.0:1713481296.632794:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.632794:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98337 00000100:00100000:0.0:1713481296.632821:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+33:3493:x1796714784474240:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.632826:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98339 00000100:00100000:3.0:1713481296.632887:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784474752 00000100:00100000:3.0:1713481296.632891:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784474752 00000100:00100000:3.0:1713481296.632917:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562106 00000100:00100000:3.0:1713481296.632922:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007812c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16465:17009:x1796714882397120:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.632923:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562107 00000100:00100000:0.0:1713481296.632928:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007812df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2683:3491:x1796714784474752:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.632931:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:0.0:1713481296.632938:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43239 count 1 00010000:00010000:3.0:1713481296.632941:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013228eac0/0xdfc0fb148a3876e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d6f expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.632948:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.632954:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.632958:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084040d80/0xdfc0fb148688934 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27a5 expref: 26603 pid: 16477 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.632963:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.632965:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.632965:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.632966:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.632969:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632970:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013228eac0/0xdfc0fb148a3876e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d6f expref: 16466 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.632978:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013228eac0/0xdfc0fb148a3876e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d6f expref: 16466 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.632981:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084040d80/0xdfc0fb148688934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27a5 expref: 26603 pid: 16477 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.632985:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013228eac0, rc 0) 00010000:00010000:0.0:1713481296.632989:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084040d80/0xdfc0fb148688934 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27a5 expref: 26603 pid: 16477 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.632997:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784475072:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.633002:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007812c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16466:17009:x1796714882397120:12345-192.168.202.24@tcp:101:dd.0 Request processed in 79us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.633008:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562106 00000100:00100000:0.0:1713481296.633020:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a2ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.633058:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.633064:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784475200:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.633083:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.633105:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784475200 00000100:00100000:0.0:1713481296.633107:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784475200 00000100:00100000:0.0:1713481296.633295:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.633313:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.633327:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882397696 00000100:00100000:0.0:1713481296.633329:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882397696 00000100:00100000:0.0:1713481296.633347:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562111 00000100:00100000:0.0:1713481296.633352:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26604:11388:x1796714882397696:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.633358:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.633368:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a34000/0xdfc0fb148a38791 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d7d expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633384:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097d1d440/0xdfc0fb148941a2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00b6 expref: 24480 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.633390:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.633391:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.633394:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34000/0xdfc0fb148a38791 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d7d expref: 26606 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633410:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097d1d440/0xdfc0fb148941a2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00b6 expref: 24480 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.633418:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097d1d440/0xdfc0fb148941a2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00b6 expref: 24480 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.633428:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077935500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784475328:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.633449:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a2eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.633450:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784472128:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.633475:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.633501:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784471680:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.633519:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1713481296.633533:0:6961:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8662 committed batchid 8660 00000020:00080000:0.0:1713481296.633554:0:6961:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8660 00010000:00010000:0.0:1713481296.633562:0:15498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633574:0:15498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633581:0:15498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633587:0:15498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633593:0:15498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633598:0:15498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b09c6c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.633601:0:15498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633607:0:15498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633623:0:15498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633630:0:15498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b09c6c0/0xdfc0fb148a38672 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.633768:0:15498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+2684:3492:x1796714784472192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6816us (6887us total) trans 4295960622 rc 0/0 00000100:00100000:0.0:1713481296.633775:0:15498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562090 00000004:00080000:0.0:1713481296.633810:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084939880/2, rc 0, transno 993326 00000100:00100000:0.0:1713481296.633816:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784472192:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.633842:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784475456:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.633865:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.633886:0:15498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784475456 00000100:00100000:0.0:1713481296.633889:0:15498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784475456 00000100:00100000:0.0:1713481296.633903:0:15498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562112 00000100:00100000:0.0:1713481296.633907:0:15498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+2684:3490:x1796714784475456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.633915:0:15498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43240 count 1 00010000:00010000:0.0:1713481296.633923:0:15498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a35440/0xdfc0fb148a387b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633930:0:15498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c03fcc0/0xdfc0fb14868893b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27b3 expref: 26603 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.633934:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.633935:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.633936:0:15498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35440/0xdfc0fb148a387b4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.633946:0:15498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007c03fcc0/0xdfc0fb14868893b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27b3 expref: 26603 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.633950:0:15498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007c03fcc0/0xdfc0fb14868893b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27b3 expref: 26603 pid: 16488 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.633960:0:15498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15498:1796714784475520:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.633973:0:15498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a2eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.633985:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882397632 00000100:00100000:0.0:1713481296.633987:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882397632 00000100:00100000:0.0:1713481296.634009:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485751 00000100:00100000:0.0:1713481296.634014:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2004:18871:x1796714882397632:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:0.0:1713481296.634021:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.634030:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880135a373c0/0xdfc0fb148a387bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d76 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634071:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880135a35f80/0xdfc0fb148a387c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.634078:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880135a35f80/0xdfc0fb148a387c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.634084:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880135a35f80/0xdfc0fb148a387c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000004:00200000:0.0:1713481296.634101:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3431:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.634103:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.634143:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880135a373c0/0xdfc0fb148a387bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d76 expref: 2006 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634158:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880135a35f80/0xdfc0fb148a387c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d76 expref: 2005 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634164:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88011f854e00) 00010000:00010000:0.0:1713481296.634166:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1713481296.634169:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35f80, rc 0) 00000100:00100000:0.0:1713481296.634188:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2005:18871:x1796714882397632:12345-192.168.202.24@tcp:101:touch.0 Request processed in 173us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.634194:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485751 00000004:00080000:0.0:1713481296.634227:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081e1ed80/2, rc 0, transno 1073430 00000100:00100000:0.0:1713481296.634233:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784471872:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.634271:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634279:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634292:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634299:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634306:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634311:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f852640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.634314:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634321:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634334:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634341:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38664 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.634479:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+66:3491:x1796714784472064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8324us (8398us total) trans 4296040727 rc 0/0 00000100:00100000:3.0:1713481296.634486:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562088 00000004:00080000:3.0:1713481296.634532:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081e1c700/2, rc 0, transno 1073431 00000100:00100000:3.0:1713481296.634538:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784472064:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.634609:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.634616:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784475648:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.634636:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.634655:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784475648 00000100:00100000:3.0:1713481296.634660:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784475648 00010000:00010000:0.0:1713481296.634663:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634685:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634692:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.634697:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562113 00000100:00100000:3.0:1713481296.634702:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2685:3490:x1796714784475648:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.634715:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43241 count 1 00010000:00010000:3.0:1713481296.634728:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133c7f3c0/0xdfc0fb148a387c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634739:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098334480/0xdfc0fb14868897a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27c1 expref: 26603 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.634746:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.634748:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.634751:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133c7f3c0/0xdfc0fb148a387c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634768:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098334480/0xdfc0fb14868897a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27c1 expref: 26603 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.634777:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098334480/0xdfc0fb14868897a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27c1 expref: 26603 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.634782:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.634788:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784475712:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.634791:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634797:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011fa04900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.634800:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634807:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.634811:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231ed900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.634819:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.634825:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011fa04900/0xdfc0fb148a3864f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x269d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.634994:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635008:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635015:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635022:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635029:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635035:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b09fcc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.635038:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.635039:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+66:3492:x1796714784471616:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9713us (9769us total) trans 4296040729 rc 0/0 00000100:00100000:0.0:1713481296.635045:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562085 00010000:00010000:3.0:1713481296.635045:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635064:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635070:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b09fcc0/0xdfc0fb148a3868e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.635076:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800794fce00/2, rc 0, transno 1073433 00000100:00100000:0.0:1713481296.635079:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784471616:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713481296.635092:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007daff100/2, rc 0, transno 1073432 00000100:00100000:0.0:1713481296.635095:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007daff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784472384:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.635143:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784475776:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.635172:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.635222:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784475840:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.635241:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.635259:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2686:3493:x1796714784472704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7731us (7768us total) trans 4295960624 rc 0/0 00000004:00080000:0.0:1713481296.635265:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800918c5500/2, rc 0, transno 993328 00000100:00100000:3.0:1713481296.635267:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562094 00000100:00100000:0.0:1713481296.635270:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800918c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784472704:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.635290:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784475840 00000100:00100000:3.0:1713481296.635294:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784475840 00000100:00100000:0.0:1713481296.635299:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784475968:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.635311:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562115 00000100:00100000:0.0:1713481296.635316:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.635316:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+67:3493:x1796714784475840:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.635328:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9894 count 1 00010000:00010000:3.0:1713481296.635342:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.635343:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784475968 00000100:00100000:0.0:1713481296.635346:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784475968 00010000:00010000:3.0:1713481296.635353:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6400/0xdfc0fb148802138 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ba expref: 20875 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.635360:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562116 00010000:00010000:3.0:1713481296.635361:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.635362:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.635364:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2686:3490:x1796714784475968:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.635365:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.635373:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43242 count 1 00010000:00010000:3.0:1713481296.635382:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086cd6400/0xdfc0fb148802138 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ba expref: 20875 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.635383:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.635391:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086cd6400/0xdfc0fb148802138 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ba expref: 20875 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.635392:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098787840/0xdfc0fb148688981 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27cf expref: 26603 pid: 16486 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.635398:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.635400:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.635401:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784476032:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.635402:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.635418:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098787840/0xdfc0fb148688981 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27cf expref: 26602 pid: 16486 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.635418:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.635424:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098787840/0xdfc0fb148688981 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27cf expref: 26602 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.635431:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784476096:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.635443:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135401b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.635468:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.635474:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784476160:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.635494:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.635598:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784476160 00000100:00100000:3.0:1713481296.635601:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784476160 00000004:00080000:0.0:1713481296.635619:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083794380/2, rc 0, transno 993329 00000100:00100000:3.0:1713481296.635623:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562117 00000100:00100000:3.0:1713481296.635627:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012caf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+68:3490:x1796714784476160:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.635628:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784472320:0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.635638:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9895 count 1 00010000:00010000:3.0:1713481296.635649:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.635656:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713481296.635660:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007354bcc0/0xdfc0fb14880213f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626c8 expref: 20875 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.635662:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012caf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784476224:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.635681:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.635683:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.635686:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.635696:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.635702:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007354bcc0/0xdfc0fb14880213f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626c8 expref: 20875 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.635710:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007354bcc0/0xdfc0fb14880213f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626c8 expref: 20875 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.635719:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784476288:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.635721:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784476224 00000100:00100000:0.0:1713481296.635725:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784476224 00000100:00100000:3.0:1713481296.635736:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.635742:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562119 00000100:00100000:0.0:1713481296.635746:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2687:3493:x1796714784476224:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.635757:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43243 count 1 00010000:00010000:0.0:1713481296.635768:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.635778:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148688988 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27dd expref: 26601 pid: 16478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.635784:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.635786:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.635788:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.635805:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148688988 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27dd expref: 26601 pid: 16478 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.635813:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148688988 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27dd expref: 26601 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.635828:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784476352:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.635845:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.635881:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784476416:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.635900:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.635953:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784476480:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.635969:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.636141:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882397952 00000100:00100000:0.0:1713481296.636145:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882397952 00010000:00010000:0.0:1713481296.636156:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134e5fa80/0xdfc0fb14891b5f2 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x8057:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8f29 expref: 20877 pid: 16533 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.636172:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820104 00000100:00100000:0.0:1713481296.636176:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20877:1960:x1796714882397952:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.636181:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.636185:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134e5fa80/0xdfc0fb14891b5f2 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x8057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8f29 expref: 20877 pid: 16533 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.636192:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134e5fa80/0xdfc0fb14891b5f2 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c8f29 expref: 20877 pid: 16533 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.636205:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.636206:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.636210:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b09df80/0xdfc0fb148a38695 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d14 expref: 16466 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.636220:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b09df80/0xdfc0fb148a38695 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d14 expref: 16466 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.636235:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007b09df80/0xdfc0fb148a38695 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8057:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d14 expref: 16466 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.636242:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784476672:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.636256:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc49180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.636347:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784473600:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.636363:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.636365:0:6932:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398208 00000100:00100000:3.0:1713481296.636369:0:6932:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398208 00000100:00100000:0.0:1713481296.636377:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1959:x1796714882396160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6657us (6802us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.636383:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820086 00000100:00100000:3.0:1713481296.636395:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485752 00000100:00100000:3.0:1713481296.636400:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2790:18838:x1796714882398208:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.636408:0:6932:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.636413:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398144 00000100:00100000:0.0:1713481296.636416:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398144 00010000:00010000:3.0:1713481296.636419:0:6932:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090462400/0xdfc0fb148a3880f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47da0 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.636429:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398272 00000100:00100000:0.0:1713481296.636431:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398272 00000100:00100000:0.0:1713481296.636442:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562123 00000100:00100000:0.0:1713481296.636446:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ddc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26603:17935:x1796714882398144:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.636453:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.636461:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124b49b00/0xdfc0fb148a38816 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47d99 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.636473:0:16541:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb78c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.636481:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.636482:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.636486:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b49b00/0xdfc0fb148a38816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d99 expref: 26604 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636487:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.636494:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124b49b00/0xdfc0fb148a38816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d99 expref: 26604 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636496:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.636500:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124b49b00, rc 0) 00010000:00010000:3.0:1713481296.636503:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636511:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ddc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26604:17935:x1796714882398144:12345-192.168.202.24@tcp:101:dd.0 Request processed in 65us (190us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.636515:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636517:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562123 00010000:00010000:3.0:1713481296.636521:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636527:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636533:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562124 00000100:00100000:0.0:1713481296.636536:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e34b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20877:17924:x1796714882398272:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.636540:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.636546:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124b4ad00/0xdfc0fb148a3882b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47da7 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.636555:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350aa880/0xdfc0fb148a15fbe lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397fe expref: 20878 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.636562:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.636563:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.636566:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124b4ad00/0xdfc0fb148a3882b lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da7 expref: 20878 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636568:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a38832 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636576:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a38832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.636581:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350aa880/0xdfc0fb148a15fbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397fe expref: 20878 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.636582:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a38832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.636593:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350aa880/0xdfc0fb148a15fbe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397fe expref: 20878 pid: 16493 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.636602:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784476800:192.168.202.24@tcp:104: 00000004:00200000:3.0:1713481296.636603:0:6932:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x3866:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.636607:0:6932:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.636617:0:6932:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a38832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636619:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fcb40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.636625:0:6932:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636630:0:6932:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636636:0:6932:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636641:0:6932:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636645:0:6932:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a125200 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.636648:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398464 00010000:00010000:3.0:1713481296.636648:0:6932:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636652:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398464 00010000:00010000:3.0:1713481296.636654:0:6932:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636661:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.636677:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.636681:0:6932:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636686:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a125200/0xdfc0fb148a3881d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636687:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398400 00000100:00100000:0.0:1713481296.636689:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398400 00010000:00010000:3.0:1713481296.636697:0:6932:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636702:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398528 00010000:00010000:3.0:1713481296.636702:0:6932:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636704:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398528 00010000:00010000:3.0:1713481296.636707:0:6932:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636711:0:6932:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086f28480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.636714:0:6932:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636719:0:6932:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT0 00000100:00100000:0.0:1713481296.636720:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485753 00000100:00100000:0.0:1713481296.636725:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18860:x1796714882398464:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.636725:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880083a05d00) 00010000:00010000:3.0:1713481296.636728:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.636730:0:6932:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.636733:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.636735:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880086f28480/0xdfc0fb148a38824 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.636745:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124b48900/0xdfc0fb148a38847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47dae expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636770:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090462400/0xdfc0fb148a3880f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da0 expref: 2794 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636785:0:6932:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a38832 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da0 expref: 2793 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636792:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff880098564000) 00010000:00010000:3.0:1713481296.636794:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713481296.636796:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124b4b3c0/0xdfc0fb148a3884e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.636796:0:6932:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c230fc0, rc 0) 00010000:00010000:0.0:1713481296.636803:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124b4b3c0/0xdfc0fb148a3884e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.636809:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124b4b3c0/0xdfc0fb148a3884e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.636813:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18838:x1796714882398208:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 412us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.636820:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485752 00000004:00200000:0.0:1713481296.636828:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51a6:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.636831:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713481296.636839:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485754 00000100:00100000:3.0:1713481296.636845:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2005:18879:x1796714882398400:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.636853:0:6932:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.636858:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124b48900/0xdfc0fb148a38847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x51a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dae expref: 2793 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636861:0:6932:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38855 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47db5 expref: -99 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.636881:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124b4b3c0/0xdfc0fb148a3884e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dae expref: 2792 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.636887:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff880084371e00) 00010000:00010000:0.0:1713481296.636889:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713481296.636891:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124b4b3c0, rc 0) 00000100:00100000:0.0:1713481296.636906:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18860:x1796714882398464:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 181us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.636911:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485753 00010000:00010000:3.0:1713481296.636920:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636929:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00000100:00100000:0.0:1713481296.636931:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485755 00000100:00100000:0.0:1713481296.636935:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18729:x1796714882398528:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.636936:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.636945:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.636951:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.636954:0:10467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1713481296.636957:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.636966:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e4606c0/0xdfc0fb148a386db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3484:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d3e expref: 2369 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636982:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800817106c0/0xdfc0fb148a3886a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.636988:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081e20240/0xdfc0fb148a0bab2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3484:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa35768 expref: 2368 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.636989:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800817106c0/0xdfc0fb148a3886a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.636996:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800817106c0/0xdfc0fb148a3886a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637003:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3484:0x0].0x0 (ffff880092a01d00) 00000004:00010000:3.0:1713481296.637007:0:6932:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800817106c0/0xdfc0fb148a3886a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637015:0:6932:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637016:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906561c0/0xdfc0fb148a37f10 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3480:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ac8 expref: 2367 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.637020:0:6932:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637026:0:6932:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637027:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3480:0x0].0x0 (ffff880078e52900) 00010000:00010000:0.0:1713481296.637029:0:10467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.637031:0:6932:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637036:0:6932:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800817121c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.637038:0:6932:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637039:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.637044:0:6932:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637045:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.637050:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:0.0:1713481296.637051:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.637053:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.637056:0:6932:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637059:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b48000/0xdfc0fb148a38878 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3480:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.637060:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800817121c0/0xdfc0fb148a3885c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637064:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124b48000/0xdfc0fb148a38878 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3480:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637069:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124b48000/0xdfc0fb148a38878 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3480:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.637076:0:6932:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637081:0:6932:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637086:0:6932:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637090:0:6932:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081712d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.637093:0:6932:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637101:0:6932:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637104:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.637107:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff88012ca0c100) 00010000:00010000:0.0:1713481296.637109:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.637109:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.637111:0:6932:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:0.0:1713481296.637114:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.637116:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081712d00/0xdfc0fb148a38863 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT1 00010000:00010000:3.0:1713481296.637170:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850480/0xdfc0fb148a38855 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47db5 expref: 2007 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.637184:0:6932:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800817106c0/0xdfc0fb148a3886a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47db5 expref: 2006 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.637190:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff880096d87000) 00010000:00010000:3.0:1713481296.637192:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.637195:0:6932:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800817106c0, rc 0) 00000100:00100000:3.0:1713481296.637211:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2006:18879:x1796714882398400:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 366us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.637217:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485754 00000040:00080000:0.0:1713481296.637257:0:10467:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3427, 64 off227520 00000100:00100000:3.0:1713481296.637268:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796714784474624:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.637291:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.637297:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.637297:0:15479:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.637303:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637311:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637316:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637320:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637325:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637329:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b4b840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.637331:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637335:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637340:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3484:0x0].0x0 (ffff88009e47f300) 00010000:00010000:0.0:1713481296.637342:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1713481296.637344:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637348:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4b840/0xdfc0fb148a38886 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3484:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637365:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637369:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637373:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637377:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b49680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.637380:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637384:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637389:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3484:0x0].0x0 (ffff88009e47f300) 00010000:00010000:0.0:1713481296.637390:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713481296.637392:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637396:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124b49680/0xdfc0fb148a3887f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637482:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637485:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637488:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637491:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637493:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b4a1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.637494:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637497:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637504:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3480:0x0].0x0 (ffff880078e52900) 00010000:00010000:0.0:1713481296.637506:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.637507:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637510:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124b4a1c0/0xdfc0fb148a38871 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3480:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000004:00010000:0.0:1713481296.637520:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88011e349880 reply state ffff8801344a6000 transno 4295107556 ns: mdt-lustre-MDT0001_UUID lock: ffff880124b48000/0xdfc0fb148a38878 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3480:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637524:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124b48000/0xdfc0fb148a38878 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3480:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.637527:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3480:0x0].0x3031 (ffff88009d3bbe00) 00010000:00010000:0.0:1713481296.637529:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.637530:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.637547:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:18729:x1796714882398528:12345-192.168.202.24@tcp:36:rm.0 Request processed in 611us (1041us total) trans 4295107556 rc 0/0 00000100:00100000:0.0:1713481296.637551:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485755 00000001:00080000:3.0:1713481296.637600:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040714 00002000:00080000:3.0:1713481296.637726:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 55378 00000004:00080000:3.0:1713481296.637966:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135b79500/2, rc 0, transno 993330 00000100:00100000:3.0:1713481296.637987:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784473728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.638040:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784476928:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.638060:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.638182:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.638209:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398912 00000100:00100000:0.0:1713481296.638212:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398912 00010000:00010000:0.0:1713481296.638223:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880085efa880/0xdfc0fb1489f7413 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2e5 expref: 2368 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.638239:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820107 00000100:00100000:0.0:1713481296.638243:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120be3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:1960:x1796714882398912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.638250:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.638254:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880085efa880/0xdfc0fb1489f7413 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2e5 expref: 2368 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.638262:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880085efa880/0xdfc0fb1489f7413 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2e5 expref: 2368 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.638274:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085efa880/0xdfc0fb1489f7413 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3464:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2e5 expref: 2368 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.638290:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3464:0x0].0x0 (ffff88008f80ae00) 00010000:00010000:0.0:1713481296.638293:0:6918:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638300:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638305:0:6918:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638320:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.638333:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120be3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2367:1960:x1796714882398912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 89us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.638338:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820107 00000100:00100000:0.0:1713481296.638351:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398720 00000100:00100000:0.0:1713481296.638353:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398720 00010000:00010000:0.0:1713481296.638362:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19fcc0/0xdfc0fb1488e7e3e lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54d1 expref: 16467 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.638374:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398592 00000100:00100000:0.0:1713481296.638376:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398592 00010000:00010000:0.0:1713481296.638384:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dab4240/0xdfc0fb148a13d51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f54 expref: 24476 pid: 16523 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.638395:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820108 00000100:00100000:0.0:1713481296.638398:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16467:1958:x1796714882398720:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.638402:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.638405:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c19fcc0/0xdfc0fb1488e7e3e lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54d1 expref: 16467 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.638410:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c19fcc0/0xdfc0fb1488e7e3e lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54d1 expref: 16467 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.638420:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19fcc0/0xdfc0fb1488e7e3e lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54d1 expref: 16467 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.638428:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.638429:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.638431:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b1ec6c0/0xdfc0fb148a38721 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d68 expref: 16466 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.638436:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b1ec6c0/0xdfc0fb148a38721 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d68 expref: 16466 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.638447:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007b1ec6c0/0xdfc0fb148a38721 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d68 expref: 16466 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.638457:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784477056:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.638472:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fc000 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.638491:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882399040 00000100:00100000:0.0:1713481296.638494:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882399040 00010000:00010000:0.0:1713481296.638504:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097d1d440/0xdfc0fb148941a2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00b6 expref: 24477 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.638522:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820109 00000100:00100000:0.0:1713481296.638527:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1958:x1796714882398592:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.638534:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.638546:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dab4240/0xdfc0fb148a13d51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f54 expref: 24477 pid: 16523 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.638554:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dab4240/0xdfc0fb148a13d51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f54 expref: 24477 pid: 16523 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.638554:0:15479:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.638561:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638570:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dab4240/0xdfc0fb148a13d51 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f54 expref: 24477 pid: 16523 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.638582:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.638583:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.638586:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e463cc0/0xdfc0fb148a386f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d5a expref: 24476 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.638594:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e463cc0/0xdfc0fb148a386f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d5a expref: 24476 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.638612:0:16553:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e463cc0/0xdfc0fb148a386f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d5a expref: 24476 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.638621:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16553:1796714784477120:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.638638:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.638656:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882399168 00000100:00100000:0.0:1713481296.638659:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882399168 00010000:00010000:0.0:1713481296.638688:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880078282640/0xdfc0fb148688926 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2789 expref: 26601 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.638706:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882399360 00000100:00100000:0.0:1713481296.638708:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882399360 00010000:00010000:0.0:1713481296.638717:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084040d80/0xdfc0fb148688934 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27a5 expref: 26602 pid: 16477 timeout: 815 lvb_type: 1 00000040:00080000:3.0:1713481296.638721:0:15479:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31881, 64 off2048576 00000100:00100000:0.0:1713481296.638739:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820110 00000100:00100000:0.0:1713481296.638744:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:1960:x1796714882399040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.638751:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.638755:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097d1d440/0xdfc0fb148941a2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00b6 expref: 24476 pid: 16545 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.638759:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.638763:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097d1d440/0xdfc0fb148941a2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00b6 expref: 24476 pid: 16545 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.638767:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.638774:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638779:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.638780:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.638780:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638783:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a34000/0xdfc0fb148a38791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d7d expref: 26603 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.638785:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638790:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34000/0xdfc0fb148a38791 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d7d expref: 26603 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.638790:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.638795:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.638800:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081712f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.638803:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638804:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135a34000/0xdfc0fb148a38791 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x7a82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d7d expref: 26603 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.638811:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784477184:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.638812:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.638819:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3464:0x0].0x0 (ffff88008f80ae00) 00010000:00010000:3.0:1713481296.638821:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1713481296.638824:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce000 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.638824:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.638829:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081712f40/0xdfc0fb148a38894 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3464:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.638845:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820114 00010000:00010000:3.0:1713481296.638847:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.638849:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26601:1960:x1796714882399104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.638853:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638855:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.638858:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638859:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe006c0/0xdfc0fb14868892d lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2797 expref: 26601 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.638862:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013228cb40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.638865:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638867:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe006c0/0xdfc0fb14868892d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2797 expref: 26601 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.638870:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.638876:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3464:0x0].0x0 (ffff88008f80ae00) 00010000:00010000:3.0:1713481296.638877:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.638880:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638882:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.638883:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.638885:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013228cb40/0xdfc0fb148a38759 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.638887:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.638893:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.638910:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.638924:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26601:1960:x1796714882399104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.638930:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820114 00000100:00100000:0.0:1713481296.638959:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882398976 00000100:00100000:0.0:1713481296.638962:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882398976 00000100:00100000:0.0:1713481296.638972:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882399296 00000100:00100000:0.0:1713481296.638974:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882399296 00000100:00100000:0.0:1713481296.638985:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562128 00000100:00100000:0.0:1713481296.638989:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:10409:x1796714882398976:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.638996:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.639004:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.639005:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008012b180/0xdfc0fb148a3889b lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47dca expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639011:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.639016:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.639020:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096bac900/0xdfc0fb14891d151 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d0 expref: 24478 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.639021:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.639026:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f851200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.639027:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd533c0/0xdfc0fb14893ab05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3c4 expref: 26600 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.639028:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.639033:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.639033:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.639035:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.639038:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008012b180/0xdfc0fb148a3889b lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dca expref: 24478 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639041:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:3.0:1713481296.639043:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.639045:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.639050:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f851200/0xdfc0fb148a3873d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3463:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.639053:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd533c0/0xdfc0fb14893ab05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3c4 expref: 26600 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.639062:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd533c0/0xdfc0fb14893ab05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3c4 expref: 26600 pid: 16512 timeout: 815 lvb_type: 1 00000004:00010000:3.0:1713481296.639062:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007812f100 reply state ffff88009d050000 transno 4295107558 ns: mdt-lustre-MDT0001_UUID lock: ffff880094316f40/0xdfc0fb148a3874b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.639069:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094316f40/0xdfc0fb148a3874b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3463:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.639071:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784477312:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.639074:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x3631 (ffff88009c664100) 00010000:00010000:3.0:1713481296.639077:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.639079:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.639096:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096bac900/0xdfc0fb14891d151 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d0 expref: 24478 pid: 16526 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.639104:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007812f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2007:18678:x1796714882396864:12345-192.168.202.24@tcp:36:rm.0 Request processed in 7228us (8153us total) trans 4295107558 rc 0/0 00010000:00010000:0.0:1713481296.639105:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096bac900/0xdfc0fb14891d151 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d0 expref: 24478 pid: 16526 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.639111:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485750 00000100:00100000:0.0:1713481296.639113:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784477376:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.639141:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.639164:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084040d80/0xdfc0fb148688934 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d27a5 expref: 26600 pid: 16477 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.639177:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe006c0/0xdfc0fb14868892d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2797 expref: 26599 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.639181:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c4b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784475072:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.639194:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784474688:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.639201:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639208:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639214:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639215:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639221:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639223:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639226:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639229:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639230:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639233:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135a34fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.639235:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639236:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639241:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639243:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639250:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639253:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639255:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013228f840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.639259:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a34fc0/0xdfc0fb148a3877c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639259:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639265:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639278:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639285:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013228f840/0xdfc0fb148a38760 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.639397:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007812df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2690:3491:x1796714784474752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6468us (6521us total) trans 4295960627 rc 0/0 00000100:00100000:0.0:1713481296.639403:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562107 00000100:00100000:0.0:1713481296.639424:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882399680 00000100:00100000:0.0:1713481296.639426:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882399680 00000100:00100000:3.0:1713481296.639429:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2689:3493:x1796714784473920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7089us (7138us total) trans 4295960628 rc 0/0 00000100:00100000:3.0:1713481296.639436:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562104 00000100:00100000:0.0:1713481296.639441:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562131 00000100:00100000:0.0:1713481296.639445:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16467:17009:x1796714882399680:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.639451:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.639460:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080128900/0xdfc0fb148a388b0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47dd8 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.639471:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.639476:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078282640/0xdfc0fb148688926 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2789 expref: 26598 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.639479:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.639481:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.639485:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080128900/0xdfc0fb148a388b0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dd8 expref: 16468 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.639488:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784474816:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.639491:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880080128900/0xdfc0fb148a388b0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dd8 expref: 16468 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.639498:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080128900, rc 0) 00010000:00010000:3.0:1713481296.639509:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.639511:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16468:17009:x1796714882399680:12345-192.168.202.24@tcp:101:dd.0 Request processed in 65us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.639516:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.639517:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562131 00010000:00010000:3.0:1713481296.639522:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639533:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639540:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639547:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639552:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013228c000 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:0.0:1713481296.639553:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086c04e00/2, rc 0, transno 993331 00010000:00010000:3.0:1713481296.639555:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.639561:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784474752:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.639561:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639572:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639579:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013228c000/0xdfc0fb148a38767 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.639592:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.639598:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784477696:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.639614:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.639723:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2690:3493:x1796714784473856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7194us (7245us total) trans 4295960629 rc 0/0 00000100:00100000:3.0:1713481296.639731:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562105 00000100:00100000:3.0:1713481296.639765:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882399808 00000100:00100000:3.0:1713481296.639769:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882399808 00000100:00100000:3.0:1713481296.639786:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485756 00000100:00100000:3.0:1713481296.639790:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2181:18922:x1796714882399808:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:3.0:1713481296.639812:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:0.0:1713481296.639819:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086c07b80/2, rc 0, transno 1073438 00000100:00100000:0.0:1713481296.639824:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784474880:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.639824:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ad3840/0xdfc0fb148a38744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x51fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47d84 expref: 2181 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.639837:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51fb:0x0].0x0 (ffff88012f10b400) 00010000:00010000:3.0:1713481296.639840:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.639864:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784477888:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.639885:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.639896:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x51fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.639903:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.639910:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.639911:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.639916:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784477824:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.639931:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1713481296.639965:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880072ac6d80 reply state ffff8801242e1000 transno 4295105894 ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.639973:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.639979:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51fb:0x0].0x0 (ffff88012f10b400) 00010000:00010000:3.0:1713481296.639981:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.639983:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.640016:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2182:18922:x1796714882399808:12345-192.168.202.24@tcp:36:touch.0 Request processed in 225us (679us total) trans 4295105894 rc 0/0 00000100:00100000:3.0:1713481296.640023:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485756 00000100:00100000:3.0:1713481296.640052:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784477952 00000100:00100000:3.0:1713481296.640055:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784477952 00000100:00100000:3.0:1713481296.640072:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562135 00000100:00100000:3.0:1713481296.640076:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+73:3493:x1796714784477952:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.640088:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9899 count 1 00010000:00010000:3.0:1713481296.640100:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.640112:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6f40/0xdfc0fb14880215b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962700 expref: 20878 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.640139:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.640140:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.640143:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.640162:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086cd6f40/0xdfc0fb14880215b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962700 expref: 20878 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.640172:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086cd6f40/0xdfc0fb14880215b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962700 expref: 20878 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.640182:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784478208:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.640200:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135604480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.640283:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784478272 00000100:00100000:3.0:1713481296.640286:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784478272 00000100:00100000:3.0:1713481296.640305:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562136 00000100:00100000:3.0:1713481296.640309:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+74:3491:x1796714784478272:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.640319:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9900 count 1 00010000:00010000:3.0:1713481296.640331:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.640340:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148802162 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96270e expref: 20878 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.640346:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.640348:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.640351:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.640365:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148802162 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96270e expref: 20878 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.640374:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148802162 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96270e expref: 20878 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.640384:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784478400:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.640402:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c5d600 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.640556:0:15565:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713481296.640561:0:15565:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.640567:0:15565:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dd94fc0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:0.0:1713481296.640570:0:15565:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.640578:0:15565:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.640593:0:15565:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.640597:0:15565:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713481296.640611:0:15565:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 1/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.640615:0:15565:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007dd94fc0/0xdfc0fb148a38522 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3853e expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.640633:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.640634:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.640635:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713481296.640752:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784478464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.641494:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.641802:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784475712:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.641817:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.641826:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133c7f3c0/0xdfc0fb148a387c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.641835:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.641866:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562137 00000100:00100000:0.0:1713481296.641871:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16468:18844:x1796714882399872:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713481296.641873:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784476032:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.641878:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.641887:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080129b00/0xdfc0fb148a388f6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ddf expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.641894:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.641897:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.641905:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.641906:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.641910:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080129b00/0xdfc0fb148a388f6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ddf expref: 16469 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.641919:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880080129b00/0xdfc0fb148a388f6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ddf expref: 16469 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.641926:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080129b00, rc 0) 00000100:00100000:0.0:1713481296.641944:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16469:18844:x1796714882399872:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.641950:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562137 00000100:00100000:0.0:1713481296.642009:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784476096:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.642028:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.642077:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784476288:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.642103:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.642117:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c5cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784476352:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.642152:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.642202:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c5cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784476672:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.642223:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.642243:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20878:1960:x1796714882397952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6065us (6148us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.642250:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820104 00000100:00100000:0.0:1713481296.642293:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.642311:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882400192 00000100:00100000:0.0:1713481296.642314:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882400192 00010000:00010000:0.0:1713481296.642326:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086cd6400/0xdfc0fb148802138 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ba expref: 20878 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.642343:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820118 00000100:00100000:0.0:1713481296.642347:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20878:1960:x1796714882400192:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.642354:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.642359:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086cd6400/0xdfc0fb148802138 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ba expref: 20878 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.642367:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086cd6400/0xdfc0fb148802138 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ba expref: 20878 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.642388:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6400/0xdfc0fb148802138 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ba expref: 20878 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.642404:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.642406:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.642408:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642415:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642442:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.642446:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.642454:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.642462:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20877:1960:x1796714882400192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 113us (168us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.642462:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.642469:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820118 00010000:00010000:3.0:1713481296.642470:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.642477:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.642483:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880076b66d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.642486:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642493:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.642493:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642500:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642507:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.642513:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642514:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.642520:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880076b66d00/0xdfc0fb148a387d7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642526:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642532:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135a34480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.642534:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642541:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642553:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642559:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a34480/0xdfc0fb148a387de lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.642679:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+75:3493:x1796714784475840:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7347us (7421us total) trans 4296040735 rc 0/0 00000100:00100000:3.0:1713481296.642688:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562115 00000100:00100000:0.0:1713481296.642696:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2693:3490:x1796714784475968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7330us (7378us total) trans 4295960631 rc 0/0 00000100:00100000:0.0:1713481296.642702:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562116 00010000:00010000:0.0:1713481296.642726:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642732:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642738:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642744:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642749:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642754:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b49200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.642756:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642761:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642773:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.642779:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124b49200/0xdfc0fb148a387f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.642848:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784478656 00000100:00100000:3.0:1713481296.642852:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784478656 00000100:00100000:3.0:1713481296.642870:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784478720 00000100:00100000:3.0:1713481296.642872:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784478720 00000100:00100000:0.0:1713481296.642876:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2694:3493:x1796714784476224:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7129us (7179us total) trans 4295960632 rc 0/0 00000100:00100000:0.0:1713481296.642883:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562119 00000100:00100000:3.0:1713481296.642892:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562141 00000100:00100000:3.0:1713481296.642897:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+75:3490:x1796714784478720:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.642909:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9901 count 1 00010000:00010000:3.0:1713481296.642920:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.642931:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.642931:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6880/0xdfc0fb148802169 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96271c expref: 20876 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.642938:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.642940:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.642943:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.642960:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.642964:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086cd6880/0xdfc0fb148802169 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96271c expref: 20876 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.642968:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882400128 00000100:00100000:0.0:1713481296.642970:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882400128 00010000:00010000:3.0:1713481296.642973:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086cd6880/0xdfc0fb148802169 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96271c expref: 20876 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.642980:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c321680/0xdfc0fb148802131 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ac expref: 20877 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.642982:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784478848:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.642989:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882400256 00000100:00100000:0.0:1713481296.642990:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882400256 00010000:00010000:0.0:1713481296.642995:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801209ecfc0/0xdfc0fb148802146 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626d6 expref: 20878 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.642999:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.643002:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820122 00000100:00100000:0.0:1713481296.643005:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20878:1960:x1796714882400128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.643010:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.643012:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c321680/0xdfc0fb148802131 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ac expref: 20878 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643017:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c321680/0xdfc0fb148802131 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ac expref: 20878 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643035:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c321680/0xdfc0fb148802131 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626ac expref: 20878 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643042:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.643043:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.643045:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008feab600/0xdfc0fb148a387d0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643049:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008feab600/0xdfc0fb148a387d0 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643064:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.643074:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20877:1960:x1796714882400128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.643077:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820122 00000100:00100000:0.0:1713481296.643089:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820123 00000100:00100000:0.0:1713481296.643092:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20876:1960:x1796714882400256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.643097:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.643100:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801209ecfc0/0xdfc0fb148802146 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626d6 expref: 20876 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643108:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801209ecfc0/0xdfc0fb148802146 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626d6 expref: 20876 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643146:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801209ecfc0/0xdfc0fb148802146 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626d6 expref: 20876 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643157:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.643158:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.643161:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643167:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643185:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.643199:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20875:1960:x1796714882400256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.643205:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820123 00010000:00010000:0.0:1713481296.643298:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643306:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643313:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643320:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643326:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643331:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880089419b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.643334:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643339:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643352:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643363:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880089419b00/0xdfc0fb148a38801 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.643552:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882400384 00000100:00100000:0.0:1713481296.643556:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882400384 00010000:00010000:0.0:1713481296.643656:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007354bcc0/0xdfc0fb14880213f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626c8 expref: 20876 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.643695:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820125 00000100:00100000:0.0:1713481296.643700:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20876:1960:x1796714882400384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.643707:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.643711:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007354bcc0/0xdfc0fb14880213f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626c8 expref: 20875 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643720:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007354bcc0/0xdfc0fb14880213f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626c8 expref: 20875 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643737:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007354bcc0/0xdfc0fb14880213f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626c8 expref: 20875 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.643750:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.643751:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.643754:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643761:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.643783:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.643789:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.643795:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20874:1960:x1796714882400384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 94us (340us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.643797:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.643800:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820125 00010000:00010000:3.0:1713481296.643806:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.643813:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.643820:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.643825:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086b118c0 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:0.0:1713481296.643827:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800728eb480/2, rc 0, transno 1073441 00010000:00010000:3.0:1713481296.643828:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.643831:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784475776:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.643835:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.643850:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.643856:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086b118c0/0xdfc0fb148a387e5 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.643984:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012caf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+76:3490:x1796714784476160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8355us (8487us total) trans 4296040739 rc 0/0 00000100:00100000:3.0:1713481296.643991:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562117 00000100:00100000:3.0:1713481296.644068:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882400832 00000100:00100000:3.0:1713481296.644072:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882400832 00000100:00100000:3.0:1713481296.644092:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562144 00000100:00100000:3.0:1713481296.644097:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16469:17935:x1796714882400832:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.644105:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.644138:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8533c0/0xdfc0fb148a38951 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47dfb expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.644154:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.644161:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c5ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784476800:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.644163:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801320b8d80/0xdfc0fb148a38839 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dbc expref: 16470 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.644165:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.644166:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.644171:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8533c0/0xdfc0fb148a38951 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dfb expref: 16470 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.644173:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801320b8d80, rc 0) 00010000:00010000:0.0:1713481296.644181:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124b4ad00/0xdfc0fb148a3882b lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da7 expref: 20872 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.644182:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16470:18817:x1796714882398784:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 7618us (7648us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.644187:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562125 00010000:00010000:3.0:1713481296.644187:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8533c0/0xdfc0fb148a38951 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dfb expref: 16470 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.644190:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124b4ad00, rc 0) 00010000:00010000:3.0:1713481296.644196:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8533c0, rc 0) 00000100:00100000:0.0:1713481296.644203:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e34b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:17924:x1796714882398272:12345-192.168.202.24@tcp:101:dd.0 Request processed in 7666us (7849us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.644212:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16469:17935:x1796714882400832:12345-192.168.202.24@tcp:101:dd.0 Request processed in 114us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.644218:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784479296:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.644219:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562144 00000100:00100000:2.0:1713481296.644240:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.644259:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784479296 00000100:00100000:3.0:1713481296.644263:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784479296 00000100:00100000:2.0:1713481296.644267:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882400896 00000100:00100000:2.0:1713481296.644269:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882400896 00000100:00100000:3.0:1713481296.644291:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562146 00000100:00100000:2.0:1713481296.644297:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562147 00000100:00100000:3.0:1713481296.644297:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+77:3491:x1796714784479296:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.644300:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16469:18836:x1796714882400896:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.644303:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562124 00010000:00010000:2.0:1713481296.644305:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:3.0:1713481296.644309:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9903 count 1 00010000:00010000:2.0:1713481296.644313:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e13f600/0xdfc0fb148a3895f lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8058:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e02 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.644320:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.644323:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008370d200/0xdfc0fb14891ca20 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8058:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c9f59 expref: 20871 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.644327:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.644328:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1713481296.644330:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882400960 00010000:00010000:2.0:1713481296.644330:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e13f600/0xdfc0fb148a3895f lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8058:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e02 expref: 16470 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.644331:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801209ef180/0xdfc0fb148802177 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962738 expref: 20871 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.644333:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882400960 00010000:00010000:3.0:1713481296.644337:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.644338:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.644340:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008370d200/0xdfc0fb14891ca20 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8058:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c9f59 expref: 20872 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.644340:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.644349:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008370d200/0xdfc0fb14891ca20 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8058:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c9f59 expref: 20872 pid: 16495 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.644354:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078411180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784479360:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.644357:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562148 00010000:00010000:3.0:1713481296.644358:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801209ef180/0xdfc0fb148802177 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962738 expref: 20872 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.644362:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:18792:x1796714882400960:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.644364:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.644369:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.644371:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801209ef180/0xdfc0fb148802177 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962738 expref: 20872 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.644377:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882401152 00010000:00010000:0.0:1713481296.644379:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fda400/0xdfc0fb148a3896d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc508:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e09 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.644379:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882401152 00000100:00100000:3.0:1713481296.644381:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784479424:192.168.202.24@tcp:104: 00002000:00010000:0.0:1713481296.644392:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc508:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.644396:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485759 00000100:00100000:2.0:1713481296.644399:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2182:18879:x1796714882401152:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:3.0:1713481296.644399:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231ed900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.644401:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.644403:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.644404:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.644407:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fda400/0xdfc0fb148a3896d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e09 expref: 20873 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.644411:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8000/0xdfc0fb148a3897b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e10 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.644417:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fda400/0xdfc0fb148a3896d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc508:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e09 expref: 20873 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.644424:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fda400, rc 0) 00000100:00100000:0.0:1713481296.644439:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20873:18792:x1796714882400960:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 76us (117us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.644462:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c9680/0xdfc0fb148a38982 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.644471:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c9680/0xdfc0fb148a38982 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.644478:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c9680/0xdfc0fb148a38982 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.644495:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562148 00000100:00100000:0.0:1713481296.644525:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784477056:192.168.202.24@tcp:105: 00000004:00200000:2.0:1713481296.644529:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x3899:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.644532:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713481296.644540:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.644557:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8000/0xdfc0fb148a3897b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e10 expref: 2184 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.644572:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c9680/0xdfc0fb148a38982 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e10 expref: 2183 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.644579:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88007da00600) 00010000:00010000:2.0:1713481296.644581:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713481296.644583:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968c9680, rc 0) 00000100:00100000:2.0:1713481296.644599:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2183:18879:x1796714882401152:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 199us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.644605:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485759 00000100:00100000:0.0:1713481296.644636:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16472:1958:x1796714882398720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6236us (6294us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.644642:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820108 00000100:00100000:2.0:1713481296.644651:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784479552:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.644682:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.644732:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784479616:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.644751:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.644796:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562150 00000100:00100000:0.0:1713481296.644801:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+79:3492:x1796714784479552:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.644811:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9904 count 1 00010000:00010000:0.0:1713481296.644821:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.644830:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086cd4480/0xdfc0fb14880217e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962746 expref: 20872 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.644835:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.644836:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.644839:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.644852:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086cd4480/0xdfc0fb14880217e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962746 expref: 20872 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.644859:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086cd4480/0xdfc0fb14880217e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962746 expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.644868:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784479680:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.644881:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fc000 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.645029:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16553:1796714784477120:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.645044:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.645053:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1958:x1796714882398592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6526us (6700us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.645059:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820109 00000100:00100000:0.0:1713481296.645084:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784477184:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.645099:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.645108:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1960:x1796714882399040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6364us (6643us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.645113:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820110 00000100:00100000:2.0:1713481296.645149:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135b79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784477248:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.645167:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801320bb600/0xdfc0fb148a388a2 lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dd1 expref: 20872 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.645174:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801320bb600, rc 0) 00000100:00100000:0.0:1713481296.645180:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.645185:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:10479:x1796714882399296:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6190us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.645189:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562129 00000100:00100000:0.0:1713481296.645205:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.645216:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882401088 00000100:00100000:0.0:1713481296.645218:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882401088 00010000:00010000:0.0:1713481296.645235:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086f2b840/0xdfc0fb1489cf45e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22027 expref: 20872 pid: 16463 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.645329:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784479872 00000100:00100000:2.0:1713481296.645333:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784479872 00000100:00100000:0.0:1713481296.645347:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820126 00000100:00100000:0.0:1713481296.645352:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:1960:x1796714882401088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.645358:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.645358:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82878 00010000:00010000:0.0:1713481296.645362:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086f2b840/0xdfc0fb1489cf45e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22027 expref: 20872 pid: 16463 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.645362:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:15483:x1796714784479872:12345-0@lo:1000:mdt00_019.0 00010000:00010000:0.0:1713481296.645371:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086f2b840/0xdfc0fb1489cf45e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22027 expref: 20872 pid: 16463 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.645387:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086f2b840/0xdfc0fb1489cf45e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22027 expref: 20872 pid: 16463 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.645399:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.645400:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.645403:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801320b8d80/0xdfc0fb148a38839 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dbc expref: 16473 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.645410:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801320b8d80/0xdfc0fb148a38839 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dbc expref: 16473 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.645417:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:15483:x1796714784479872:12345-0@lo:1000:mdt00_019.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.645425:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82878 00010000:00010000:0.0:1713481296.645426:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801320b8d80/0xdfc0fb148a38839 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dbc expref: 16473 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.645434:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784479936:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.645455:0:15483:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-mdtlov_UUID:15483:1796714784479872:0@lo:1000:mdt00_019.0 00000100:00100000:2.0:1713481296.645496:0:15483:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-mdtlov_UUID:15483:1796714784480000:0@lo:1000:mdt00_019.0 00000100:00100000:0.0:1713481296.645509:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.645513:0:15483:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.645523:0:15483:0:(client.c:2539:ptlrpc_set_wait()) set ffff880133b4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.645529:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820128 00000100:00100000:2.0:1713481296.645532:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784480000 00000100:00100000:0.0:1713481296.645534:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:1960:x1796714882401024:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.645535:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784480000 00010000:00010000:0.0:1713481296.645541:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.645545:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350aa880/0xdfc0fb148a15fbe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397fe expref: 20872 pid: 16493 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.645553:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350aa880/0xdfc0fb148a15fbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397fe expref: 20872 pid: 16493 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.645558:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82879 00000100:00100000:2.0:1713481296.645563:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:15483:x1796714784480000:12345-0@lo:1000:mdt00_019.0 00010000:00010000:0.0:1713481296.645571:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350aa880/0xdfc0fb148a15fbe lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa397fe expref: 20872 pid: 16493 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.645581:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.645582:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.645586:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124b4ad00/0xdfc0fb148a3882b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da7 expref: 20871 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.645593:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124b4ad00/0xdfc0fb148a3882b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da7 expref: 20871 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.645610:0:16553:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880124b4ad00/0xdfc0fb148a3882b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da7 expref: 20871 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.645618:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784480128:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.645622:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:15483:x1796714784480000:12345-0@lo:1000:mdt00_019.0 Request processed in 58us (106us total) trans 0 rc 1/1 00000100:00100000:2.0:1713481296.645628:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82879 00000100:00100000:0.0:1713481296.645633:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.645658:0:15483:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-mdtlov_UUID:15483:1796714784480000:0@lo:1000:mdt00_019.0 00000100:00100000:0.0:1713481296.645660:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.645700:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.645711:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.645720:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:18838:x1796714882401408:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 559us (602us total) trans 0 rc -17/-17 00000100:00100000:2.0:1713481296.645726:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485761 00000100:00100000:0.0:1713481296.645800:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.645817:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882401984 00000100:00100000:0.0:1713481296.645819:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125666 00000100:00100000:2.0:1713481296.645821:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882401984 00000100:00100000:0.0:1713481296.645823:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2183:18578:x1796714882401920:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:2.0:1713481296.645837:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485762 00000100:00100000:2.0:1713481296.645841:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18867:x1796714882401984:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:2.0:1713481296.645847:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.645854:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968caac0/0xdfc0fb148a389b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e33 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.645891:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2184:18578:x1796714882401920:12345-192.168.202.24@tcp:35:rm.0 Request processed in 67us (179us total) trans 4295105895 rc 0/0 00000100:00100000:0.0:1713481296.645896:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125666 00010000:00010000:2.0:1713481296.645907:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645912:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645917:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645923:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645927:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645930:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.645937:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784477312:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.645946:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb80000/0xdfc0fb148a389cf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645950:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb80000/0xdfc0fb148a389cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645953:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb80000/0xdfc0fb148a389cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.645960:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00010000:2.0:1713481296.645960:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb80000/0xdfc0fb148a389cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645965:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645968:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645971:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.645976:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784477376:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.645976:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645979:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800968c8b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.645981:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645983:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645987:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.645989:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.645990:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.645993:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8b40/0xdfc0fb148a389c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.645994:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008012b180/0xdfc0fb148a3889b lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dca expref: 24476 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646000:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008012b180, rc 0) 00010000:00010000:2.0:1713481296.646002:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.646005:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.646008:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:10409:x1796714882398976:12345-192.168.202.24@tcp:101:dd.0 Request processed in 7018us (7704us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.646008:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.646010:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800968c8fc0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.646011:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562128 00010000:00010000:2.0:1713481296.646012:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.646015:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.646020:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff88009c7e9e00) 00010000:00010000:2.0:1713481296.646021:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.646023:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.646026:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c8fc0/0xdfc0fb148a389c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.646034:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.646046:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.646048:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968caac0/0xdfc0fb148a389b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e33 expref: 2794 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.646052:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402048 00000100:00100000:0.0:1713481296.646055:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402048 00010000:00010000:2.0:1713481296.646058:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb80000/0xdfc0fb148a389cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e33 expref: 2793 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646061:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd533c0/0xdfc0fb14893ab05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3c4 expref: 26592 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.646061:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff880131402e00) 00010000:00010000:2.0:1713481296.646063:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.646064:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb80000, rc 0) 00000100:00100000:0.0:1713481296.646072:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402176 00000100:00100000:0.0:1713481296.646074:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402176 00000100:00100000:2.0:1713481296.646075:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18867:x1796714882401984:12345-192.168.202.24@tcp:101:touch.0 Request processed in 234us (276us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.646078:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096bac900/0xdfc0fb14891d151 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d0 expref: 24476 pid: 16526 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.646079:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485762 00000100:00100000:0.0:1713481296.646085:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820130 00000100:00100000:0.0:1713481296.646088:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26592:1960:x1796714882402048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.646092:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.646092:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402112 00010000:00010000:0.0:1713481296.646094:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd533c0/0xdfc0fb14893ab05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3c4 expref: 26592 pid: 16512 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.646094:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402112 00010000:00010000:0.0:1713481296.646099:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd533c0/0xdfc0fb14893ab05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3c4 expref: 26592 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.646106:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd533c0/0xdfc0fb14893ab05 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3c4 expref: 26592 pid: 16512 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.646108:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485763 00000100:00100000:2.0:1713481296.646111:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2008:18678:x1796714882402112:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:0.0:1713481296.646115:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.646134:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.646138:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26591:1960:x1796714882402048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 49us (177us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.646140:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009432c240/0xdfc0fb148a389d6 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e3a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.646142:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820130 00000004:00080000:3.0:1713481296.646176:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c5cd880/2, rc 0, transno 993338 00010000:00010000:2.0:1713481296.646182:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:3.0:1713481296.646183:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784476928:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.646189:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646195:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646205:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.646211:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646216:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.646221:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.646230:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784480256:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.646241:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.646249:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929da640/0xdfc0fb148a389eb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.646256:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929da640/0xdfc0fb148a389eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.646256:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.646259:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402240 00010000:00010000:2.0:1713481296.646261:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929da640/0xdfc0fb148a389eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.646262:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402240 00010000:00010000:0.0:1713481296.646274:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880073548480/0xdfc0fb148802154 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626f2 expref: 20874 pid: 16456 timeout: 815 lvb_type: 1 00000004:00200000:2.0:1713481296.646276:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3463:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.646279:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713481296.646286:0:15475:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800929da640/0xdfc0fb148a389eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.646291:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820132 00010000:00010000:2.0:1713481296.646291:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646294:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.646295:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20874:1960:x1796714882402240:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.646297:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646300:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646303:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009432e1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.646304:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646307:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646311:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x0 (ffff88007ab6ad00) 00010000:00010000:2.0:1713481296.646312:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.646314:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 3/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646316:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009432e1c0/0xdfc0fb148a389dd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646325:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646327:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646330:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646333:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800929db600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.646335:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646338:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646341:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x3631 (ffff8800998d8a00) 00010000:00010000:2.0:1713481296.646342:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.646344:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.646346:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929db600/0xdfc0fb148a389e4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.646369:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.646374:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880073548480/0xdfc0fb148802154 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26aa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626f2 expref: 20874 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.646374:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009432c240/0xdfc0fb148a389d6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e3a expref: 2010 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646383:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880073548480/0xdfc0fb148802154 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626f2 expref: 20874 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.646384:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929da640/0xdfc0fb148a389eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e3a expref: 2009 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.646387:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:2.0:1713481296.646388:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713481296.646389:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929da640, rc 0) 00010000:00010000:0.0:1713481296.646401:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073548480/0xdfc0fb148802154 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9626f2 expref: 20874 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.646402:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2009:18678:x1796714882402112:12345-192.168.202.24@tcp:101:rm.0 Request processed in 290us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.646405:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485763 00010000:00010000:0.0:1713481296.646416:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.646417:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.646420:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880089419f80/0xdfc0fb148a388a9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646427:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089419f80/0xdfc0fb148a388a9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646512:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.646526:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20873:1960:x1796714882402240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 229us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.646532:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820132 00000004:00080000:2.0:1713481296.646612:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086f07100/2, rc 0, transno 1073444 00000100:00100000:2.0:1713481296.646621:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784477440:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.646662:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784480448:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.646692:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.646785:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.646798:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784480448 00000100:00100000:0.0:1713481296.646801:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784480448 00000100:00100000:0.0:1713481296.646815:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402304 00000100:00100000:0.0:1713481296.646816:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402304 00000100:00100000:0.0:1713481296.646823:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562155 00000100:00100000:0.0:1713481296.646826:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+80:3491:x1796714784480448:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.646834:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9906 count 1 00000100:00100000:2.0:1713481296.646840:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784478144:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.646842:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646849:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801209ecb40/0xdfc0fb14880218c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962762 expref: 20872 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.646853:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.646854:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.646855:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646856:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.646862:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784478208:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.646867:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801209ecb40/0xdfc0fb14880218c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962762 expref: 20872 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.646872:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801209ecb40/0xdfc0fb14880218c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962762 expref: 20872 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.646874:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402368 00000100:00100000:2.0:1713481296.646876:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402368 00000100:00100000:0.0:1713481296.646878:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076afdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784480512:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.646883:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.646889:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800929ad780 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.646889:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562156 00000100:00100000:2.0:1713481296.646892:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16475:17009:x1796714882402304:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.646897:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.646901:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562157 00000100:00100000:0.0:1713481296.646904:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16475:11388:x1796714882402368:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.646904:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929dad00/0xdfc0fb148a38a00 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e41 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.646904:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784478400:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.646909:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.646913:0:16452:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.646916:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dca4000/0xdfc0fb148a38a07 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e48 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.646919:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.646920:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.646923:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929dad00/0xdfc0fb148a38a00 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e41 expref: 16477 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.646923:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646929:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c18ad00/0xdfc0fb148941a33 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00c4 expref: 20872 pid: 16469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.646929:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929dad00/0xdfc0fb148a38a00 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e41 expref: 16477 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.646934:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.646934:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929dad00, rc 0) 00010000:00010000:0.0:1713481296.646936:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.646939:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dca4000/0xdfc0fb148a38a07 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e48 expref: 16477 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.646945:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16477:17009:x1796714882402304:12345-192.168.202.24@tcp:101:dd.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.646949:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562156 00010000:00010000:0.0:1713481296.646954:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c18ad00/0xdfc0fb148941a33 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00c4 expref: 20872 pid: 16469 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.646961:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402560 00000100:00100000:2.0:1713481296.646962:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402560 00010000:00010000:0.0:1713481296.646963:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c18ad00/0xdfc0fb148941a33 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00c4 expref: 20872 pid: 16469 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.646971:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562158 00000100:00100000:0.0:1713481296.646972:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076afce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784480576:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.646974:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16477:18844:x1796714882402560:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.646980:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.646985:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929dba80/0xdfc0fb148a38a0e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e4f expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.646987:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b984d80 going to sleep for 11 seconds 00002000:00010000:2.0:1713481296.646993:0:16452:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.646998:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.646999:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.647001:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929dba80/0xdfc0fb148a38a0e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e4f expref: 16478 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647005:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820134 00010000:00010000:2.0:1713481296.647007:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929dba80/0xdfc0fb148a38a0e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e4f expref: 16478 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647010:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20873:1959:x1796714882402752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.647011:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929dba80, rc 0) 00010000:00010000:0.0:1713481296.647015:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.647019:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148802162 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96270e expref: 20873 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.647019:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16478:18844:x1796714882402560:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 45us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.647023:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562158 00010000:00010000:0.0:1713481296.647032:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148802162 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96270e expref: 20873 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.647050:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148802162 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96270e expref: 20873 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.647062:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647063:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647065:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647069:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647081:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.647086:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647090:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:1959:x1796714882402752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 80us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.647091:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647094:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820134 00010000:00010000:2.0:1713481296.647095:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647099:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647103:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647106:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801216e8240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.647108:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647112:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647134:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.647135:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647139:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801216e8240/0xdfc0fb148a388da lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647146:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402496 00000100:00100000:0.0:1713481296.647148:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402496 00010000:00010000:0.0:1713481296.647155:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008901ef40/0xdfc0fb1486889c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2815 expref: 26589 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.647164:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820135 00000100:00100000:0.0:1713481296.647166:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076afd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26589:1959:x1796714882402496:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.647171:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.647173:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008901ef40/0xdfc0fb1486889c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2815 expref: 26589 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.647178:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008901ef40/0xdfc0fb1486889c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2815 expref: 26589 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.647192:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008901ef40/0xdfc0fb1486889c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2815 expref: 26589 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.647201:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647202:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647204:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647210:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647226:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.647239:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076afd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26588:1959:x1796714882402496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.647245:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820135 00000100:00100000:2.0:1713481296.647256:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+81:3491:x1796714784478272:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6946us (6998us total) trans 4296040741 rc 0/0 00000100:00100000:2.0:1713481296.647261:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562136 00010000:00010000:0.0:1713481296.647269:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.647270:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083a97480/2, rc 0, transno 1073445 00010000:00010000:0.0:1713481296.647276:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.647277:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784478272:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.647287:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647293:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.647293:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120be0700/2, rc 0, transno 993339 00010000:00010000:0.0:1713481296.647300:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.647303:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784477696:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.647305:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135ad33c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.647309:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647315:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647327:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647333:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ad33c0/0xdfc0fb148a388c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.647335:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784480640:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.647348:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.647358:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.647361:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784480704:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.647370:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.647383:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784480640 00000100:00100000:2.0:1713481296.647385:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784480640 00000100:00100000:2.0:1713481296.647400:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784480704 00000100:00100000:2.0:1713481296.647401:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784480704 00000100:00100000:2.0:1713481296.647408:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562159 00000100:00100000:2.0:1713481296.647411:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2698:3492:x1796714784480640:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.647419:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43253 count 1 00010000:00010000:2.0:1713481296.647427:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647434:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880078281f80/0xdfc0fb148688a14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2869 expref: 26587 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.647438:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.647439:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.647441:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647452:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2698:3491:x1796714784477888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7532us (7565us total) trans 4295960636 rc 0/0 00010000:00010000:2.0:1713481296.647453:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880078281f80/0xdfc0fb148688a14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2869 expref: 26587 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.647458:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562133 00010000:00010000:2.0:1713481296.647460:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880078281f80/0xdfc0fb148688a14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2869 expref: 26587 pid: 16460 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.647461:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120093800/2, rc 0, transno 993340 00000100:00100000:3.0:1713481296.647467:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784477888:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.647469:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784480768:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.647483:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402688 00000100:00100000:2.0:1713481296.647485:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b984e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.647486:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402688 00000100:00100000:3.0:1713481296.647486:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.647491:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784480896:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.647497:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098786f40/0xdfc0fb1486889b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2807 expref: 26588 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.647507:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.647511:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402624 00000100:00100000:2.0:1713481296.647511:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402880 00000100:00100000:0.0:1713481296.647513:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402624 00000100:00100000:2.0:1713481296.647517:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402880 00010000:00010000:0.0:1713481296.647521:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086cd6f40/0xdfc0fb14880215b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962700 expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.647528:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784480896 00000100:00100000:2.0:1713481296.647530:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784480896 00000100:00100000:0.0:1713481296.647538:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820137 00000100:00100000:0.0:1713481296.647542:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:1958:x1796714882402624:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.647545:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562161 00010000:00010000:0.0:1713481296.647548:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.647550:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2698:3491:x1796714784480896:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.647552:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086cd6f40/0xdfc0fb14880215b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962700 expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00002000:00080000:2.0:1713481296.647559:0:15499:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43254 count 1 00010000:00010000:0.0:1713481296.647560:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086cd6f40/0xdfc0fb14880215b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962700 expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.647569:0:15499:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647578:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6f40/0xdfc0fb14880215b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962700 expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.647580:0:15499:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008901e1c0/0xdfc0fb148688a29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2877 expref: 26587 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.647586:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.647587:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647590:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.647590:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647592:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647594:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647601:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647604:0:15499:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008901e1c0/0xdfc0fb148688a29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2877 expref: 26587 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.647613:0:15499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008901e1c0/0xdfc0fb148688a29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2877 expref: 26587 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.647622:0:15499:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784480960:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.647627:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.647629:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647635:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.647637:0:15499:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800921f8f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.647640:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647643:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20871:1958:x1796714882402624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 100us (344us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.647643:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647648:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647649:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820137 00010000:00010000:2.0:1713481296.647649:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647652:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095d8b180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.647653:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647657:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647661:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647677:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647682:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d8b180/0xdfc0fb148a388d3 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647684:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647690:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647696:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647702:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b3b2ac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.647705:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647712:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647718:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.647726:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647732:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b3b2ac0/0xdfc0fb148a388cc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.647740:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.647754:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403136 00000100:00100000:0.0:1713481296.647757:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403136 00000100:00100000:0.0:1713481296.647774:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562162 00000100:00100000:0.0:1713481296.647779:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20871:15045:x1796714882403136:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.647781:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+82:3493:x1796714784477952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7704us (7758us total) trans 4296040742 rc 0/0 00010000:00010000:0.0:1713481296.647786:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.647786:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562135 00010000:00010000:0.0:1713481296.647797:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098121440/0xdfc0fb148a38a2a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e5d expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.647809:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.647812:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784478848:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.647818:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647820:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647824:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098121440/0xdfc0fb148a38a2a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e5d expref: 20872 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647828:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647832:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098121440/0xdfc0fb148a38a2a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e5d expref: 20872 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647839:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098121440, rc 0) 00000004:00080000:3.0:1713481296.647847:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072ac4000/2, rc 0, transno 1073446 00000100:00100000:3.0:1713481296.647851:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784477952:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.647853:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:15045:x1796714882403136:12345-192.168.202.24@tcp:101:dd.0 Request processed in 74us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.647856:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2699:3491:x1796714784477824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7861us (7924us total) trans 4295960637 rc 0/0 00000100:00100000:2.0:1713481296.647860:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562134 00000100:00100000:0.0:1713481296.647863:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562162 00000004:00080000:3.0:1713481296.647868:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c4b1f80/2, rc 0, transno 993341 00000100:00100000:3.0:1713481296.647872:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784477824:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.647886:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820138 00000100:00100000:0.0:1713481296.647890:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26588:1960:x1796714882403200:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.647890:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784478784:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.647896:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.647900:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008901f840/0xdfc0fb1486889ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2831 expref: 26588 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.647901:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820140 00010000:00010000:2.0:1713481296.647905:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.647905:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20872:1959:x1796714882403328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.647907:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008901f840/0xdfc0fb1486889ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2831 expref: 26588 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.647911:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.647915:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086cd6880/0xdfc0fb148802169 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96271c expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.647921:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008901f840/0xdfc0fb1486889ce lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2831 expref: 26588 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.647923:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086cd6880/0xdfc0fb148802169 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96271c expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.647927:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ddc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784478592:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.647930:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647931:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.647933:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647935:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.647939:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.647946:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882402944 00010000:00010000:3.0:1713481296.647946:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6880/0xdfc0fb148802169 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96271c expref: 20872 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.647948:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882402944 00010000:00010000:0.0:1713481296.647953:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.647958:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403072 00000100:00100000:2.0:1713481296.647960:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403072 00010000:00010000:3.0:1713481296.647961:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.647963:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26586:1960:x1796714882403200:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.647963:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.647966:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.647968:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485764 00000100:00100000:2.0:1713481296.647971:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2184:18922:x1796714882402944:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.647973:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.647979:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.647986:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0b2400/0xdfc0fb148a38a31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x51fb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e56 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.647992:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.648004:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0b2400/0xdfc0fb148a38a31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x51fb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e56 expref: 2185 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648008:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20871:1959:x1796714882403328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 101us (172us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.648010:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0b2400/0xdfc0fb148a38a31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x51fb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e56 expref: 2185 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648016:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820140 00010000:00010000:2.0:1713481296.648018:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51fb:0x0].0x0 (ffff88012f10b400) 00010000:00010000:2.0:1713481296.648020:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713481296.648021:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0b2400, rc 0) 00000100:00100000:2.0:1713481296.648031:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2185:18922:x1796714882402944:12345-192.168.202.24@tcp:101:touch.0 Request processed in 60us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.648035:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485764 00000100:00100000:3.0:1713481296.648041:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.648048:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784481024:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.648051:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648056:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820138 00010000:00010000:2.0:1713481296.648056:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648060:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648063:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648067:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648069:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.648070:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098c18d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.648071:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648075:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648083:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648088:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c18d80/0xdfc0fb148a38919 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.648103:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.648110:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.648138:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.648150:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648154:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784481024 00010000:00010000:3.0:1713481296.648156:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648158:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784481024 00010000:00010000:3.0:1713481296.648161:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f852640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.648163:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.648169:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648177:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562163 00000100:00100000:0.0:1713481296.648181:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2700:3490:x1796714784481024:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.648181:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.648187:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f852640/0xdfc0fb148a38920 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.648195:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2700:3490:x1796714784478656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5312us (5434us total) trans 4295960638 rc 0/0 00000100:00100000:2.0:1713481296.648199:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562140 00010000:00010000:2.0:1713481296.648217:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648221:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648226:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648230:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648233:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648236:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098c1ba80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.648238:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648242:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.648245:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43255 count 1 00010000:00010000:2.0:1713481296.648250:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648254:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ba80/0xdfc0fb148a38912 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.648257:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.648267:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008901e640/0xdfc0fb148688a30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2885 expref: 26584 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.648273:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.648274:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.648276:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.648291:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008901e640/0xdfc0fb148688a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2885 expref: 26584 pid: 16524 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.648308:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+82:3490:x1796714784478720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5409us (5476us total) trans 4296040743 rc 0/0 00000100:00100000:3.0:1713481296.648314:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562141 00000100:00100000:2.0:1713481296.648349:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ddc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2700:3493:x1796714784478528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5768us (5806us total) trans 4295960639 rc 0/0 00000100:00100000:2.0:1713481296.648353:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562139 00000004:00080000:3.0:1713481296.648361:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008493b800/2, rc 0, transno 1073447 00000100:00100000:3.0:1713481296.648365:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784478720:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713481296.648376:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008493a680/2, rc 0, transno 993342 00000100:00100000:2.0:1713481296.648380:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784479104:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.648383:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784478656:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.648389:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008901e640/0xdfc0fb148688a30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2885 expref: 26584 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.648399:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086aa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784481088:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.648399:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801236a2f40/0xdfc0fb148a3892e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648415:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d599c0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.648422:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ddc6a00/2, rc 0, transno 993343 00010000:00010000:2.0:1713481296.648428:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098336640/0xdfc0fb1486889d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d283f expref: 26584 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.648428:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ddc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784478528:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.648432:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.648439:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800796ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784478976:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.648439:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784481152:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.648461:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648462:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.648469:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648475:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648486:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648493:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648499:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648503:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784481216:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.648504:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098c18240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.648507:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648510:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784481152 00000100:00100000:0.0:1713481296.648514:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784481152 00010000:00010000:2.0:1713481296.648514:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648523:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.648526:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648530:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784481216 00000100:00100000:0.0:1713481296.648533:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784481216 00010000:00010000:2.0:1713481296.648533:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c18240/0xdfc0fb148a38927 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648551:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562164 00000100:00100000:3.0:1713481296.648556:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2701:3493:x1796714784481152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.648569:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43256 count 1 00010000:00010000:3.0:1713481296.648581:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.648592:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d5caf40/0xdfc0fb148688a45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2893 expref: 26583 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.648598:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.648600:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.648602:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562165 00010000:00010000:3.0:1713481296.648602:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648607:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2702:3493:x1796714784481216:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.648619:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d5caf40/0xdfc0fb148688a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2893 expref: 26583 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.648629:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d5caf40/0xdfc0fb148688a45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2893 expref: 26582 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.648645:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784481280:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.648652:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2702:3493:x1796714784478912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5612us (5645us total) trans 4295960640 rc 0/0 00000100:00100000:2.0:1713481296.648657:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562142 00000100:00100000:3.0:1713481296.648661:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c5d600 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.648709:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485766 00002000:00080000:0.0:1713481296.648712:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43257 count 1 00000100:00100000:2.0:1713481296.648712:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2010:18604:x1796714882402880:12345-192.168.202.24@tcp:36:rm.0 00000004:00080000:3.0:1713481296.648712:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083a3fb80/2, rc 0, transno 993344 00000100:00100000:3.0:1713481296.648719:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784478912:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.648722:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648726:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.648731:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d5c8480/0xdfc0fb148688a53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28a1 expref: 26582 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.648734:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985ecb40/0xdfc0fb148a3491d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45bfe expref: 2010 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.648737:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.648738:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.648741:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.648745:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713481296.648750:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347c:0x0].0x0 (ffff88012f1f4a00) 00000100:00100000:3.0:1713481296.648751:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784481344:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.648752:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.648761:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.648768:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713481296.648772:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.648774:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:2.0:1713481296.648798:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784481344 00000100:00100000:2.0:1713481296.648801:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784481344 00010000:00010000:0.0:1713481296.648802:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d5c8480/0xdfc0fb148688a53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28a1 expref: 26582 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.648810:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d5c8480/0xdfc0fb148688a53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28a1 expref: 26582 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.648817:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562166 00000100:00100000:0.0:1713481296.648819:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086aa0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784481408:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.648821:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2703:3491:x1796714784481344:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.648824:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800796ded80/2, rc 0, transno 993345 00000100:00100000:3.0:1713481296.648830:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800796ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784479040:0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.648832:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43258 count 1 00000100:00100000:0.0:1713481296.648833:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.648841:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.648851:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d5cbcc0/0xdfc0fb148688a61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28af expref: 26582 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.648857:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.648857:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784481472:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.648859:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.648861:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.648876:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.648878:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d5cbcc0/0xdfc0fb148688a61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28af expref: 26582 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.648886:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d5cbcc0/0xdfc0fb148688a61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28af expref: 26582 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.648895:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403584 00000100:00100000:3.0:1713481296.648895:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.648896:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784481536:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.648898:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403584 00000100:00100000:0.0:1713481296.648915:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784481472 00000100:00100000:2.0:1713481296.648915:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800921f8540 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.648917:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784481472 00000100:00100000:0.0:1713481296.648940:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562167 00000100:00100000:0.0:1713481296.648944:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26583:1958:x1796714882403584:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.648944:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562168 00000100:00100000:2.0:1713481296.648950:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2703:3491:x1796714784481472:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.648953:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.648962:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092841b00/0xdfc0fb148a38a77 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e6b expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.648962:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43259 count 1 00002000:00010000:0.0:1713481296.648972:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae6e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.648974:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.648979:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.648981:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.648983:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d5cba80/0xdfc0fb148688a6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28bd expref: 26584 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.648984:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092841b00/0xdfc0fb148a38a77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e6b expref: 26584 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.648988:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.648989:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.648992:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.648993:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092841b00/0xdfc0fb148a38a77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e6b expref: 26584 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.649000:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092841b00, rc 0) 00010000:00010000:2.0:1713481296.649005:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d5cba80/0xdfc0fb148688a6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28bd expref: 26584 pid: 16524 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.649011:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26584:1958:x1796714882403584:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.649016:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562167 00010000:00010000:2.0:1713481296.649018:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d5cba80/0xdfc0fb148688a6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28bd expref: 26584 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.649027:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784481600:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.649041:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f0c00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.649055:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bd440/0xdfc0fb148a38a85 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3474:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.649060:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bd440/0xdfc0fb148a38a85 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.649061:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.649065:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bd440/0xdfc0fb148a38a85 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.649072:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403648 00000100:00100000:0.0:1713481296.649075:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403648 00000100:00100000:0.0:1713481296.649086:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562169 00000100:00100000:0.0:1713481296.649090:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16478:1958:x1796714882403648:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.649093:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.649095:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.649096:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649100:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.649103:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092840b40/0xdfc0fb148a38a93 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9653:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e72 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.649113:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9653:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.649148:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.649149:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.649153:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092840b40/0xdfc0fb148a38a93 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e72 expref: 16479 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.649162:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092840b40/0xdfc0fb148a38a93 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e72 expref: 16479 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.649166:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092840b40, rc 0) 00000100:00100000:0.0:1713481296.649179:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16479:1958:x1796714882403648:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 88us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.649184:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562169 00000100:00100000:0.0:1713481296.649204:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403712 00000100:00100000:0.0:1713481296.649207:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403712 00000100:00100000:2.0:1713481296.649212:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403776 00000100:00100000:2.0:1713481296.649216:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403776 00000100:00100000:0.0:1713481296.649221:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403840 00000100:00100000:0.0:1713481296.649223:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403840 00000100:00100000:2.0:1713481296.649234:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562170 00000100:00100000:0.0:1713481296.649235:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403904 00000100:00100000:0.0:1713481296.649237:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403904 00000100:00100000:2.0:1713481296.649238:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26585:1958:x1796714882403712:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.649245:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.649247:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882403968 00000100:00100000:0.0:1713481296.649249:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882403968 00010000:00010000:2.0:1713481296.649256:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800834bf3c0/0xdfc0fb148a38a9a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e79 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.649261:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562171 00000100:00100000:0.0:1713481296.649265:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16480:1957:x1796714882403776:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.649268:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae6f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.649271:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.649277:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.649278:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.649281:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092841440/0xdfc0fb148a38aa1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9654:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e80 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.649282:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800834bf3c0/0xdfc0fb148a38a9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e79 expref: 26587 pid: 16525 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.649291:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9654:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.649291:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800834bf3c0/0xdfc0fb148a38a9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e79 expref: 26587 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.649298:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800834bf3c0, rc 0) 00010000:00010000:0.0:1713481296.649301:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.649303:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.649307:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092841440/0xdfc0fb148a38aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e80 expref: 16481 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.649314:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26587:1958:x1796714882403712:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.649316:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092841440/0xdfc0fb148a38aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e80 expref: 16481 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.649320:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562170 00010000:00010000:0.0:1713481296.649322:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092841440, rc 0) 00000100:00100000:0.0:1713481296.649334:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16481:1957:x1796714882403776:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.649338:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404032 00000100:00100000:0.0:1713481296.649339:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562171 00000100:00100000:2.0:1713481296.649340:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404032 00000100:00100000:0.0:1713481296.649356:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404096 00000100:00100000:2.0:1713481296.649356:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404160 00000100:00100000:0.0:1713481296.649357:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404096 00000100:00100000:2.0:1713481296.649358:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404160 00000100:00100000:0.0:1713481296.649383:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404224 00000100:00100000:2.0:1713481296.649383:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404288 00000100:00100000:0.0:1713481296.649384:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404224 00000100:00100000:2.0:1713481296.649385:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404288 00000100:00100000:2.0:1713481296.649402:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562173 00000100:00100000:0.0:1713481296.649406:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562174 00000100:00100000:2.0:1713481296.649407:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16483:1957:x1796714882403904:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.649410:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26588:1958:x1796714882403968:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.649413:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.649415:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.649423:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092840480/0xdfc0fb148a38ab6 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e95 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.649423:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800834bd8c0/0xdfc0fb148a38aaf lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9655:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e8e expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.649424:0:16474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562175 00000100:00100000:3.0:1713481296.649430:0:16474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16483:1957:x1796714882404032:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.649432:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae71:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.649435:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9655:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.649439:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.649439:0:16474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.649440:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.649443:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.649444:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092840480/0xdfc0fb148a38ab6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e95 expref: 26590 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.649445:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.649449:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800834bd8c0/0xdfc0fb148a38aaf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e8e expref: 16484 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.649451:0:16474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098787840/0xdfc0fb148a38abd lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9656:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47e9c expref: -99 pid: 16474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.649459:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800834bd8c0/0xdfc0fb148a38aaf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e8e expref: 16484 pid: 16525 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1713481296.649465:0:16474:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9656:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.649466:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800834bd8c0, rc 0) 00010000:00010000:3.0:1713481296.649477:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.649479:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.649480:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16485:1957:x1796714882403904:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (271us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.649484:0:16474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098787840/0xdfc0fb148a38abd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e9c expref: 16485 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.649486:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562173 00010000:00010000:3.0:1713481296.649495:0:16474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098787840/0xdfc0fb148a38abd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e9c expref: 16485 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.649502:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562176 00010000:00010000:3.0:1713481296.649503:0:16474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098787840, rc 0) 00000100:00100000:2.0:1713481296.649506:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26589:1957:x1796714882404096:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.649511:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.649518:0:16474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16484:1957:x1796714882404032:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 88us (231us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.649519:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800834bc000/0xdfc0fb148a38ac4 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ea3 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.649524:0:16474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562175 00002000:00010000:2.0:1713481296.649529:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae72:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.649536:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.649537:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.649541:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800834bc000/0xdfc0fb148a38ac4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ea3 expref: 26590 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.649548:0:16474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562178 00010000:00010000:2.0:1713481296.649550:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800834bc000/0xdfc0fb148a38ac4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ea3 expref: 26590 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.649552:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092840480/0xdfc0fb148a38ab6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e95 expref: 26590 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.649553:0:16474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16484:1958:x1796714882404288:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.649558:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800834bc000, rc 0) 00010000:00010000:3.0:1713481296.649560:0:16474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.649561:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092840480, rc 0) 00000100:00100000:2.0:1713481296.649568:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26590:1957:x1796714882404096:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.649569:0:16474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095e85d40/0xdfc0fb148a38ad2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9658:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47eb8 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.649572:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562176 00000100:00100000:0.0:1713481296.649576:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26590:1958:x1796714882403968:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 164us (358us total) trans 0 rc 0/0 00002000:00010000:3.0:1713481296.649580:0:16474:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9658:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.649582:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562174 00010000:00010000:3.0:1713481296.649589:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.649591:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.649594:0:16474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095e85d40/0xdfc0fb148a38ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47eb8 expref: 16484 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.649603:0:16474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095e85d40/0xdfc0fb148a38ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47eb8 expref: 16484 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.649611:0:16474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095e85d40, rc 0) 00000040:00080000:2.0:1713481296.649613:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3428, 64 off227584 00000100:00100000:3.0:1713481296.649625:0:16474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16484:1958:x1796714882404288:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.649631:0:16474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562178 00010000:00010000:2.0:1713481296.649637:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.649642:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649646:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649650:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649653:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649656:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649659:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649661:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834bfcc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.649663:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649679:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649684:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347c:0x0].0x0 (ffff88012f1f4a00) 00010000:00010000:2.0:1713481296.649686:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713481296.649687:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649690:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bfcc0/0xdfc0fb148a38ae0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x347c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713481296.649701:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404352 00000100:00100000:3.0:1713481296.649706:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404352 00010000:00010000:2.0:1713481296.649709:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649712:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649715:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649717:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834bcfc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.649719:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649721:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649725:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347c:0x0].0x0 (ffff88012f1f4a00) 00010000:00010000:2.0:1713481296.649726:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.649727:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649730:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bcfc0/0xdfc0fb148a38a8c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x347c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713481296.649736:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404416 00000100:00100000:0.0:1713481296.649737:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404480 00000100:00100000:3.0:1713481296.649738:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404416 00000100:00100000:3.0:1713481296.649752:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562180 00000100:00100000:3.0:1713481296.649758:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26589:1958:x1796714882404352:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.649765:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.649776:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801320b9d40/0xdfc0fb148a38ae7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ebf expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.649788:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae74:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.649791:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404480 00010000:00010000:3.0:1713481296.649797:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.649799:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.649803:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801320b9d40/0xdfc0fb148a38ae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ebf expref: 26591 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.649811:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.649812:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562182 00010000:00010000:3.0:1713481296.649813:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801320b9d40/0xdfc0fb148a38ae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ebf expref: 26591 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.649815:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.649816:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16486:1958:x1796714882404544:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.649818:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:3.0:1713481296.649820:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801320b9d40, rc 0) 00010000:00010000:2.0:1713481296.649821:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.649822:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.649823:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c0b06c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.649824:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.649827:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.649831:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092842ac0/0xdfc0fb148a38af5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x965a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ed4 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.649831:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:2.0:1713481296.649832:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.649833:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713481296.649835:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26591:1958:x1796714882404352:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 78us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.649836:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c0b06c0/0xdfc0fb148a38a54 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00002000:00010000:0.0:1713481296.649840:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x965a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.649841:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562180 00000004:00010000:2.0:1713481296.649846:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880079a43800 reply state ffff880134521000 transno 4295107563 ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bd440/0xdfc0fb148a38a85 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.649848:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.649849:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.649850:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800834bd440/0xdfc0fb148a38a85 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.649854:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092842ac0/0xdfc0fb148a38af5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ed4 expref: 16486 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.649854:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x3931 (ffff880091441300) 00010000:00010000:2.0:1713481296.649855:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.649857:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.649863:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092842ac0/0xdfc0fb148a38af5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ed4 expref: 16486 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.649871:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092842ac0, rc 0) 00000100:00100000:2.0:1713481296.649873:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2011:18604:x1796714882402880:12345-192.168.202.24@tcp:36:rm.0 Request processed in 1159us (2510us total) trans 4295107563 rc 0/0 00000100:00100000:2.0:1713481296.649877:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485766 00000100:00100000:3.0:1713481296.649925:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784481664:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.649936:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16486:1958:x1796714882404544:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 118us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.649936:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784481728:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.649942:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562182 00000100:00100000:3.0:1713481296.649954:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.649962:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784481664 00000100:00100000:0.0:1713481296.649964:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784481664 00000100:00100000:0.0:1713481296.649979:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562185 00000100:00100000:0.0:1713481296.649983:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16486:1957:x1796714882404672:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.649983:0:16464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562186 00000100:00100000:2.0:1713481296.649986:0:16464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:lustre-MDT0001-mdtlov_UUID+82:3492:x1796714784481664:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.649995:0:16464:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9908 count 1 00010000:00010000:2.0:1713481296.650004:0:16464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.650012:0:16464:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083348000/0xdfc0fb14880219a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96277e expref: 20870 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650015:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650016:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650018:0:16464:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.650028:0:16464:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083348000/0xdfc0fb14880219a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96277e expref: 20870 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.650033:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.650033:0:16464:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083348000/0xdfc0fb14880219a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96277e expref: 20870 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.650040:0:16464:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_036:lustre-OST0000_UUID:16464:1796714784481792:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.650042:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133c7f3c0/0xdfc0fb148a38b11 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x965b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ee2 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.650050:0:16464:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084ba6d80 going to sleep for 11 seconds 00002000:00010000:0.0:1713481296.650052:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x965b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.650059:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.650060:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.650063:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.650064:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133c7f3c0/0xdfc0fb148a38b11 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ee2 expref: 16488 pid: 16528 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.650086:0:16474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562187 00000100:00100000:3.0:1713481296.650093:0:16474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26592:1958:x1796714882404736:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.650104:0:16474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.650116:0:16474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801320bb3c0/0xdfc0fb148a38b1f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ee9 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.650135:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133c7f3c0/0xdfc0fb148a38b11 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ee2 expref: 16488 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.650146:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133c7f3c0, rc 0) 00000100:00100000:0.0:1713481296.650158:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16489:1957:x1796714882404672:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 174us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.650159:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562189 00002000:00010000:3.0:1713481296.650159:0:16474:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae77:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.650162:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562185 00000100:00100000:2.0:1713481296.650163:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0001-mdtlov_UUID+83:3493:x1796714784481728:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.650169:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.650170:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713481296.650171:0:16548:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9909 count 1 00010000:00010000:3.0:1713481296.650175:0:16474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801320bb3c0/0xdfc0fb148a38b1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ee9 expref: 26593 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650179:0:16548:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.650185:0:16548:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086cd5d40/0xdfc0fb1488021a1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96278c expref: 20870 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.650185:0:16474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801320bb3c0/0xdfc0fb148a38b1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ee9 expref: 26593 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650189:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650190:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650192:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.650193:0:16474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801320bb3c0, rc 0) 00010000:00010000:2.0:1713481296.650201:0:16548:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086cd5d40/0xdfc0fb1488021a1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96278c expref: 20870 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650206:0:16548:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086cd5d40/0xdfc0fb1488021a1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96278c expref: 20870 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.650208:0:16474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26593:1958:x1796714882404736:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 116us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.650211:0:16548:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0000_UUID:16548:1796714784481856:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.650215:0:16474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562187 00000100:00100000:2.0:1713481296.650223:0:16548:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.650273:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404864 00000100:00100000:2.0:1713481296.650275:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404864 00000100:00100000:2.0:1713481296.650287:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562190 00000100:00100000:2.0:1713481296.650289:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26593:1957:x1796714882404864:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.650295:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.650303:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120f14b40/0xdfc0fb148a38b2d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47ef7 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.650310:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae78:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.650317:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650318:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650320:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120f14b40/0xdfc0fb148a38b2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ef7 expref: 26594 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650326:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120f14b40/0xdfc0fb148a38b2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ef7 expref: 26594 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650331:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120f14b40, rc 0) 00000100:00100000:3.0:1713481296.650351:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404928 00000100:00100000:3.0:1713481296.650355:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404928 00000100:00100000:3.0:1713481296.650373:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882404992 00000100:00100000:3.0:1713481296.650375:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882404992 00000100:00100000:3.0:1713481296.650387:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562191 00000100:00100000:3.0:1713481296.650392:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16488:1958:x1796714882404928:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.650398:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.650409:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801320b98c0/0xdfc0fb148a38b34 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x965d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47efe expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.650426:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x965d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.650434:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26595:1957:x1796714882404864:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 143us (176us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.650435:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.650437:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.650438:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562190 00010000:00010000:3.0:1713481296.650442:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801320b98c0/0xdfc0fb148a38b34 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47efe expref: 16489 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.650451:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562192 00010000:00010000:3.0:1713481296.650452:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801320b98c0/0xdfc0fb148a38b34 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47efe expref: 16489 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.650455:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26594:1957:x1796714882404992:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.650457:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.650458:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.650459:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801320b98c0, rc 0) 00010000:00010000:2.0:1713481296.650464:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120f14480/0xdfc0fb148a38b3b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f05 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.650470:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae79:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.650476:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650477:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.650478:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16489:1958:x1796714882404928:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 86us (192us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.650479:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120f14480/0xdfc0fb148a38b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f05 expref: 26595 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650485:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120f14480/0xdfc0fb148a38b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f05 expref: 26595 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.650485:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562191 00010000:00010000:2.0:1713481296.650489:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120f14480, rc 0) 00000100:00100000:2.0:1713481296.650497:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26595:1957:x1796714882404992:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.650500:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405056 00000100:00100000:2.0:1713481296.650501:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562192 00000100:00100000:3.0:1713481296.650503:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405056 00000100:00100000:2.0:1713481296.650513:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562193 00000100:00100000:2.0:1713481296.650516:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16489:1957:x1796714882405056:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.650520:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.650526:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120f17600/0xdfc0fb148a38b42 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x965e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f0c expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.650532:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x965e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.650533:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405120 00000100:00100000:3.0:1713481296.650536:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405120 00010000:00010000:2.0:1713481296.650537:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650537:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650540:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120f17600/0xdfc0fb148a38b42 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f0c expref: 16490 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650545:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120f17600/0xdfc0fb148a38b42 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f0c expref: 16490 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650549:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120f17600, rc 0) 00000100:00100000:3.0:1713481296.650553:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562194 00000100:00100000:0.0:1713481296.650556:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.650557:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16491:1957:x1796714882405056:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.650558:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26595:1958:x1796714882405120:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.650562:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562193 00010000:00010000:3.0:1713481296.650566:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.650577:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562195 00010000:00010000:3.0:1713481296.650577:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801320bad00/0xdfc0fb148a38b49 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f13 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.650581:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16490:1957:x1796714882405184:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.650588:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1713481296.650589:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae7a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.650596:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120f173c0/0xdfc0fb148a38b50 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x965f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f1a expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.650597:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.650599:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.650604:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801320bad00/0xdfc0fb148a38b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f13 expref: 26597 pid: 15507 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.650605:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.650607:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x965f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.650614:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801320bad00/0xdfc0fb148a38b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f13 expref: 26598 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650615:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650616:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650621:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120f173c0/0xdfc0fb148a38b50 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f1a expref: 16491 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.650622:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801320bad00, rc 0) 00000100:00100000:0.0:1713481296.650624:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405312 00000100:00100000:0.0:1713481296.650627:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405312 00010000:00010000:2.0:1713481296.650630:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120f173c0/0xdfc0fb148a38b50 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x965f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f1a expref: 16492 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650637:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120f173c0, rc 0) 00000100:00100000:3.0:1713481296.650638:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26598:1958:x1796714882405120:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 79us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.650645:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562197 00000100:00100000:0.0:1713481296.650649:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16492:1958:x1796714882405312:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.650654:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562194 00000100:00100000:2.0:1713481296.650655:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16492:1957:x1796714882405184:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (115us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.650657:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.650660:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562195 00010000:00010000:0.0:1713481296.650683:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b3b2880/0xdfc0fb148a38b5e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9660:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f28 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.650696:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9660:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.650704:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.650705:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882407744 00010000:00010000:0.0:1713481296.650706:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.650708:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882407744 00010000:00010000:0.0:1713481296.650710:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b3b2880/0xdfc0fb148a38b5e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f28 expref: 16492 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.650719:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b3b2880/0xdfc0fb148a38b5e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f28 expref: 16492 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.650727:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b3b2880, rc 0) 00000100:00100000:3.0:1713481296.650727:0:16474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405376 00000100:00100000:3.0:1713481296.650731:0:16474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405376 00000100:00100000:2.0:1713481296.650734:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485768 00000100:00100000:2.0:1713481296.650739:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2185:18578:x1796714882407744:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:0.0:1713481296.650741:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16492:1958:x1796714882405312:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 91us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.650747:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562197 00000100:00100000:3.0:1713481296.650757:0:16474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562198 00000100:00100000:2.0:1713481296.650762:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405440 00000100:00100000:3.0:1713481296.650763:0:16474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26597:1957:x1796714882405376:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.650764:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405440 00000100:00100000:0.0:1713481296.650769:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405504 00010000:00010000:3.0:1713481296.650770:0:16474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.650771:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405504 00000100:00100000:2.0:1713481296.650781:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562199 00010000:00010000:3.0:1713481296.650781:0:16474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fea8240/0xdfc0fb148a38b65 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f2f expref: -99 pid: 16474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.650785:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16492:1958:x1796714882405440:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.650786:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405568 00000100:00100000:0.0:1713481296.650788:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405568 00010000:00010000:2.0:1713481296.650792:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1713481296.650793:0:16474:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae7c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.650802:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120f15f80/0xdfc0fb148a38b6c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9661:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f36 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.650803:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.650805:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.650808:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405632 00010000:00010000:3.0:1713481296.650809:0:16474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fea8240/0xdfc0fb148a38b65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f2f expref: 26599 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.650811:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405632 00002000:00010000:2.0:1713481296.650813:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9661:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.650819:0:16474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fea8240/0xdfc0fb148a38b65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f2f expref: 26600 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.650822:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.650824:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562201 00010000:00010000:2.0:1713481296.650824:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.650828:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120f15f80/0xdfc0fb148a38b6c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f36 expref: 16494 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.650829:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16494:1958:x1796714882405568:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.650833:0:16474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fea8240, rc 0) 00010000:00010000:0.0:1713481296.650835:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.650837:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120f15f80/0xdfc0fb148a38b6c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f36 expref: 16494 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.650844:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b3b06c0/0xdfc0fb148a38b7a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9662:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f44 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.650844:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120f15f80, rc 0) 00000100:00100000:3.0:1713481296.650849:0:16474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26600:1957:x1796714882405376:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 86us (140us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.650855:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9662:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.650856:0:16474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562198 00000100:00100000:2.0:1713481296.650860:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16494:1958:x1796714882405440:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.650864:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.650865:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.650866:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562199 00010000:00010000:0.0:1713481296.650869:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b3b06c0/0xdfc0fb148a38b7a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f44 expref: 16495 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.650875:0:16474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562202 00010000:00010000:0.0:1713481296.650879:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b3b06c0/0xdfc0fb148a38b7a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f44 expref: 16494 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.650881:0:16474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26600:1957:x1796714882405632:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.650886:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b3b06c0, rc 0) 00010000:00010000:3.0:1713481296.650888:0:16474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.650890:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.650898:0:16474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fea9f80/0xdfc0fb148a38b81 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f4b expref: -99 pid: 16474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.650900:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16494:1958:x1796714882405568:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (121us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.650900:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3b58c0/0xdfc0fb148a38b88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f9f expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.650906:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562201 00002000:00010000:3.0:1713481296.650909:0:16474:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae7e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.650919:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.650921:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.650925:0:16474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fea9f80/0xdfc0fb148a38b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f4b expref: 26600 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.650935:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405696 00010000:00010000:3.0:1713481296.650935:0:16474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fea9f80/0xdfc0fb148a38b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f4b expref: 26600 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.650939:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405696 00010000:00010000:3.0:1713481296.650943:0:16474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fea9f80, rc 0) 00000100:00100000:0.0:1713481296.650952:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405760 00000100:00100000:0.0:1713481296.650954:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405760 00000100:00100000:3.0:1713481296.650959:0:16474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26601:1957:x1796714882405632:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.650966:0:16474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562202 00010000:00010000:2.0:1713481296.650967:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3b46c0/0xdfc0fb148a38b8f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.650972:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562203 00010000:00010000:2.0:1713481296.650975:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3b46c0/0xdfc0fb148a38b8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.650978:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16494:1957:x1796714882405696:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.650982:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3b46c0/0xdfc0fb148a38b8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.650984:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1713481296.650989:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385e:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.650993:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086f15b00/0xdfc0fb148a38b96 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9663:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f52 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.651002:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9663:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.651009:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.651010:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.651014:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086f15b00/0xdfc0fb148a38b96 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f52 expref: 16495 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.651022:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086f15b00/0xdfc0fb148a38b96 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f52 expref: 16495 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.651028:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086f15b00, rc 0) 00000100:00100000:0.0:1713481296.651039:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16495:1957:x1796714882405696:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.651044:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562203 00010000:00010000:2.0:1713481296.651051:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3b58c0/0xdfc0fb148a38b88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f9f expref: 2188 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651065:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3b46c0/0xdfc0fb148a38b8f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f9f expref: 2187 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651071:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x0 (ffff8800897e3f00) 00010000:00010000:2.0:1713481296.651074:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1713481296.651075:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.651076:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3b46c0, rc 0) 00000100:00100000:2.0:1713481296.651091:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2187:18578:x1796714882407744:12345-192.168.202.24@tcp:101:rm.0 Request processed in 351us (615us total) trans 4295105896 rc 0/0 00000100:00100000:2.0:1713481296.651096:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485768 00000100:00100000:0.0:1713481296.651117:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562205 00000100:00100000:0.0:1713481296.651138:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16495:1957:x1796714882405824:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.651146:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.651156:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce81680/0xdfc0fb148a38bab lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9664:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f60 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.651167:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9664:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.651175:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.651177:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.651181:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce81680/0xdfc0fb148a38bab lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f60 expref: 16496 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.651189:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ce81680/0xdfc0fb148a38bab lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f60 expref: 16496 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.651200:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce81680, rc 0) 00000100:00100000:0.0:1713481296.651212:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16496:1957:x1796714882405824:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 74us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.651216:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562205 00000100:00100000:0.0:1713481296.651230:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405888 00000100:00100000:0.0:1713481296.651232:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405888 00000100:00100000:0.0:1713481296.651244:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562206 00000100:00100000:2.0:1713481296.651245:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078411180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784479360:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.651247:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26601:17935:x1796714882405888:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.651252:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.651260:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800978c1200/0xdfc0fb148a38bb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb78d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f67 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651265:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e13f600/0xdfc0fb148a3895f lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8058:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e02 expref: 16495 pid: 16523 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.651269:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb78d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.651272:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e13f600, rc 0) 00010000:00010000:0.0:1713481296.651275:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.651276:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.651280:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978c1200/0xdfc0fb148a38bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f67 expref: 26602 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.651282:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16495:18836:x1796714882400896:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6981us (7038us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.651286:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562147 00010000:00010000:0.0:1713481296.651287:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800978c1200/0xdfc0fb148a38bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f67 expref: 26602 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.651293:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800978c1200, rc 0) 00000100:00100000:0.0:1713481296.651303:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26602:17935:x1796714882405888:12345-192.168.202.24@tcp:101:dd.0 Request processed in 55us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.651308:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562206 00000100:00100000:3.0:1713481296.651317:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784479424:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.651339:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.651359:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c5ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784479680:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.651381:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.651414:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.651454:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.651468:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.651483:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882406016 00000100:00100000:0.0:1713481296.651486:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882406016 00010000:00010000:0.0:1713481296.651497:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008370d200/0xdfc0fb14891ca20 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8058:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c9f59 expref: 20872 pid: 16495 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.651514:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882405952 00000100:00100000:0.0:1713481296.651516:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882405952 00010000:00010000:0.0:1713481296.651524:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac2d00/0xdfc0fb148802170 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96272a expref: 20873 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.651547:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820144 00000100:00100000:0.0:1713481296.651552:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16494:1959:x1796714882406144:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.651558:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.651564:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820145 00000100:00100000:2.0:1713481296.651569:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20873:1959:x1796714882405952:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.651570:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880078c25f80/0xdfc0fb148959b09 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb91 expref: 16494 pid: 16496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.651576:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.651578:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880078c25f80/0xdfc0fb148959b09 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb91 expref: 16494 pid: 16496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.651579:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122ac2d00/0xdfc0fb148802170 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96272a expref: 20873 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.651585:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122ac2d00/0xdfc0fb148802170 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96272a expref: 20873 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.651593:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880078c25f80/0xdfc0fb148959b09 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeb91 expref: 16494 pid: 16496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.651602:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122ac2d00/0xdfc0fb148802170 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96272a expref: 20872 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.651608:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.651610:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.651610:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.651611:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.651613:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.651614:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135ad06c0/0xdfc0fb148a38974 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e17 expref: 16493 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651618:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.651621:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ad06c0/0xdfc0fb148a38974 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e17 expref: 16493 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651631:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.651638:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135ad06c0/0xdfc0fb148a38974 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e17 expref: 16493 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.651641:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20871:1959:x1796714882405952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.651644:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820145 00000100:00100000:0.0:1713481296.651647:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007727ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784481984:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.651660:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.651663:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fc000 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.651679:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651687:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651691:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651695:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651698:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135ad0d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.651700:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651704:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.651705:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.651711:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.651715:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ad0d80/0xdfc0fb148a38958 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.651763:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784480128:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.651784:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.651797:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20870:1960:x1796714882401024:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6262us (6405us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.651803:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820128 00010000:00010000:3.0:1713481296.651823:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.651831:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.651840:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.651848:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.651855:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.651861:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800906561c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.651864:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.651870:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784479936:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.651871:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.651885:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+84:3490:x1796714784479168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7735us (7783us total) trans 4296040744 rc 0/0 00010000:00010000:3.0:1713481296.651885:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.651886:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.651892:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562145 00010000:00010000:3.0:1713481296.651897:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800906561c0/0xdfc0fb148a38966 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.651898:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20868:1960:x1796714882401088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6545us (6692us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.651904:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820126 00000004:00080000:2.0:1713481296.651929:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007dafd180/2, rc 0, transno 1073448 00000100:00100000:0.0:1713481296.651938:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.651938:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784479168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.651968:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.651974:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784482048:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.651984:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.651996:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.652013:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.652023:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784482048 00000100:00100000:2.0:1713481296.652026:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784482048 00000100:00100000:3.0:1713481296.652036:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+85:3491:x1796714784479296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7738us (7793us total) trans 4296040745 rc 0/0 00000100:00100000:2.0:1713481296.652039:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882406720 00000100:00100000:2.0:1713481296.652040:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882406720 00000100:00100000:3.0:1713481296.652044:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562146 00000100:00100000:0.0:1713481296.652048:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.652053:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562208 00000100:00100000:2.0:1713481296.652057:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+84:3490:x1796714784482048:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.652060:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.652068:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882406848 00002000:00080000:2.0:1713481296.652069:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9910 count 1 00000100:00100000:0.0:1713481296.652071:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882406848 00010000:00010000:2.0:1713481296.652079:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.652086:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98344 00010000:00010000:2.0:1713481296.652089:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800833486c0/0xdfc0fb1488021a8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96279a expref: 20867 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.652090:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007727ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:1957:x1796714882406848:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:2.0:1713481296.652096:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.652097:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.652097:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.652099:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652105:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124b4b3c0/0xdfc0fb148a3884e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x51a6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47dae expref: 2793 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.652115:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800833486c0/0xdfc0fb1488021a8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96279a expref: 20867 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.652135:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff880084371e00) 00010000:00010000:0.0:1713481296.652142:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.652149:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800833486c0/0xdfc0fb1488021a8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96279a expref: 20867 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.652153:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:1957:x1796714882406848:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 62us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.652158:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98344 00000100:00100000:2.0:1713481296.652158:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078411180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784482112:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.652171:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.652184:0:16508:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562209 00000100:00100000:0.0:1713481296.652187:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.652187:0:16508:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:17924:x1796714882406720:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.652192:0:16508:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.652201:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882407168 00010000:00010000:2.0:1713481296.652201:0:16508:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3b7180/0xdfc0fb148a38be3 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f7c expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.652204:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882407168 00010000:00010000:0.0:1713481296.652213:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008901f3c0/0xdfc0fb148688a0d lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d285b expref: 26602 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.652215:0:16508:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120fd86c0/0xdfc0fb148a16249 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39805 expref: 24477 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.652220:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.652222:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.652225:0:16508:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3b7180/0xdfc0fb148a38be3 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f7c expref: 24477 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.652228:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820147 00000100:00100000:0.0:1713481296.652232:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007727f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26602:1958:x1796714882407168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.652240:0:16508:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120fd86c0/0xdfc0fb148a16249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39805 expref: 24477 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.652242:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.652246:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008901f3c0/0xdfc0fb148688a0d lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d285b expref: 26602 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.652248:0:16508:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120fd86c0/0xdfc0fb148a16249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39805 expref: 24477 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.652256:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008901f3c0/0xdfc0fb148688a0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d285b expref: 26602 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.652256:0:16508:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800796de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16508:1796714784482240:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.652269:0:16508:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b9840c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.652271:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.652272:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.652275:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083a7b3c0/0xdfc0fb148a389f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652281:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a7b3c0/0xdfc0fb148a389f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.652284:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882406528 00000100:00100000:2.0:1713481296.652287:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882406528 00010000:00010000:0.0:1713481296.652291:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.652302:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26602:1958:x1796714882407168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.652306:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820147 00000100:00100000:2.0:1713481296.652307:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882406592 00000100:00100000:2.0:1713481296.652310:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882406592 00000100:00100000:2.0:1713481296.652320:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485769 00000100:00100000:2.0:1713481296.652323:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18867:x1796714882406528:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:2.0:1713481296.652328:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.652335:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.652335:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009418d200/0xdfc0fb148a38bea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f75 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.652351:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.652383:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882407296 00000100:00100000:0.0:1713481296.652387:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.652387:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882407296 00000100:00100000:0.0:1713481296.652393:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882406272 00000100:00100000:0.0:1713481296.652396:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882406272 00010000:00010000:2.0:1713481296.652397:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.652402:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652406:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.652408:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882406784 00000100:00100000:0.0:1713481296.652409:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882406784 00000100:00100000:3.0:1713481296.652409:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562210 00010000:00010000:2.0:1713481296.652410:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652413:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000100:00100000:3.0:1713481296.652414:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26602:18817:x1796714882407296:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.652415:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac1b00/0xdfc0fb148802185 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962754 expref: 20867 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.652416:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652419:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009418df80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.652421:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.652422:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.652424:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652428:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff88008804c600) 00010000:00010000:2.0:1713481296.652429:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00000100:00100000:0.0:1713481296.652431:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820148 00010000:00010000:2.0:1713481296.652431:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.652433:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880089419b00/0xdfc0fb148a38bf8 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f83 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.652434:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009418df80/0xdfc0fb148a38bf1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.652435:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20867:1960:x1796714882406784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.652440:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.652443:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122ac1b00/0xdfc0fb148802185 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962754 expref: 20867 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.652448:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f998480/0xdfc0fb1489cf576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2206d expref: 24477 pid: 16505 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652450:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122ac1b00/0xdfc0fb148802185 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962754 expref: 20867 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.652455:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.652457:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.652460:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880089419b00/0xdfc0fb148a38bf8 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f83 expref: 26603 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652467:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122ac1b00/0xdfc0fb148802185 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962754 expref: 20867 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.652468:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009418d200/0xdfc0fb148a38bea lrc: 1/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f75 expref: 2371 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.652472:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009418d200/0xdfc0fb148a38bea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f75 expref: 2371 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.652478:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f998480/0xdfc0fb1489cf576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2206d expref: 24477 pid: 16505 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652479:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.652480:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.652480:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418d200, rc 0) 00010000:00010000:0.0:1713481296.652482:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652487:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.652487:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f998480/0xdfc0fb1489cf576 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2206d expref: 24477 pid: 16505 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.652491:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18867:x1796714882406528:12345-192.168.202.24@tcp:101:touch.0 Request processed in 167us (524us total) trans 0 rc 301/301 00010000:00010000:0.0:1713481296.652496:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.652496:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485769 00000100:00100000:3.0:1713481296.652497:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784482304:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.652506:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20866:1960:x1796714882406784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 71us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.652508:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485770 00000100:00100000:0.0:1713481296.652510:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820148 00000100:00100000:2.0:1713481296.652511:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18729:x1796714882406592:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:3.0:1713481296.652515:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.652522:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98345 00010000:00010000:2.0:1713481296.652523:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:0.0:1713481296.652524:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2187:1960:x1796714882406272:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:0.0:1713481296.652528:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713481296.652530:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007dd958c0/0xdfc0fb148a384b9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3480:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cdc expref: 2369 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652535:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968c9680/0xdfc0fb148a38982 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e10 expref: 2187 pid: 15475 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.652541:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a367800/2, rc 0, transno 1073449 00010000:00010000:2.0:1713481296.652546:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a146f40/0xdfc0fb148a0b95b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3480:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa356c7 expref: 2368 pid: 15545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.652546:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784479296:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.652553:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800986aa1c0/0xdfc0fb148a2cd07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42142 expref: 2186 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.652557:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3480:0x0].0x0 (ffff880078e52900) 00010000:00010000:0.0:1713481296.652570:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88007da00600) 00010000:00010000:2.0:1713481296.652570:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073731d40/0xdfc0fb148a3809f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b5b expref: 2367 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652573:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.652583:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00000100:00100000:0.0:1713481296.652585:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2185:1960:x1796714882406272:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 59us (233us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.652585:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.652591:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98345 00010000:00010000:2.0:1713481296.652591:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.652595:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652599:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652605:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133a598c0/0xdfc0fb148a38c29 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x347f:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.652608:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133a598c0/0xdfc0fb148a38c29 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652611:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133a598c0/0xdfc0fb148a38c29 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.652613:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652620:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.652635:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.652639:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652643:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.652732:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652738:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652744:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652754:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013596a640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.652756:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652762:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713481296.652769:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3480:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.652773:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.652778:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013596a640/0xdfc0fb148a389a5 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.652778:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652787:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652792:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652797:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a415200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.652799:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652805:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652812:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3480:0x0].0x0 (ffff88007aaaf200) 00010000:00010000:2.0:1713481296.652814:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.652817:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652822:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a415200/0xdfc0fb148a38c30 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652879:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652885:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652890:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652895:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652899:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009418e640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.652902:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652908:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652914:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:2.0:1713481296.652916:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.652918:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652923:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009418e640/0xdfc0fb148a38c22 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.652928:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+85:3493:x1796714784479616:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8119us (8175us total) trans 4296040746 rc 0/0 00000004:00010000:2.0:1713481296.652931:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007727e680 reply state ffff88009cc6b000 transno 4295107564 ns: mdt-lustre-MDT0001_UUID lock: ffff880133a598c0/0xdfc0fb148a38c29 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.652934:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562151 00010000:00010000:2.0:1713481296.652938:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133a598c0/0xdfc0fb148a38c29 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.652943:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x3031 (ffff88007aaaf900) 00010000:00010000:2.0:1713481296.652945:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.652946:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1713481296.652963:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800728ee680/2, rc 0, transno 993346 00000100:00100000:2.0:1713481296.652964:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:18729:x1796714882406592:12345-192.168.202.24@tcp:36:rm.0 Request processed in 451us (979us total) trans 4295107564 rc 0/0 00000100:00100000:2.0:1713481296.652969:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485770 00000100:00100000:3.0:1713481296.652972:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784480256:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.652973:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d5e680/2, rc 0, transno 1073450 00000100:00100000:0.0:1713481296.652978:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784479616:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.652994:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882407104 00000100:00100000:0.0:1713481296.652997:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882407104 00010000:00010000:0.0:1713481296.653007:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008306e640/0xdfc0fb148a13df2 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc174:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f5b expref: 20865 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.653009:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784482432:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.653033:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820149 00000100:00100000:3.0:1713481296.653033:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.653037:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4018c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20865:1960:x1796714882407104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.653046:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.653056:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008306e640/0xdfc0fb148a13df2 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc174:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f5b expref: 20865 pid: 16480 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.653064:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008306e640/0xdfc0fb148a13df2 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc174:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f5b expref: 20865 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.653072:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413184 00000100:00100000:2.0:1713481296.653074:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413184 00010000:00010000:0.0:1713481296.653083:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008306e640/0xdfc0fb148a13df2 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc174:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f5b expref: 20865 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.653086:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485771 00000100:00100000:2.0:1713481296.653089:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18934:x1796714882413184:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:2.0:1713481296.653094:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.653095:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.653096:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.653096:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1713481296.653100:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ff86c0/0xdfc0fb148a389ba lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc174:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e2c expref: 20864 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.653104:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c230fc0/0xdfc0fb148a38832 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47da0 expref: 2792 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653107:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ff86c0/0xdfc0fb148a389ba lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc174:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e2c expref: 20864 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.653115:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff880098564000) 00010000:00010000:2.0:1713481296.653116:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.653137:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4161c0/0xdfc0fb148a38c3e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa481dd expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653143:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ff86c0/0xdfc0fb148a389ba lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc174:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e2c expref: 20864 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.653153:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120be3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784482496:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.653169:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.653196:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000001:00080000:3.0:1713481296.653197:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040731 00010000:00010000:2.0:1713481296.653202:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653210:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653217:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.653218:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.653227:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x3866:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653233:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.653235:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820150 00010000:00010000:2.0:1713481296.653238:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.653240:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20865:1960:x1796714882406656:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.653246:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.653251:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086cd4480/0xdfc0fb14880217e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962746 expref: 20865 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.653260:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086cd4480/0xdfc0fb14880217e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962746 expref: 20865 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.653273:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086cd4480/0xdfc0fb14880217e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962746 expref: 20865 pid: 16538 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.653285:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 55506 00010000:00010000:0.0:1713481296.653287:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.653289:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.653292:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653299:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653314:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.653327:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20864:1960:x1796714882406656:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 87us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.653333:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820150 00010000:00010000:0.0:1713481296.653358:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653366:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653373:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653379:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653385:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653391:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134fda640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.653394:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653400:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653413:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653419:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fda640/0xdfc0fb148a3899e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.653421:0:15642:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000407:0xd900:0x0], index 0: 0 00010000:00010000:2.0:1713481296.653511:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219f840/0xdfc0fb148a38c53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x522e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653518:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008219f840/0xdfc0fb148a38c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x522e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653525:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008219f840/0xdfc0fb148a38c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x522e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653546:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.653552:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+86:3492:x1796714784479552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8750us (8867us total) trans 4296040748 rc 0/0 00010000:00010000:2.0:1713481296.653552:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653557:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.653559:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562150 00010000:00010000:2.0:1713481296.653562:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00000004:00080000:3.0:1713481296.653565:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d5fb80/2, rc 0, transno 1073452 00010000:00010000:2.0:1713481296.653566:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008219eac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.653569:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00000100:00100000:3.0:1713481296.653571:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784479552:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.653574:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653580:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff880098564000) 00010000:00010000:2.0:1713481296.653583:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.653585:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653590:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008219eac0/0xdfc0fb148a38c45 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00000004:00010000:2.0:1713481296.653601:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007684df80 reply state ffff880076b10000 transno 4295105897 ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.653608:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.653609:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076afdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784480512:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.653617:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x35 (ffff88007aaaf600) 00010000:00010000:2.0:1713481296.653619:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.653621:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.653624:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.653643:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4161c0/0xdfc0fb148a38c3e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x3866:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481dd expref: 2793 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.653646:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.653659:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219f840/0xdfc0fb148a38c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x522e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481dd expref: 2792 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.653660:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.653677:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x522e:0x0].0x0 (ffff88007aaaf800) 00010000:00010000:2.0:1713481296.653680:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713481296.653682:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008219f840, rc 0) 00000100:00100000:0.0:1713481296.653683:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882407552 00000100:00100000:0.0:1713481296.653685:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882407552 00000100:00100000:0.0:1713481296.653697:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882407616 00000100:00100000:0.0:1713481296.653698:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882407616 00000100:00100000:2.0:1713481296.653698:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18934:x1796714882413184:12345-192.168.202.24@tcp:101:touch.0 Request processed in 607us (664us total) trans 4295105897 rc 0/0 00000100:00100000:2.0:1713481296.653702:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485771 00000100:00100000:0.0:1713481296.653708:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562213 00000100:00100000:0.0:1713481296.653713:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10479:x1796714882407552:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.653719:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.653725:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784482368 00010000:00010000:0.0:1713481296.653726:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012024cb40/0xdfc0fb148a38c68 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47f91 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.653727:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784482368 00010000:00010000:0.0:1713481296.653736:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dd17a80/0xdfc0fb148916d6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6553 expref: 24480 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.653740:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.653741:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.653743:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82880 00010000:00010000:0.0:1713481296.653744:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012024cb40/0xdfc0fb148a38c68 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f91 expref: 24480 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.653746:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:15512:x1796714784482368:12345-0@lo:101:mdt_io00_007.0 00010000:00010000:2.0:1713481296.653751:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.653753:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dd17a80/0xdfc0fb148916d6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6553 expref: 24480 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.653758:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dd17a80/0xdfc0fb148916d6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6553 expref: 24480 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.653759:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c6c0/0xdfc0fb148a38c76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a38c1b expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.653767:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784482816:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.653769:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c6c0/0xdfc0fb148a38c76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a38c1b expref: 11 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.653774:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c6c0/0xdfc0fb148a38c76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51a6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a38c1b expref: 11 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.653779:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fc300 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.653781:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51a6:0x0].0x0 (ffff880091936200) 00010000:00010000:2.0:1713481296.653782:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1713481296.653784:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008219c6c0, rc 0) 00000100:00100000:0.0:1713481296.653807:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.653809:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15512:x1796714784482368:12345-0@lo:101:mdt_io00_007.0 Request processed in 62us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.653812:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82880 00000100:00100000:0.0:1713481296.653818:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882407808 00000100:00100000:0.0:1713481296.653820:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882407808 00010000:00010000:0.0:1713481296.653829:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801209ecb40/0xdfc0fb14880218c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962762 expref: 20864 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.653845:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820152 00000100:00100000:0.0:1713481296.653849:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20864:1959:x1796714882407808:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.653854:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.653858:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801209ecb40/0xdfc0fb14880218c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962762 expref: 20864 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.653859:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.653864:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800796ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784482880:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.653867:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801209ecb40/0xdfc0fb14880218c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962762 expref: 20864 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.653879:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.653883:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801209ecb40/0xdfc0fb14880218c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962762 expref: 20864 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.653894:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.653895:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.653896:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784482944 00010000:00010000:0.0:1713481296.653898:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.653898:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784482944 00010000:00010000:0.0:1713481296.653908:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.653915:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82881 00000100:00100000:2.0:1713481296.653918:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:15512:x1796714784482944:12345-0@lo:1000:mdt_io00_007.0 00010000:00010000:0.0:1713481296.653926:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.653941:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20863:1959:x1796714882407808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 90us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.653947:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820152 00010000:00010000:0.0:1713481296.653964:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.653970:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:15512:x1796714784482944:12345-0@lo:1000:mdt_io00_007.0 Request processed in 50us (84us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.653971:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.653976:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82881 00010000:00010000:0.0:1713481296.653977:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653983:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653989:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.653993:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dca4480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.653995:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.653999:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784482880 00000100:00100000:2.0:1713481296.654002:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784482880 00010000:00010000:0.0:1713481296.654005:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.654015:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562215 00010000:00010000:0.0:1713481296.654016:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.654019:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+86:3493:x1796714784482880:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.654021:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dca4480/0xdfc0fb148a389f9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.654029:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9911 count 1 00010000:00010000:2.0:1713481296.654040:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.654050:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6ac0/0xdfc0fb1488021af lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627a8 expref: 20862 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.654061:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.654062:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.654065:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.654079:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086cd6ac0/0xdfc0fb1488021af lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627a8 expref: 20862 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.654086:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086cd6ac0/0xdfc0fb1488021af lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627a8 expref: 20862 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.654092:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784483008:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.654104:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.654154:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784483072 00000100:00100000:2.0:1713481296.654156:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784483072 00000100:00100000:2.0:1713481296.654171:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82882 00000100:00100000:0.0:1713481296.654173:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+87:3491:x1796714784480448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7343us (7477us total) trans 4296040749 rc 0/0 00000100:00100000:2.0:1713481296.654174:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:15512:x1796714784483072:12345-0@lo:1000:mdt_io00_007.0 00000100:00100000:0.0:1713481296.654180:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562155 00000004:00080000:3.0:1713481296.654192:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d5df80/2, rc 0, transno 1073453 00000100:00100000:3.0:1713481296.654197:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784480448:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.654201:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562216 00000100:00100000:0.0:1713481296.654206:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26603:1959:x1796714882407872:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.654213:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.654222:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012024e400/0xdfc0fb148a38c84 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47fa6 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.654224:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:15512:x1796714784483072:12345-0@lo:1000:mdt_io00_007.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.654230:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82882 00002000:00010000:0.0:1713481296.654234:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae80:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.654243:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.654244:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.654248:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012024e400/0xdfc0fb148a38c84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fa6 expref: 26604 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.654271:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ddc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784483136:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.654292:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.654345:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ddc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784483200:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.654363:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.654410:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784483264:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.654428:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.654474:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012024e400/0xdfc0fb148a38c84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fa6 expref: 26604 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.654484:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012024e400, rc 0) 00000100:00100000:0.0:1713481296.654497:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26604:1959:x1796714882407872:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 290us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.654502:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562216 00000100:00100000:0.0:1713481296.654516:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784483136 00000100:00100000:0.0:1713481296.654518:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784483136 00000100:00100000:0.0:1713481296.654528:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784483200 00000100:00100000:0.0:1713481296.654530:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784483200 00000100:00100000:0.0:1713481296.654538:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784483264 00000100:00100000:0.0:1713481296.654539:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784483264 00000100:00100000:2.0:1713481296.654545:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562217 00000100:00100000:2.0:1713481296.654550:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ddc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+89:3493:x1796714784483136:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.654560:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562219 00002000:00080000:2.0:1713481296.654560:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9912 count 1 00000100:00100000:0.0:1713481296.654563:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+89:3491:x1796714784483264:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.654570:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.654574:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9914 count 1 00010000:00010000:2.0:1713481296.654580:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090432d00/0xdfc0fb1488021bd lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627b6 expref: 20862 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.654584:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.654585:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.654585:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.654586:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.654595:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801347c5440/0xdfc0fb1488021c4 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627d2 expref: 20862 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.654597:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090432d00/0xdfc0fb1488021bd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627b6 expref: 20862 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.654601:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.654603:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.654603:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090432d00/0xdfc0fb1488021bd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627b6 expref: 20862 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.654605:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.654609:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784483392:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.654619:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801347c5440/0xdfc0fb1488021c4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627d2 expref: 20862 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.654621:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364d80 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.654630:0:8077:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a5738e40 version 16901 rpc_version 16901 00010000:00010000:0.0:1713481296.654631:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801347c5440/0xdfc0fb1488021c4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627d2 expref: 20862 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.654639:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784483456:192.168.202.24@tcp:104: 00000020:00100000:2.0:1713481296.654640:0:8077:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713481296.654644:0:8077:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880076878000 x1796714784483584/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713481296.654652:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.654652:0:8077:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076878000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784483584:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1713481296.654694:0:8077:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.654708:0:8077:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.654718:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784483584 00000100:00100000:2.0:1713481296.654720:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784483584 00000100:00100000:2.0:1713481296.654734:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82883 00000100:00100000:2.0:1713481296.654736:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:8077:x1796714784483584:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713481296.654831:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882408000 00000100:00100000:0.0:1713481296.654834:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882408000 00000100:00100000:0.0:1713481296.654846:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882408064 00000100:00100000:0.0:1713481296.654847:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882408064 00000100:00100000:2.0:1713481296.654850:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:8077:x1796714784483584:12345-0@lo:1000:osp_up0-1.0 Request processed in 112us (155us total) trans 4295105898 rc 0/0 00000100:00100000:2.0:1713481296.654854:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82883 00000100:00100000:0.0:1713481296.654867:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562222 00000100:00100000:0.0:1713481296.654871:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16495:1960:x1796714882408064:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.654891:0:8077:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076878000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784483584:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713481296.654916:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.654924:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134e4e1c0/0xdfc0fb148a38cae lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9666:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47fbb expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.654933:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9666:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.654939:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.654940:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.654943:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134e4e1c0/0xdfc0fb148a38cae lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fbb expref: 16496 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.654949:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134e4e1c0/0xdfc0fb148a38cae lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fbb expref: 16496 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.654954:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134e4e1c0, rc 0) 00000100:00100000:0.0:1713481296.654964:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16496:1960:x1796714882408064:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 93us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.654968:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562222 00000100:00100000:0.0:1713481296.655002:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.655016:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882408128 00000100:00100000:0.0:1713481296.655019:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882408128 00000100:00100000:0.0:1713481296.655034:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562223 00000100:00100000:0.0:1713481296.655189:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26605:1959:x1796714882408128:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.655196:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.655206:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134e4c000/0xdfc0fb148a38cb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47fc2 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.655217:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae82:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.655226:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.655227:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.655231:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134e4c000/0xdfc0fb148a38cb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fc2 expref: 26606 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.655241:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134e4c000/0xdfc0fb148a38cb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fc2 expref: 26606 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.655248:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134e4c000, rc 0) 00000100:00100000:0.0:1713481296.655263:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26606:1959:x1796714882408128:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.655268:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562223 00000100:00100000:0.0:1713481296.655327:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.655339:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882408384 00000100:00100000:0.0:1713481296.655341:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882408384 00000100:00100000:0.0:1713481296.655353:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562226 00000100:00100000:0.0:1713481296.655357:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26607:1959:x1796714882408384:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.655363:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.655371:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134e4c900/0xdfc0fb148a38cca lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47fde expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.655381:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae84:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.655389:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.655390:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.655394:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134e4c900/0xdfc0fb148a38cca lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fde expref: 26608 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.655400:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134e4c900/0xdfc0fb148a38cca lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fde expref: 26608 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.655405:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134e4c900, rc 0) 00000100:00100000:0.0:1713481296.655514:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26608:1959:x1796714882408384:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 156us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.655518:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562226 00000100:00100000:0.0:1713481296.655719:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882408512 00000100:00100000:0.0:1713481296.655723:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882408512 00000100:00100000:0.0:1713481296.655738:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562229 00000100:00100000:0.0:1713481296.655742:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007987f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26608:1959:x1796714882408512:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.655748:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.655756:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134e4f600/0xdfc0fb148a38cdf lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa47fec expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.655772:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae85:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.655839:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.655841:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.655844:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134e4f600/0xdfc0fb148a38cdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fec expref: 26610 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.655851:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134e4f600/0xdfc0fb148a38cdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47fec expref: 26610 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.655856:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134e4f600, rc 0) 00000100:00100000:0.0:1713481296.655866:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007987f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26611:1959:x1796714882408512:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 125us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.655870:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562229 00000100:00100000:0.0:1713481296.655902:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.656039:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.656057:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562232 00000100:00100000:0.0:1713481296.656437:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16500:1959:x1796714882408704:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.656444:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.656453:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134e4d440/0xdfc0fb148a38cf4 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x966b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48001 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.656465:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x966b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.656474:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.656475:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.656480:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134e4d440/0xdfc0fb148a38cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x966b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48001 expref: 16501 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.656489:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134e4d440/0xdfc0fb148a38cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x966b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48001 expref: 16501 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.656496:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134e4d440, rc 0) 00000100:00100000:0.0:1713481296.656508:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16501:1959:x1796714882408704:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.656514:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562232 00000100:00100000:0.0:1713481296.656531:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882408832 00000100:00100000:0.0:1713481296.656533:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882408832 00000100:00100000:0.0:1713481296.656556:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562234 00000100:00100000:0.0:1713481296.656560:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007987ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16501:1959:x1796714882408832:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.656565:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.656573:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134e4f3c0/0xdfc0fb148a38d02 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x966c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4800f expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.656580:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x966c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.656586:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.656587:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.656590:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134e4f3c0/0xdfc0fb148a38d02 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x966c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4800f expref: 16502 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.656595:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134e4f3c0/0xdfc0fb148a38d02 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x966c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4800f expref: 16502 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.656600:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134e4f3c0, rc 0) 00000100:00100000:0.0:1713481296.656609:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007987ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16502:1959:x1796714882408832:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.656612:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562234 00000100:00100000:0.0:1713481296.656751:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.656813:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882409024 00000100:00100000:0.0:1713481296.656817:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882409024 00000100:00100000:0.0:1713481296.656897:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562238 00000100:00100000:0.0:1713481296.656902:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26612:1959:x1796714882409024:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.656909:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.656919:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120ae2d00/0xdfc0fb148a38d1e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48024 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.656931:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae89:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.656939:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.656941:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.656945:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120ae2d00/0xdfc0fb148a38d1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48024 expref: 26613 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.656954:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120ae2d00/0xdfc0fb148a38d1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48024 expref: 26613 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.656961:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae2d00, rc 0) 00000100:00100000:0.0:1713481296.657031:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26614:1959:x1796714882409024:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 127us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.657038:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562238 00000100:00100000:0.0:1713481296.657082:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.657360:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.657389:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.657402:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882409408 00000100:00100000:0.0:1713481296.657405:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882409408 00000100:00100000:0.0:1713481296.657430:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562243 00000100:00100000:0.0:1713481296.657435:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26615:1959:x1796714882409408:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.657442:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.657452:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120ae2880/0xdfc0fb148a38d41 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4804e expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.657464:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae8c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.657472:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.657474:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.657477:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120ae2880/0xdfc0fb148a38d41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4804e expref: 26616 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.657486:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120ae2880/0xdfc0fb148a38d41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4804e expref: 26617 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.657493:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae2880, rc 0) 00000100:00100000:0.0:1713481296.657563:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26617:1959:x1796714882409408:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.657571:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562243 00000100:00100000:0.0:1713481296.657727:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.657741:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882409792 00000100:00100000:0.0:1713481296.657744:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882409792 00000100:00100000:0.0:1713481296.657764:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562246 00000100:00100000:0.0:1713481296.657768:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26618:1959:x1796714882409792:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.657777:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.657785:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120ae1b00/0xdfc0fb148a38d56 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48078 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.657795:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae8f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.657803:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.657804:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.657808:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120ae1b00/0xdfc0fb148a38d56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48078 expref: 26619 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.657817:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120ae1b00/0xdfc0fb148a38d56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48078 expref: 26619 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.657825:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae1b00, rc 0) 00000100:00100000:0.0:1713481296.657838:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26619:1959:x1796714882409792:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.657843:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562246 00000100:00100000:0.0:1713481296.657880:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.657895:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882409600 00000100:00100000:0.0:1713481296.657898:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882409600 00000100:00100000:0.0:1713481296.657911:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562248 00000100:00100000:0.0:1713481296.657915:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16507:1959:x1796714882409600:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.657921:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.657928:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120ae3840/0xdfc0fb148a38d64 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9672:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48063 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.657938:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9672:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.657945:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.657946:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.657950:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120ae3840/0xdfc0fb148a38d64 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48063 expref: 16508 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.657957:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120ae3840/0xdfc0fb148a38d64 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48063 expref: 16508 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.657964:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae3840, rc 0) 00000100:00100000:0.0:1713481296.657974:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16509:1959:x1796714882409600:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.657979:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562248 00000100:00100000:0.0:1713481296.658012:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.658026:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882409856 00000100:00100000:0.0:1713481296.658028:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882409856 00000100:00100000:0.0:1713481296.658044:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562250 00000100:00100000:0.0:1713481296.658049:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800770a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16509:1959:x1796714882409856:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.658055:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.658065:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120ae3180/0xdfc0fb148a38d72 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9674:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4807f expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.658076:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9674:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.658085:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658086:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658090:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120ae3180/0xdfc0fb148a38d72 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4807f expref: 16510 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.658103:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120ae3180/0xdfc0fb148a38d72 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4807f expref: 16510 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.658111:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae3180, rc 0) 00000100:00100000:0.0:1713481296.658145:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800770a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16510:1959:x1796714882409856:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 94us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.658151:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562250 00000100:00100000:0.0:1713481296.658190:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.658255:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.658269:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882410176 00000100:00100000:0.0:1713481296.658272:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882410176 00000100:00100000:0.0:1713481296.658289:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562253 00000100:00100000:0.0:1713481296.658294:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800770a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26621:1959:x1796714882410176:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.658301:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.658310:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120ae21c0/0xdfc0fb148a38d87 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa480a2 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.658320:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae92:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.658329:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658330:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658334:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120ae21c0/0xdfc0fb148a38d87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480a2 expref: 26623 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.658344:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120ae21c0/0xdfc0fb148a38d87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480a2 expref: 26624 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.658357:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae21c0, rc 0) 00000100:00100000:0.0:1713481296.658371:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800770a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26624:1959:x1796714882410176:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 76us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.658377:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562253 00000100:00100000:0.0:1713481296.658396:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882410432 00000100:00100000:0.0:1713481296.658398:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882410432 00000100:00100000:0.0:1713481296.658413:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562255 00000100:00100000:0.0:1713481296.658417:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26623:1959:x1796714882410432:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.658420:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562256 00010000:00010000:0.0:1713481296.658423:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.658424:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16510:1959:x1796714882409984:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.658430:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.658432:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120ae3cc0/0xdfc0fb148a38d95 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa480be expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.658440:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008219e640/0xdfc0fb148a38d9c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9675:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4808d expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.658442:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae94:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.658448:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9675:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.658451:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658452:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658455:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658456:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120ae3cc0/0xdfc0fb148a38d95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480be expref: 26624 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.658456:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658459:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008219e640/0xdfc0fb148a38d9c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4808d expref: 16512 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.658465:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120ae3cc0/0xdfc0fb148a38d95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480be expref: 26624 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.658466:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008219e640/0xdfc0fb148a38d9c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4808d expref: 16512 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.658473:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae3cc0, rc 0) 00010000:00010000:2.0:1713481296.658474:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008219e640, rc 0) 00000100:00100000:0.0:1713481296.658486:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26624:1959:x1796714882410432:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.658488:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16513:1959:x1796714882409984:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.658492:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562255 00000100:00100000:2.0:1713481296.658496:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562256 00000100:00100000:0.0:1713481296.658544:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.658579:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.658588:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882410368 00000100:00100000:2.0:1713481296.658590:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882410368 00000100:00100000:2.0:1713481296.658606:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562259 00000100:00100000:2.0:1713481296.658609:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16514:1959:x1796714882410368:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.658614:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.658620:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008219c900/0xdfc0fb148a38db1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9678:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa480b7 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.658626:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.658627:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9678:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.658633:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658634:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658638:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008219c900/0xdfc0fb148a38db1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480b7 expref: 16515 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.658639:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882410560 00000100:00100000:0.0:1713481296.658642:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882410560 00010000:00010000:2.0:1713481296.658647:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008219c900/0xdfc0fb148a38db1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480b7 expref: 16515 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.658654:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008219c900, rc 0) 00000100:00100000:0.0:1713481296.658658:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562260 00000100:00100000:0.0:1713481296.658662:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26624:1959:x1796714882410560:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.658678:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16514:1959:x1796714882410368:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.658682:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.658683:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562259 00010000:00010000:0.0:1713481296.658692:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120ae06c0/0xdfc0fb148a38db8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa480cc expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.658700:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882410496 00002000:00010000:0.0:1713481296.658702:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae95:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.658703:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882410496 00010000:00010000:0.0:1713481296.658709:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658710:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.658714:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120ae06c0/0xdfc0fb148a38db8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480cc expref: 26625 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.658719:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562261 00010000:00010000:0.0:1713481296.658722:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120ae06c0/0xdfc0fb148a38db8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480cc expref: 26625 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.658723:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16515:1959:x1796714882410496:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.658729:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae06c0, rc 0) 00010000:00010000:2.0:1713481296.658729:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.658739:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124a26ac0/0xdfc0fb148a38dbf lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9679:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa480c5 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.658740:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26625:1959:x1796714882410560:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.658745:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562260 00002000:00010000:2.0:1713481296.658748:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9679:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.658755:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658756:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658760:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a26ac0/0xdfc0fb148a38dbf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480c5 expref: 16516 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.658768:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124a26ac0/0xdfc0fb148a38dbf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480c5 expref: 16517 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.658774:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124a26ac0, rc 0) 00000100:00100000:2.0:1713481296.658787:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16517:1959:x1796714882410496:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.658792:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562261 00000100:00100000:0.0:1713481296.658796:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.658836:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.658846:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882410816 00000100:00100000:2.0:1713481296.658849:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882410816 00000100:00100000:2.0:1713481296.658859:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562264 00000100:00100000:2.0:1713481296.658862:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26627:1959:x1796714882410816:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.658866:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.658871:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.658873:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800914c0b40/0xdfc0fb148a38dd4 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa480e8 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.658881:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae97:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.658886:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658887:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.658890:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914c0b40/0xdfc0fb148a38dd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480e8 expref: 26627 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.658896:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800914c0b40/0xdfc0fb148a38dd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480e8 expref: 26628 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.658900:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c0b40, rc 0) 00000100:00100000:2.0:1713481296.658910:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26628:1959:x1796714882410816:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.658913:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562264 00000100:00100000:0.0:1713481296.659028:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.659254:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.659277:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.659294:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.659306:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882411200 00000100:00100000:2.0:1713481296.659310:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882411200 00000100:00100000:0.0:1713481296.659312:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562268 00000100:00100000:0.0:1713481296.659317:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26629:1959:x1796714882411072:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.659324:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.659334:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120ae2f40/0xdfc0fb148a38df0 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48104 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.659337:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562269 00000100:00100000:2.0:1713481296.659342:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26629:1959:x1796714882411200:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.659346:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae99:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.659349:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.659354:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.659356:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.659359:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800914c2400/0xdfc0fb148a38df7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xae9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48112 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.659370:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xae9a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.659378:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.659379:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.659383:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914c2400/0xdfc0fb148a38df7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48112 expref: 26631 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.659398:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800914c2400/0xdfc0fb148a38df7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48112 expref: 26632 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.659405:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c2400, rc 0) 00010000:00010000:0.0:1713481296.659418:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120ae2f40/0xdfc0fb148a38df0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48104 expref: 26630 pid: 10554 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.659418:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26632:1959:x1796714882411200:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.659424:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562269 00010000:00010000:0.0:1713481296.659430:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120ae2f40/0xdfc0fb148a38df0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xae99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48104 expref: 26632 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.659437:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120ae2f40, rc 0) 00000100:00100000:0.0:1713481296.659629:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26632:1959:x1796714882411072:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 310us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.659635:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562268 00000100:00100000:0.0:1713481296.659701:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.659727:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.659738:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882411008 00000100:00100000:0.0:1713481296.659740:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882411008 00000100:00100000:0.0:1713481296.659761:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562272 00000100:00100000:0.0:1713481296.659765:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16518:1959:x1796714882411008:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.659771:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.659780:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b01d40/0xdfc0fb148a38e0c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x967d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa480fd expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.659790:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x967d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.659797:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.659798:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.659802:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b01d40/0xdfc0fb148a38e0c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x967d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480fd expref: 16519 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.659811:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b01d40/0xdfc0fb148a38e0c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x967d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa480fd expref: 16519 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.659818:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b01d40, rc 0) 00000100:00100000:0.0:1713481296.659832:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16519:1959:x1796714882411008:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.659837:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562272 00000100:00100000:0.0:1713481296.659884:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.659896:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882411264 00000100:00100000:0.0:1713481296.659899:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882411264 00000100:00100000:0.0:1713481296.659909:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562274 00000100:00100000:0.0:1713481296.659912:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16521:1959:x1796714882411264:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.659916:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.659922:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b018c0/0xdfc0fb148a38e1a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x967f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48119 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.659933:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x967f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.659940:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.659941:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.659945:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b018c0/0xdfc0fb148a38e1a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x967f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48119 expref: 16521 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.659953:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b018c0/0xdfc0fb148a38e1a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x967f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48119 expref: 16522 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.659960:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b018c0, rc 0) 00000100:00100000:0.0:1713481296.659974:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16522:1959:x1796714882411264:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.659979:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562274 00000100:00100000:0.0:1713481296.660107:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.660141:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882411712 00000100:00100000:0.0:1713481296.660145:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882411712 00000100:00100000:0.0:1713481296.660193:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.660207:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882411520 00000100:00100000:0.0:1713481296.660210:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882411520 00000100:00100000:0.0:1713481296.660226:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562278 00000100:00100000:0.0:1713481296.660230:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16522:1959:x1796714882411520:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.660236:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.660244:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b00d80/0xdfc0fb148a38e36 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9681:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48135 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.660254:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9681:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.660263:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.660264:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.660269:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b00d80/0xdfc0fb148a38e36 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9681:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48135 expref: 16523 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.660278:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b00d80/0xdfc0fb148a38e36 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9681:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48135 expref: 16523 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.660285:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b00d80, rc 0) 00000100:00100000:0.0:1713481296.660299:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16524:1959:x1796714882411520:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.660304:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562278 00000100:00100000:0.0:1713481296.660361:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.660378:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882411776 00000100:00100000:0.0:1713481296.660381:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882411776 00000100:00100000:0.0:1713481296.660407:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562280 00000100:00100000:0.0:1713481296.660411:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16524:1959:x1796714882411776:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.660418:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.660427:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b01f80/0xdfc0fb148a38e44 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48151 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.660438:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9683:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.660562:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.660564:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.660568:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b01f80/0xdfc0fb148a38e44 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48151 expref: 16525 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.660583:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b01f80/0xdfc0fb148a38e44 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48151 expref: 16525 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.660590:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b01f80, rc 0) 00000100:00100000:0.0:1713481296.660601:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16525:1959:x1796714882411776:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 190us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.660606:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562280 00000100:00100000:0.0:1713481296.660726:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.660736:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882411904 00000100:00100000:2.0:1713481296.660739:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882411904 00000100:00100000:0.0:1713481296.660766:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.660781:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882412032 00000100:00100000:0.0:1713481296.660903:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882412032 00000100:00100000:2.0:1713481296.660921:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562286 00000100:00100000:2.0:1713481296.660924:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16526:1959:x1796714882412032:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.660930:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.660938:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c0480/0xdfc0fb148a38e6e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4816d expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.660946:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9685:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.660952:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.660953:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.660956:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c0480/0xdfc0fb148a38e6e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4816d expref: 16527 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.660958:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.660962:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800914c0480/0xdfc0fb148a38e6e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4816d expref: 16527 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.660967:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c0480, rc 0) 00000100:00100000:2.0:1713481296.660977:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16527:1959:x1796714882412032:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.660981:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562286 00000100:00100000:0.0:1713481296.660984:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.660994:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562287 00000100:00100000:2.0:1713481296.660997:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26638:1959:x1796714882412352:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.660998:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562288 00010000:00010000:2.0:1713481296.661001:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.661002:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16527:1959:x1796714882412160:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.661006:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800914c33c0/0xdfc0fb148a38e75 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaea3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48190 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.661009:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.661013:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaea3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.661017:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b00480/0xdfc0fb148a38e7c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4817b expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.661018:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.661018:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.661021:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914c33c0/0xdfc0fb148a38e75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaea3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48190 expref: 26639 pid: 16460 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.661026:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9686:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.661026:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800914c33c0/0xdfc0fb148a38e75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaea3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48190 expref: 26639 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.661030:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c33c0, rc 0) 00010000:00010000:0.0:1713481296.661033:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661034:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661038:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b00480/0xdfc0fb148a38e7c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4817b expref: 16529 pid: 10554 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.661038:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26639:1959:x1796714882412352:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.661041:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562287 00010000:00010000:0.0:1713481296.661051:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b00480/0xdfc0fb148a38e7c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4817b expref: 16529 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.661059:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b00480, rc 0) 00000100:00100000:0.0:1713481296.661069:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16529:1959:x1796714882412160:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.661073:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562288 00000100:00100000:0.0:1713481296.661106:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.661238:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.661251:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882412480 00000100:00100000:0.0:1713481296.661254:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882412480 00000100:00100000:0.0:1713481296.661272:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882412608 00000100:00100000:0.0:1713481296.661273:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882412608 00000100:00100000:0.0:1713481296.661295:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562292 00000100:00100000:0.0:1713481296.661300:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26640:1959:x1796714882412608:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.661307:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.661316:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b01b00/0xdfc0fb148a38e98 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaea5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa481ac expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.661444:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaea5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.661453:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661454:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661459:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b01b00/0xdfc0fb148a38e98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaea5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481ac expref: 26642 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.661468:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084b01b00/0xdfc0fb148a38e98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaea5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481ac expref: 26642 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.661477:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b01b00, rc 0) 00000001:00080000:3.0:1713481296.661483:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040747 00000100:00100000:0.0:1713481296.661545:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26644:1959:x1796714882412608:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 243us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.661551:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562292 00002000:00080000:3.0:1713481296.661554:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 55634 00000100:00100000:0.0:1713481296.661585:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.661613:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.661640:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562295 00000100:00100000:0.0:1713481296.661645:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26643:1959:x1796714882413056:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.661652:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.661659:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b02ac0/0xdfc0fb148a38ead lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaea8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa481d6 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.661683:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaea8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.661690:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661692:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661695:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b02ac0/0xdfc0fb148a38ead lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaea8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481d6 expref: 26644 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.661704:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084b02ac0/0xdfc0fb148a38ead lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaea8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481d6 expref: 26644 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.661711:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b02ac0, rc 0) 00000100:00100000:0.0:1713481296.661722:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26644:1959:x1796714882413056:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.661731:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562295 00000100:00100000:0.0:1713481296.661763:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.661886:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882412672 00000100:00100000:0.0:1713481296.661889:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882412672 00000100:00100000:0.0:1713481296.661907:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882412800 00000100:00100000:0.0:1713481296.661908:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882412800 00000100:00100000:0.0:1713481296.661921:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562298 00000100:00100000:0.0:1713481296.661924:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800754fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16532:1959:x1796714882412800:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.661965:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.661972:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b01440/0xdfc0fb148a38ec2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x968b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa481c1 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.661982:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x968b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.661990:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661992:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.661996:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b01440/0xdfc0fb148a38ec2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x968b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481c1 expref: 16533 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.662005:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b01440/0xdfc0fb148a38ec2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x968b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481c1 expref: 16533 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.662012:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b01440, rc 0) 00000100:00100000:0.0:1713481296.662026:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800754fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16534:1959:x1796714882412800:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 100us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.662032:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562298 00000100:00100000:0.0:1713481296.662068:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.662081:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413248 00000100:00100000:0.0:1713481296.662083:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413248 00000100:00100000:0.0:1713481296.662313:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413376 00000100:00100000:0.0:1713481296.662316:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413376 00000100:00100000:2.0:1713481296.662374:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562302 00000100:00100000:2.0:1713481296.662378:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26647:1959:x1796714882413504:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.662383:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.662391:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800914c2d00/0xdfc0fb148a38ede lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48207 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.662400:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeab:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.662406:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.662407:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.662410:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914c2d00/0xdfc0fb148a38ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48207 expref: 26648 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.662416:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800914c2d00/0xdfc0fb148a38ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48207 expref: 26647 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.662421:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c2d00, rc 0) 00000100:00100000:2.0:1713481296.662434:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26647:1959:x1796714882413504:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 55us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.662439:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562302 00000100:00100000:0.0:1713481296.662451:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413120 00000100:00100000:0.0:1713481296.662455:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413120 00000100:00100000:2.0:1713481296.662474:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413312 00000100:00100000:2.0:1713481296.662477:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413312 00000100:00100000:2.0:1713481296.662496:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562303 00000100:00100000:2.0:1713481296.662500:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16536:1959:x1796714882413120:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.662507:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.662516:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c1440/0xdfc0fb148a38ee5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x968d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa481e4 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.662527:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x968d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.662537:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.662538:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.662542:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c1440/0xdfc0fb148a38ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x968d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481e4 expref: 16538 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.662556:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800914c1440/0xdfc0fb148a38ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x968d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481e4 expref: 16538 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.662564:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c1440, rc 0) 00000100:00100000:2.0:1713481296.662578:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16538:1959:x1796714882413120:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.662603:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562305 00000100:00100000:0.0:1713481296.662610:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16538:1959:x1796714882413440:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.662611:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562303 00010000:00010000:0.0:1713481296.662616:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.662624:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b033c0/0xdfc0fb148a38ef3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x968f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48200 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.662634:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x968f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.662641:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.662642:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.662646:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b033c0/0xdfc0fb148a38ef3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x968f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48200 expref: 16537 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.662655:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b033c0/0xdfc0fb148a38ef3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x968f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48200 expref: 16537 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.662656:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413568 00000100:00100000:2.0:1713481296.662659:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413568 00010000:00010000:0.0:1713481296.662662:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b033c0, rc 0) 00000100:00100000:0.0:1713481296.662689:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16538:1959:x1796714882413440:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.662689:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413632 00000100:00100000:2.0:1713481296.662691:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413632 00000100:00100000:0.0:1713481296.662694:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562305 00000100:00100000:2.0:1713481296.662713:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562306 00000100:00100000:2.0:1713481296.662719:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16538:1959:x1796714882413568:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.662725:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.662737:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c3cc0/0xdfc0fb148a38f01 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4820e expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.662747:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9690:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.662756:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.662758:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.662761:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c3cc0/0xdfc0fb148a38f01 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4820e expref: 16539 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.662771:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800914c3cc0/0xdfc0fb148a38f01 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4820e expref: 16539 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.662783:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c3cc0, rc 0) 00000100:00100000:2.0:1713481296.662797:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16538:1959:x1796714882413568:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.662803:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562306 00000100:00100000:0.0:1713481296.662820:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413760 00000100:00100000:0.0:1713481296.662824:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413760 00000100:00100000:0.0:1713481296.662841:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562308 00000100:00100000:0.0:1713481296.662846:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26648:1959:x1796714882413760:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.662896:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.662904:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b02880/0xdfc0fb148a38f08 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaead:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48223 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.662915:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaead:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.662922:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.662923:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.662926:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b02880/0xdfc0fb148a38f08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaead:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48223 expref: 26649 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.662934:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084b02880/0xdfc0fb148a38f08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaead:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48223 expref: 26649 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.662941:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b02880, rc 0) 00000100:00100000:2.0:1713481296.662949:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413888 00000100:00100000:2.0:1713481296.662951:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413888 00000100:00100000:0.0:1713481296.662952:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26649:1959:x1796714882413760:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 106us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.662957:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562308 00000100:00100000:2.0:1713481296.662963:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414016 00000100:00100000:2.0:1713481296.662964:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414016 00000100:00100000:0.0:1713481296.662972:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414144 00000100:00100000:0.0:1713481296.662974:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414144 00000100:00100000:2.0:1713481296.662977:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562309 00000100:00100000:2.0:1713481296.662980:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26651:1959:x1796714882413888:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.662985:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.662991:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800914c0240/0xdfc0fb148a38f0f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48231 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.662994:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562311 00000100:00100000:0.0:1713481296.662998:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26651:1959:x1796714882414144:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.662999:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeae:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.663003:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.663005:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663006:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663009:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914c0240/0xdfc0fb148a38f0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48231 expref: 26652 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.663013:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dbe6640/0xdfc0fb148a38f1d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4824d expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.663015:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800914c0240/0xdfc0fb148a38f0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48231 expref: 26652 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.663019:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c0240, rc 0) 00002000:00010000:0.0:1713481296.663021:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeb0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.663029:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.663029:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26654:1959:x1796714882413888:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (89us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.663030:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.663033:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562309 00010000:00010000:0.0:1713481296.663034:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dbe6640/0xdfc0fb148a38f1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4824d expref: 26654 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.663042:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dbe6640/0xdfc0fb148a38f1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4824d expref: 26654 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.663048:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbe6640, rc 0) 00000100:00100000:0.0:1713481296.663058:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26652:1959:x1796714882414144:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.663063:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562311 00000100:00100000:0.0:1713481296.663226:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.663420:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.663537:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.663564:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.663636:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562317 00000100:00100000:2.0:1713481296.663643:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007987ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16540:1959:x1796714882413824:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.663652:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.663681:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c0fc0/0xdfc0fb148a38f47 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4822a expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.663695:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9692:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.663699:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882413952 00000100:00100000:0.0:1713481296.663702:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882413952 00010000:00010000:2.0:1713481296.663706:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663707:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663712:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c0fc0/0xdfc0fb148a38f47 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4822a expref: 16541 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.663728:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800914c0fc0/0xdfc0fb148a38f47 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4822a expref: 16541 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.663736:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c0fc0, rc 0) 00000100:00100000:0.0:1713481296.663749:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.663752:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007987ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16542:1959:x1796714882413824:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 110us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.663757:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562317 00000100:00100000:0.0:1713481296.663764:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414080 00000100:00100000:0.0:1713481296.663767:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414080 00000100:00100000:2.0:1713481296.663781:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562319 00000100:00100000:2.0:1713481296.663784:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007987dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16542:1959:x1796714882414080:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.663789:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.663796:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c1d40/0xdfc0fb148a38f55 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48246 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.663807:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9694:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.663813:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663814:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663817:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c1d40/0xdfc0fb148a38f55 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48246 expref: 16543 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.663823:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800914c1d40/0xdfc0fb148a38f55 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48246 expref: 16543 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.663827:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c1d40, rc 0) 00000100:00100000:2.0:1713481296.663836:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007987dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16543:1959:x1796714882414080:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.663840:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562319 00000100:00100000:0.0:1713481296.663857:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.663868:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414336 00000100:00100000:2.0:1713481296.663871:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414336 00000100:00100000:2.0:1713481296.663887:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562321 00000100:00100000:2.0:1713481296.663890:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16544:1959:x1796714882414336:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.663894:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.663899:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.663901:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c1b00/0xdfc0fb148a38f63 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48262 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.663908:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9696:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.663914:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663915:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.663918:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c1b00/0xdfc0fb148a38f63 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48262 expref: 16545 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.663921:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.663927:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800914c1b00/0xdfc0fb148a38f63 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48262 expref: 16545 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.663931:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c1b00, rc 0) 00000100:00100000:0.0:1713481296.663937:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562322 00000100:00100000:2.0:1713481296.663940:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16546:1959:x1796714882414336:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.663941:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007987c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16546:1959:x1796714882414464:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.663944:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562321 00010000:00010000:0.0:1713481296.663947:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.663954:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dbe46c0/0xdfc0fb148a38f6a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48270 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.663962:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9697:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.663968:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.663969:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.663973:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dbe46c0/0xdfc0fb148a38f6a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48270 expref: 16546 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.663982:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dbe46c0/0xdfc0fb148a38f6a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48270 expref: 16547 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.663989:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbe46c0, rc 0) 00000100:00100000:0.0:1713481296.664004:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007987c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16547:1959:x1796714882414464:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.664009:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562322 00000100:00100000:0.0:1713481296.664048:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.664061:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414784 00000100:00100000:2.0:1713481296.664064:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414784 00000100:00100000:0.0:1713481296.664076:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.664078:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562324 00000100:00100000:2.0:1713481296.664081:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26656:1959:x1796714882414784:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.664086:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.664096:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008380b180/0xdfc0fb148a38f78 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48293 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.664106:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeb5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.664114:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.664116:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.664139:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008380b180/0xdfc0fb148a38f78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48293 expref: 26658 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.664149:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008380b180/0xdfc0fb148a38f78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48293 expref: 26658 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.664156:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008380b180, rc 0) 00000100:00100000:2.0:1713481296.664172:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26659:1959:x1796714882414784:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 89us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.664177:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562324 00000100:00100000:0.0:1713481296.664242:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.664701:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.664729:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.664757:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562328 00000100:00100000:2.0:1713481296.664761:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26660:1959:x1796714882415296:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.664766:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.664775:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012439f3c0/0xdfc0fb148a38f94 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa482cb expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.664783:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeb9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.664788:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.664790:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.664791:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.664793:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012439f3c0/0xdfc0fb148a38f94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482cb expref: 26662 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.664800:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012439f3c0/0xdfc0fb148a38f94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482cb expref: 26662 pid: 15507 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.664802:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415424 00000100:00100000:0.0:1713481296.664804:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415424 00010000:00010000:2.0:1713481296.664804:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012439f3c0, rc 0) 00000100:00100000:2.0:1713481296.664814:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26662:1959:x1796714882415296:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.664820:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562328 00000100:00100000:0.0:1713481296.664836:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.664847:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.664849:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415552 00000100:00100000:2.0:1713481296.664851:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415552 00000100:00100000:0.0:1713481296.664859:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.664862:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415680 00000100:00100000:2.0:1713481296.664863:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415680 00000100:00100000:0.0:1713481296.664867:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415808 00000100:00100000:0.0:1713481296.664870:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415808 00000100:00100000:2.0:1713481296.664872:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562330 00000100:00100000:2.0:1713481296.664875:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26664:1959:x1796714882415552:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.664879:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.664885:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012439e1c0/0xdfc0fb148a38fa2 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaebb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa482e7 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.664891:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562332 00002000:00010000:2.0:1713481296.664892:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaebb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.664895:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26665:1959:x1796714882415808:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.664897:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.664898:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.664901:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012439e1c0/0xdfc0fb148a38fa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482e7 expref: 26665 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.664902:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.664906:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012439e1c0/0xdfc0fb148a38fa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482e7 expref: 26665 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.664910:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dbe5f80/0xdfc0fb148a38fb0 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaebd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48303 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.664910:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012439e1c0, rc 0) 00000100:00100000:2.0:1713481296.664918:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26665:1959:x1796714882415552:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (83us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.664921:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaebd:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.664922:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562330 00010000:00010000:0.0:1713481296.664929:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.664931:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.664935:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dbe5f80/0xdfc0fb148a38fb0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48303 expref: 26666 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.664944:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dbe5f80/0xdfc0fb148a38fb0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48303 expref: 26666 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.664952:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbe5f80, rc 0) 00000100:00100000:0.0:1713481296.664967:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26666:1959:x1796714882415808:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.664972:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562332 00000100:00100000:0.0:1713481296.665049:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414720 00000100:00100000:0.0:1713481296.665052:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414720 00000100:00100000:0.0:1713481296.665073:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414848 00000100:00100000:0.0:1713481296.665075:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414848 00000100:00100000:0.0:1713481296.665096:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562334 00000100:00100000:0.0:1713481296.665100:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16547:1959:x1796714882414848:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.665107:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.665117:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dbe7600/0xdfc0fb148a38fbe lrc: 2/0,0 mode: --/PR res: [0x280000408:0x969a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4829a expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.665146:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x969a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.665155:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.665156:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.665161:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dbe7600/0xdfc0fb148a38fbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x969a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4829a expref: 16549 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.665171:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dbe7600/0xdfc0fb148a38fbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x969a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4829a expref: 16549 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.665178:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbe7600, rc 0) 00000100:00100000:0.0:1713481296.665193:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16548:1959:x1796714882414848:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 92us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.665199:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562334 00000100:00100000:0.0:1713481296.665215:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882414976 00000100:00100000:0.0:1713481296.665217:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882414976 00000100:00100000:0.0:1713481296.665234:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415104 00000100:00100000:0.0:1713481296.665236:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415104 00000100:00100000:2.0:1713481296.665248:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562336 00000100:00100000:2.0:1713481296.665254:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16549:1959:x1796714882415104:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.665261:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.665270:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012439df80/0xdfc0fb148a38fcc lrc: 2/0,0 mode: --/PR res: [0x280000408:0x969c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa482b6 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.665281:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x969c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.665289:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665291:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665295:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012439df80/0xdfc0fb148a38fcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x969c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482b6 expref: 16551 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.665303:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012439df80/0xdfc0fb148a38fcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x969c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482b6 expref: 16550 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.665310:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012439df80, rc 0) 00000100:00100000:0.0:1713481296.665317:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.665325:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16550:1959:x1796714882415104:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.665331:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562336 00000100:00100000:0.0:1713481296.665490:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.665533:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.665541:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415488 00000100:00100000:2.0:1713481296.665544:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415488 00000100:00100000:2.0:1713481296.665560:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562339 00000100:00100000:2.0:1713481296.665563:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16553:1959:x1796714882415488:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.665568:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.665575:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012439ed00/0xdfc0fb148a38fe1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x969f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa482e0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.665583:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x969f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.665589:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665590:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665592:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012439ed00/0xdfc0fb148a38fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x969f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482e0 expref: 16554 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.665598:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012439ed00/0xdfc0fb148a38fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x969f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482e0 expref: 16553 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.665606:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012439ed00, rc 0) 00000100:00100000:2.0:1713481296.665615:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16553:1959:x1796714882415488:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.665619:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562339 00000100:00100000:0.0:1713481296.665655:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415616 00000100:00100000:0.0:1713481296.665658:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415616 00000100:00100000:2.0:1713481296.665689:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562340 00000100:00100000:2.0:1713481296.665692:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16553:1959:x1796714882415616:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.665696:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.665702:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012439c000/0xdfc0fb148a38fe8 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa482ee expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.665709:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96a0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.665713:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665714:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665717:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012439c000/0xdfc0fb148a38fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482ee expref: 16554 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.665722:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012439c000/0xdfc0fb148a38fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa482ee expref: 16554 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.665726:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012439c000, rc 0) 00000100:00100000:0.0:1713481296.665733:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415744 00000100:00100000:2.0:1713481296.665735:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16554:1959:x1796714882415616:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.665737:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415744 00000100:00100000:2.0:1713481296.665738:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562340 00000100:00100000:2.0:1713481296.665757:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882415936 00000100:00100000:2.0:1713481296.665758:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882415936 00000100:00100000:0.0:1713481296.665759:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416064 00000100:00100000:0.0:1713481296.665761:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416064 00000100:00100000:2.0:1713481296.665771:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562342 00000100:00100000:2.0:1713481296.665773:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26666:1959:x1796714882415936:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.665777:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.665782:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562343 00010000:00010000:2.0:1713481296.665783:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013147b600/0xdfc0fb148a38fef lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaebe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48311 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.665787:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012069ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26666:1959:x1796714882416064:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.665790:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaebe:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.665793:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.665794:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665795:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.665797:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013147b600/0xdfc0fb148a38fef lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48311 expref: 26667 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.665802:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dbe4fc0/0xdfc0fb148a38ffd lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaebf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4831f expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.665803:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013147b600/0xdfc0fb148a38fef lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48311 expref: 26667 pid: 10554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.665807:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013147b600, rc 0) 00002000:00010000:0.0:1713481296.665813:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaebf:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.665814:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26667:1959:x1796714882415936:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.665817:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562342 00010000:00010000:0.0:1713481296.665820:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.665821:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.665825:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dbe4fc0/0xdfc0fb148a38ffd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4831f expref: 26667 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.665904:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dbe4fc0/0xdfc0fb148a38ffd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaebf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4831f expref: 26667 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.665914:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbe4fc0, rc 0) 00000100:00100000:0.0:1713481296.665932:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012069ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26669:1959:x1796714882416064:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 144us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.665937:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562343 00000100:00100000:0.0:1713481296.666004:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416320 00000100:00100000:0.0:1713481296.666007:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416320 00000100:00100000:0.0:1713481296.666030:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562345 00000100:00100000:0.0:1713481296.666034:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012069aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26668:1959:x1796714882416320:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.666041:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.666049:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dbe6d00/0xdfc0fb148a3900b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaec1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4833b expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.666059:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaec1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.666066:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666067:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666071:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dbe6d00/0xdfc0fb148a3900b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4833b expref: 26670 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666079:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dbe6d00/0xdfc0fb148a3900b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4833b expref: 26670 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666085:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbe6d00, rc 0) 00000100:00100000:0.0:1713481296.666097:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012069aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26670:1959:x1796714882416320:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.666102:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562345 00000100:00100000:0.0:1713481296.666151:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.666164:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416576 00000100:00100000:0.0:1713481296.666166:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416576 00000100:00100000:0.0:1713481296.666178:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562347 00000100:00100000:0.0:1713481296.666182:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013617b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26671:1959:x1796714882416576:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.666188:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.666195:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124efdf80/0xdfc0fb148a39019 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaec3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48357 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.666204:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaec3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.666212:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666214:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666218:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124efdf80/0xdfc0fb148a39019 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48357 expref: 26671 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666231:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124efdf80/0xdfc0fb148a39019 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48357 expref: 26671 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666238:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124efdf80, rc 0) 00000100:00100000:0.0:1713481296.666251:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013617b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26671:1959:x1796714882416576:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.666257:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562347 00000100:00100000:0.0:1713481296.666286:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.666296:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416000 00000100:00100000:0.0:1713481296.666298:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416000 00000100:00100000:0.0:1713481296.666309:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562349 00000100:00100000:0.0:1713481296.666312:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16557:1959:x1796714882416000:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.666318:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.666326:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c87cb40/0xdfc0fb148a39027 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48318 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.666336:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96a3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.666342:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666343:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666347:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c87cb40/0xdfc0fb148a39027 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48318 expref: 16557 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666354:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c87cb40/0xdfc0fb148a39027 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48318 expref: 16557 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666365:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c87cb40, rc 0) 00000100:00100000:0.0:1713481296.666375:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16558:1959:x1796714882416000:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.666380:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562349 00000100:00100000:0.0:1713481296.666404:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.666413:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416256 00000100:00100000:0.0:1713481296.666415:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416256 00000100:00100000:0.0:1713481296.666426:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562351 00000100:00100000:0.0:1713481296.666429:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800770a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16559:1959:x1796714882416256:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.666434:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.666442:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c87cfc0/0xdfc0fb148a39035 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48334 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.666449:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96a5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.666455:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666457:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666460:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c87cfc0/0xdfc0fb148a39035 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48334 expref: 16559 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666468:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c87cfc0/0xdfc0fb148a39035 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48334 expref: 16559 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666475:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c87cfc0, rc 0) 00000100:00100000:0.0:1713481296.666486:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800770a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16559:1959:x1796714882416256:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.666495:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562351 00000100:00100000:0.0:1713481296.666542:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.666553:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416512 00000100:00100000:0.0:1713481296.666555:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416512 00000100:00100000:0.0:1713481296.666566:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562353 00000100:00100000:0.0:1713481296.666570:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800770a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16561:1959:x1796714882416512:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.666576:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.666584:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c87d200/0xdfc0fb148a39043 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48350 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.666593:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96a7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.666600:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666601:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666605:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c87d200/0xdfc0fb148a39043 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48350 expref: 16561 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666612:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c87d200/0xdfc0fb148a39043 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48350 expref: 16561 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666618:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c87d200, rc 0) 00000100:00100000:0.0:1713481296.666628:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800770a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16562:1959:x1796714882416512:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.666633:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562353 00000100:00100000:0.0:1713481296.666658:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.666683:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416704 00000100:00100000:0.0:1713481296.666686:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416704 00000100:00100000:0.0:1713481296.666701:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562355 00000100:00100000:0.0:1713481296.666706:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800770a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26671:1959:x1796714882416704:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.666712:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.666723:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b067cc0/0xdfc0fb148a39051 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaec4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48365 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.666734:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaec4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.666741:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666742:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666746:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b067cc0/0xdfc0fb148a39051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48365 expref: 26672 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666756:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b067cc0/0xdfc0fb148a39051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48365 expref: 26672 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666764:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b067cc0, rc 0) 00000100:00100000:0.0:1713481296.666777:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800770a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26673:1959:x1796714882416704:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.666782:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562355 00000100:00100000:0.0:1713481296.666817:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.666839:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.666850:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562357 00000100:00100000:0.0:1713481296.666855:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800770a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26674:1959:x1796714882416960:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.666861:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.666869:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b066ac0/0xdfc0fb148a39066 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaec6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48381 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.666881:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaec6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.666888:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666889:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.666893:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b066ac0/0xdfc0fb148a39066 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48381 expref: 26676 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666900:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b066ac0/0xdfc0fb148a39066 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48381 expref: 26676 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.666907:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b066ac0, rc 0) 00000100:00100000:0.0:1713481296.666919:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800770a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26675:1959:x1796714882416960:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.666924:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562357 00000100:00100000:0.0:1713481296.666998:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417216 00000100:00100000:0.0:1713481296.667002:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417216 00000100:00100000:0.0:1713481296.667019:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562359 00000100:00100000:0.0:1713481296.667024:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26676:1959:x1796714882417216:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.667031:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.667041:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b0661c0/0xdfc0fb148a3906d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaec8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4839d expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.667051:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaec8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.667058:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667059:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667063:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0661c0/0xdfc0fb148a3906d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4839d expref: 26677 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.667077:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b0661c0/0xdfc0fb148a3906d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaec8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4839d expref: 26678 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.667085:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b0661c0, rc 0) 00000100:00100000:0.0:1713481296.667098:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26678:1959:x1796714882417216:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.667103:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562359 00000100:00100000:0.0:1713481296.667167:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.667184:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.667199:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562361 00000100:00100000:0.0:1713481296.667203:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26678:1959:x1796714882417472:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.667206:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562362 00010000:00010000:0.0:1713481296.667210:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.667210:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26678:1959:x1796714882417600:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.667215:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.667218:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b066880/0xdfc0fb148a3907b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483b9 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.667222:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013147ad00/0xdfc0fb148a39082 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaecb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483c7 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.667227:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeca:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.667229:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaecb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.667234:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667235:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667237:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667238:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667239:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b066880/0xdfc0fb148a3907b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483b9 expref: 26680 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667240:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013147ad00/0xdfc0fb148a39082 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaecb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483c7 expref: 26680 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667247:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013147ad00/0xdfc0fb148a39082 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaecb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483c7 expref: 26680 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.667248:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b066880/0xdfc0fb148a3907b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483b9 expref: 26680 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667251:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013147ad00, rc 0) 00010000:00010000:0.0:1713481296.667255:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b066880, rc 0) 00000100:00100000:2.0:1713481296.667262:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26680:1959:x1796714882417600:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.667265:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562362 00000100:00100000:0.0:1713481296.667270:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26680:1959:x1796714882417472:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.667275:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562361 00000100:00100000:0.0:1713481296.667310:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.667321:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882416896 00000100:00100000:0.0:1713481296.667324:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882416896 00000100:00100000:0.0:1713481296.667336:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562364 00000100:00100000:0.0:1713481296.667340:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16563:1959:x1796714882416896:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.667345:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.667353:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b064240/0xdfc0fb148a39090 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4837a expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.667362:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96aa:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.667373:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417024 00000100:00100000:2.0:1713481296.667375:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417024 00000100:00100000:2.0:1713481296.667397:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417152 00000100:00100000:2.0:1713481296.667399:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417152 00000100:00100000:2.0:1713481296.667406:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562365 00000100:00100000:2.0:1713481296.667408:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16565:1959:x1796714882417024:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.667413:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.667419:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801314786c0/0xdfc0fb148a39097 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48388 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.667426:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ab:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.667432:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667433:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667435:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314786c0/0xdfc0fb148a39097 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48388 expref: 16566 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667444:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801314786c0/0xdfc0fb148a39097 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48388 expref: 16566 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667448:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314786c0, rc 0) 00000100:00100000:2.0:1713481296.667456:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16566:1959:x1796714882417024:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.667459:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562365 00010000:00010000:0.0:1713481296.667476:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667477:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.667477:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417280 00000100:00100000:2.0:1713481296.667479:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417280 00010000:00010000:0.0:1713481296.667483:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b064240/0xdfc0fb148a39090 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4837a expref: 16567 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.667487:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562366 00000100:00100000:2.0:1713481296.667489:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16567:1959:x1796714882417152:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.667492:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b064240/0xdfc0fb148a39090 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4837a expref: 16567 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667493:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.667498:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131479d40/0xdfc0fb148a3909e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48396 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.667499:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b064240, rc 0) 00002000:00010000:2.0:1713481296.667506:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ac:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.667513:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.667514:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16568:1959:x1796714882416896:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 172us (203us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.667514:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.667519:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562364 00010000:00010000:2.0:1713481296.667519:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131479d40/0xdfc0fb148a3909e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48396 expref: 16569 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667528:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131479d40/0xdfc0fb148a3909e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48396 expref: 16569 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667535:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131479d40, rc 0) 00000100:00100000:2.0:1713481296.667549:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16568:1959:x1796714882417152:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.667554:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562366 00000100:00100000:0.0:1713481296.667562:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.667579:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417408 00000100:00100000:2.0:1713481296.667582:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417408 00000100:00100000:0.0:1713481296.667586:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.667612:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562368 00000100:00100000:2.0:1713481296.667617:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16568:1959:x1796714882417408:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.667619:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562369 00000100:00100000:0.0:1713481296.667624:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16568:1959:x1796714882417536:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.667624:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.667631:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.667635:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089720b40/0xdfc0fb148a390ac lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483b2 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.667641:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bea1f80/0xdfc0fb148a390b3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483c0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.667645:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ae:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:0.0:1713481296.667652:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96af:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.667653:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667655:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667659:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667659:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089720b40/0xdfc0fb148a390ac lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483b2 expref: 16570 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.667661:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667679:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea1f80/0xdfc0fb148a390b3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483c0 expref: 16570 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667681:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880089720b40/0xdfc0fb148a390ac lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483b2 expref: 16570 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.667688:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bea1f80/0xdfc0fb148a390b3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483c0 expref: 16570 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667688:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089720b40, rc 0) 00010000:00010000:0.0:1713481296.667694:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bea1f80, rc 0) 00000100:00100000:2.0:1713481296.667700:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16570:1959:x1796714882417408:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 83us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.667704:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562368 00000100:00100000:0.0:1713481296.667707:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16570:1959:x1796714882417536:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 82us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.667711:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562369 00000100:00100000:0.0:1713481296.667751:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.667761:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417664 00000100:00100000:0.0:1713481296.667763:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417664 00000100:00100000:0.0:1713481296.667777:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562370 00000100:00100000:0.0:1713481296.667780:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16569:1959:x1796714882417664:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.667784:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.667791:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bea0900/0xdfc0fb148a390ba lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483ce expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.667798:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96b0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.667802:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417728 00000100:00100000:2.0:1713481296.667803:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417728 00010000:00010000:0.0:1713481296.667804:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667805:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.667807:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea0900/0xdfc0fb148a390ba lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483ce expref: 16570 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.667813:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bea0900/0xdfc0fb148a390ba lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483ce expref: 16570 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.667817:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bea0900, rc 0) 00000100:00100000:2.0:1713481296.667821:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562371 00000100:00100000:2.0:1713481296.667824:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26679:1959:x1796714882417728:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.667826:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16570:1959:x1796714882417664:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (75us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.667828:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.667829:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562370 00010000:00010000:2.0:1713481296.667835:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083b158c0/0xdfc0fb148a390c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaecc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483d5 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.667842:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaecc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.667847:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667848:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667851:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083b158c0/0xdfc0fb148a390c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaecc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483d5 expref: 26681 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667856:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083b158c0/0xdfc0fb148a390c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaecc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483d5 expref: 26681 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667861:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083b158c0, rc 0) 00000100:00100000:2.0:1713481296.667869:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26681:1959:x1796714882417728:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.667873:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562371 00000100:00100000:0.0:1713481296.667878:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.667885:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417984 00000100:00100000:2.0:1713481296.667887:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417984 00000100:00100000:2.0:1713481296.667901:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562373 00000100:00100000:2.0:1713481296.667903:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26682:1959:x1796714882417984:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.667907:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.667913:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083b15d40/0xdfc0fb148a390cf lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaece:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483f1 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.667919:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaece:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.667924:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667925:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.667927:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083b15d40/0xdfc0fb148a390cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaece:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483f1 expref: 26683 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667933:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083b15d40/0xdfc0fb148a390cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaece:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483f1 expref: 26682 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.667937:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083b15d40, rc 0) 00000100:00100000:2.0:1713481296.667944:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26682:1959:x1796714882417984:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.667948:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562373 00000100:00100000:0.0:1713481296.667997:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668008:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418112 00000100:00100000:0.0:1713481296.668010:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418112 00000100:00100000:0.0:1713481296.668023:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562374 00000100:00100000:0.0:1713481296.668027:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26682:1959:x1796714882418112:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.668031:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418240 00000100:00100000:2.0:1713481296.668033:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418240 00010000:00010000:0.0:1713481296.668034:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.668041:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bea2400/0xdfc0fb148a390d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaecf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483ff expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.668043:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562375 00000100:00100000:2.0:1713481296.668045:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26683:1959:x1796714882418240:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.668049:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1713481296.668050:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaecf:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.668055:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083b17840/0xdfc0fb148a390dd lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaed0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4840d expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.668057:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668058:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713481296.668061:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaed0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.668062:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bea2400/0xdfc0fb148a390d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaecf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483ff expref: 26684 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.668067:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.668068:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668070:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bea2400/0xdfc0fb148a390d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaecf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483ff expref: 26685 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.668070:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083b17840/0xdfc0fb148a390dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4840d expref: 26685 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.668076:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083b17840/0xdfc0fb148a390dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4840d expref: 26685 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668078:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bea2400, rc 0) 00010000:00010000:2.0:1713481296.668080:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083b17840, rc 0) 00000100:00100000:0.0:1713481296.668092:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26686:1959:x1796714882418112:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.668092:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26686:1959:x1796714882418240:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.668100:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562375 00000100:00100000:0.0:1713481296.668103:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562374 00000100:00100000:0.0:1713481296.668159:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668175:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418496 00000100:00100000:0.0:1713481296.668178:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418496 00000100:00100000:0.0:1713481296.668193:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562377 00000100:00100000:0.0:1713481296.668197:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26686:1959:x1796714882418496:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.668203:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.668216:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132159f80/0xdfc0fb148a390eb lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaed2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48429 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.668227:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaed2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.668235:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668236:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668240:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132159f80/0xdfc0fb148a390eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48429 expref: 26686 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668249:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132159f80/0xdfc0fb148a390eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48429 expref: 26686 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668262:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132159f80, rc 0) 00000100:00100000:0.0:1713481296.668275:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26687:1959:x1796714882418496:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.668281:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562377 00000100:00100000:0.0:1713481296.668373:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668405:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668434:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562379 00000100:00100000:0.0:1713481296.668440:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26688:1959:x1796714882418752:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.668447:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.668456:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013215b3c0/0xdfc0fb148a390f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaed4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48445 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.668466:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaed4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.668474:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668476:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668480:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013215b3c0/0xdfc0fb148a390f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48445 expref: 26690 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668490:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013215b3c0/0xdfc0fb148a390f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48445 expref: 26690 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668497:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013215b3c0, rc 0) 00000100:00100000:0.0:1713481296.668511:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26689:1959:x1796714882418752:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.668520:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562379 00000100:00100000:0.0:1713481296.668564:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668577:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419008 00000100:00100000:0.0:1713481296.668580:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419008 00000100:00100000:0.0:1713481296.668603:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419136 00000100:00100000:0.0:1713481296.668605:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419136 00000100:00100000:0.0:1713481296.668621:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562382 00000100:00100000:0.0:1713481296.668625:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26690:1959:x1796714882419136:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.668631:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.668639:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013215ad00/0xdfc0fb148a3910e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaed7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4846f expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.668648:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaed7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.668655:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668656:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668659:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013215ad00/0xdfc0fb148a3910e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4846f expref: 26692 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668683:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013215ad00/0xdfc0fb148a3910e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4846f expref: 26692 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668689:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013215ad00, rc 0) 00000100:00100000:0.0:1713481296.668701:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26692:1959:x1796714882419136:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 76us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.668706:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562382 00000100:00100000:0.0:1713481296.668756:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668774:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668782:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882417920 00000100:00100000:0.0:1713481296.668784:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882417920 00000100:00100000:0.0:1713481296.668794:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562383 00000100:00100000:0.0:1713481296.668797:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16571:1959:x1796714882417792:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.668801:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.668808:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f698c0/0xdfc0fb148a39115 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483dc expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.668815:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96b1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.668820:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668821:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000001:00080000:3.0:1713481296.668821:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040750 00010000:00010000:0.0:1713481296.668824:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f698c0/0xdfc0fb148a39115 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483dc expref: 16572 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668830:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f698c0/0xdfc0fb148a39115 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483dc expref: 16572 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668834:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f698c0, rc 0) 00000100:00100000:0.0:1713481296.668842:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16573:1959:x1796714882417792:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.668845:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562383 00000100:00100000:0.0:1713481296.668867:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.668874:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418048 00000100:00100000:0.0:1713481296.668876:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418048 00002000:00080000:3.0:1713481296.668883:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 55762 00000100:00100000:0.0:1713481296.668884:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562385 00000100:00100000:0.0:1713481296.668887:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16572:1959:x1796714882418048:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.668893:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.668899:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f6aac0/0xdfc0fb148a39123 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa483f8 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.668907:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96b3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.668913:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668914:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.668916:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f6aac0/0xdfc0fb148a39123 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483f8 expref: 16573 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.668922:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f6aac0/0xdfc0fb148a39123 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa483f8 expref: 16573 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669096:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f6aac0, rc 0) 00000100:00100000:0.0:1713481296.669114:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16574:1959:x1796714882418048:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 224us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.669141:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562385 00000100:00100000:0.0:1713481296.669180:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.669194:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418432 00000100:00100000:0.0:1713481296.669197:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418432 00000100:00100000:0.0:1713481296.669211:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562388 00000100:00100000:0.0:1713481296.669215:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16575:1959:x1796714882418432:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.669221:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.669230:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f68240/0xdfc0fb148a39138 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48422 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.669239:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96b6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.669247:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669248:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669252:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f68240/0xdfc0fb148a39138 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48422 expref: 16576 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669260:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f68240/0xdfc0fb148a39138 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48422 expref: 16577 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669266:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f68240, rc 0) 00000100:00100000:0.0:1713481296.669362:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16577:1959:x1796714882418432:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 145us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.669367:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562388 00000100:00100000:0.0:1713481296.669384:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418688 00000100:00100000:0.0:1713481296.669386:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418688 00000100:00100000:0.0:1713481296.669431:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.669443:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418816 00000100:00100000:0.0:1713481296.669446:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418816 00000100:00100000:0.0:1713481296.669468:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562391 00000100:00100000:0.0:1713481296.669473:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16578:1959:x1796714882418816:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.669479:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.669488:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f68000/0xdfc0fb148a3914d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4844c expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.669499:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96b9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.669507:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669509:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669512:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f68000/0xdfc0fb148a3914d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4844c expref: 16579 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669527:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f68000/0xdfc0fb148a3914d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4844c expref: 16579 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669534:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f68000, rc 0) 00000100:00100000:0.0:1713481296.669546:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16579:1959:x1796714882418816:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.669551:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562391 00000100:00100000:0.0:1713481296.669570:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882418944 00000100:00100000:0.0:1713481296.669572:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882418944 00000100:00100000:0.0:1713481296.669590:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562392 00000100:00100000:0.0:1713481296.669594:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16579:1959:x1796714882418944:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.669599:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.669606:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f69680/0xdfc0fb148a39154 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4845a expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.669615:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ba:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.669623:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669624:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669628:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f69680/0xdfc0fb148a39154 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4845a expref: 16581 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669637:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f69680/0xdfc0fb148a39154 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4845a expref: 16581 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669644:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f69680, rc 0) 00000100:00100000:0.0:1713481296.669657:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16582:1959:x1796714882418944:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.669662:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562392 00000100:00100000:0.0:1713481296.669708:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.669718:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419200 00000100:00100000:0.0:1713481296.669721:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419200 00000100:00100000:0.0:1713481296.669739:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562394 00000100:00100000:0.0:1713481296.669743:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16581:1959:x1796714882419200:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.669748:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.669757:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096125f80/0xdfc0fb148a39162 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48476 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.669767:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96bc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.669774:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669776:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669780:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096125f80/0xdfc0fb148a39162 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48476 expref: 16582 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669788:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096125f80/0xdfc0fb148a39162 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48476 expref: 16582 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669792:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096125f80, rc 0) 00000100:00100000:0.0:1713481296.669802:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16582:1959:x1796714882419200:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 59us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.669805:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562394 00000100:00100000:0.0:1713481296.669835:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.669842:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419392 00000100:00100000:0.0:1713481296.669844:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419392 00000100:00100000:0.0:1713481296.669860:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562396 00000100:00100000:0.0:1713481296.669863:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26693:1959:x1796714882419392:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.669867:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.669875:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096124fc0/0xdfc0fb148a39170 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaed9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4848b expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.669887:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaed9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.669894:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669896:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.669900:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096124fc0/0xdfc0fb148a39170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4848b expref: 26694 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669909:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096124fc0/0xdfc0fb148a39170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaed9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4848b expref: 26694 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.669916:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096124fc0, rc 0) 00000100:00100000:0.0:1713481296.669930:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26693:1959:x1796714882419392:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.669935:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562396 00000100:00100000:0.0:1713481296.669988:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419520 00000100:00100000:0.0:1713481296.669991:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419520 00000100:00100000:0.0:1713481296.670012:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419648 00000100:00100000:0.0:1713481296.670014:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419648 00000100:00100000:0.0:1713481296.670030:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562398 00000100:00100000:0.0:1713481296.670034:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26694:1959:x1796714882419648:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.670041:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.670050:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096125440/0xdfc0fb148a3917e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaedb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa484a7 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.670060:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaedb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.670067:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670069:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670073:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096125440/0xdfc0fb148a3917e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484a7 expref: 26696 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670083:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096125440/0xdfc0fb148a3917e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484a7 expref: 26696 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670090:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096125440, rc 0) 00000100:00100000:0.0:1713481296.670105:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26696:1959:x1796714882419648:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.670110:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562398 00000100:00100000:0.0:1713481296.670185:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419776 00000100:00100000:0.0:1713481296.670189:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419776 00000100:00100000:0.0:1713481296.670214:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562399 00000100:00100000:0.0:1713481296.670219:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26696:1959:x1796714882419776:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.670226:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.670235:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fbe880/0xdfc0fb148a39185 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaedc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa484b5 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.670245:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaedc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.670253:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670255:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670259:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbe880/0xdfc0fb148a39185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaedc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484b5 expref: 26698 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670268:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fbe880/0xdfc0fb148a39185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaedc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484b5 expref: 26698 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670275:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbe880, rc 0) 00000100:00100000:0.0:1713481296.670288:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26698:1959:x1796714882419776:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.670293:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562399 00000100:00100000:0.0:1713481296.670330:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.670352:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.670374:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.670404:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562401 00000100:00100000:0.0:1713481296.670409:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26699:1959:x1796714882420160:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.670415:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.670424:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737b86c0/0xdfc0fb148a39193 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaedf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa484df expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.670434:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaedf:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.670440:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670442:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670445:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737b86c0/0xdfc0fb148a39193 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484df expref: 26701 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670453:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737b86c0/0xdfc0fb148a39193 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484df expref: 26701 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670464:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737b86c0, rc 0) 00000100:00100000:0.0:1713481296.670476:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26701:1959:x1796714882420160:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.670481:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562401 00000100:00100000:0.0:1713481296.670535:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.670547:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420416 00000100:00100000:0.0:1713481296.670550:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420416 00000100:00100000:0.0:1713481296.670574:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562404 00000100:00100000:0.0:1713481296.670578:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26701:1959:x1796714882420416:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.670584:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.670594:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737b8240/0xdfc0fb148a391a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaee1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa484fb expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.670603:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaee1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.670610:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670611:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670614:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737b8240/0xdfc0fb148a391a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484fb expref: 26701 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670622:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737b8240/0xdfc0fb148a391a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484fb expref: 26701 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670628:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737b8240, rc 0) 00000100:00100000:0.0:1713481296.670639:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26701:1959:x1796714882420416:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.670646:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562404 00000100:00100000:0.0:1713481296.670702:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.670711:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419456 00000100:00100000:0.0:1713481296.670713:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419456 00000100:00100000:0.0:1713481296.670731:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562406 00000100:00100000:0.0:1713481296.670735:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16584:1959:x1796714882419456:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.670740:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.670748:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737ba1c0/0xdfc0fb148a391b6 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48492 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.670757:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96be:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.670764:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670945:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.670950:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737ba1c0/0xdfc0fb148a391b6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48492 expref: 16585 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670960:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737ba1c0/0xdfc0fb148a391b6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48492 expref: 16586 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.670967:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737ba1c0, rc 0) 00000100:00100000:0.0:1713481296.670979:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16586:1959:x1796714882419456:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 244us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.670984:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562406 00000100:00100000:0.0:1713481296.671023:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.671037:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419840 00000100:00100000:0.0:1713481296.671040:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419840 00000100:00100000:0.0:1713481296.671084:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.671096:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882419968 00000100:00100000:0.0:1713481296.671099:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882419968 00000100:00100000:0.0:1713481296.671114:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562410 00000100:00100000:0.0:1713481296.671133:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16588:1959:x1796714882419968:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.671140:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.671149:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737b9f80/0xdfc0fb148a391d2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa484ca expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.671207:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96c2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.671216:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671217:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671221:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737b9f80/0xdfc0fb148a391d2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484ca expref: 16588 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671230:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737b9f80/0xdfc0fb148a391d2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484ca expref: 16588 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671236:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737b9f80, rc 0) 00000100:00100000:0.0:1713481296.671247:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16588:1959:x1796714882419968:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 128us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.671252:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562410 00000100:00100000:0.0:1713481296.671347:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420096 00000100:00100000:0.0:1713481296.671349:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420096 00000100:00100000:0.0:1713481296.671361:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420224 00000100:00100000:0.0:1713481296.671363:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420224 00000100:00100000:0.0:1713481296.671379:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562412 00000100:00100000:0.0:1713481296.671383:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800801af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16589:1959:x1796714882420224:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.671389:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.671397:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737b9680/0xdfc0fb148a391e0 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa484e6 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.671406:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96c4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.671413:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671414:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671418:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737b9680/0xdfc0fb148a391e0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484e6 expref: 16591 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671427:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737b9680/0xdfc0fb148a391e0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa484e6 expref: 16591 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671432:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737b9680, rc 0) 00000100:00100000:0.0:1713481296.671442:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800801af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16591:1959:x1796714882420224:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 59us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.671449:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562412 00000100:00100000:0.0:1713481296.671499:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420352 00000100:00100000:0.0:1713481296.671503:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420352 00000100:00100000:0.0:1713481296.671526:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420480 00000100:00100000:0.0:1713481296.671528:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420480 00000100:00100000:0.0:1713481296.671579:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.671590:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420544 00000100:00100000:2.0:1713481296.671594:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420544 00000100:00100000:0.0:1713481296.671629:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.671642:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420672 00000100:00100000:0.0:1713481296.671644:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420672 00000100:00100000:0.0:1713481296.671657:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562416 00000100:00100000:0.0:1713481296.671662:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26703:1959:x1796714882420672:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.671686:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.671696:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737bb840/0xdfc0fb148a391f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaee3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48517 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.671705:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaee3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.671712:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671713:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671717:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737bb840/0xdfc0fb148a391f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48517 expref: 26703 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671725:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737bb840/0xdfc0fb148a391f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48517 expref: 26703 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671732:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737bb840, rc 0) 00000100:00100000:0.0:1713481296.671743:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26703:1959:x1796714882420672:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 81us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.671748:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562416 00000100:00100000:0.0:1713481296.671797:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.671807:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420800 00000100:00100000:0.0:1713481296.671809:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420800 00000100:00100000:0.0:1713481296.671826:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562417 00000100:00100000:0.0:1713481296.671830:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26703:1959:x1796714882420800:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.671836:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.671848:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800836546c0/0xdfc0fb148a39203 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaee4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48525 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.671858:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaee4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.671867:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671868:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.671872:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800836546c0/0xdfc0fb148a39203 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48525 expref: 26704 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671880:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800836546c0/0xdfc0fb148a39203 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48525 expref: 26705 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.671888:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800836546c0, rc 0) 00000100:00100000:0.0:1713481296.671901:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26705:1959:x1796714882420800:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.671907:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562417 00000100:00100000:0.0:1713481296.671973:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.671988:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882421056 00000100:00100000:0.0:1713481296.671991:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882421056 00000100:00100000:0.0:1713481296.672010:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562419 00000100:00100000:0.0:1713481296.672014:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26705:1959:x1796714882421056:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.672020:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.672027:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083654d80/0xdfc0fb148a39211 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaee6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48541 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.672036:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaee6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.672043:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672045:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672049:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083654d80/0xdfc0fb148a39211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48541 expref: 26706 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672062:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083654d80/0xdfc0fb148a39211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48541 expref: 26707 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672070:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083654d80, rc 0) 00000100:00100000:0.0:1713481296.672083:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26707:1959:x1796714882421056:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.672088:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562419 00000100:00100000:0.0:1713481296.672167:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.672225:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.672237:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882421440 00000100:00100000:0.0:1713481296.672239:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882421440 00000100:00100000:0.0:1713481296.672260:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562422 00000100:00100000:0.0:1713481296.672264:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26709:1959:x1796714882421440:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.672270:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.672278:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083655b00/0xdfc0fb148a39226 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaee9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4856b expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.672287:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaee9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.672294:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672295:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672299:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083655b00/0xdfc0fb148a39226 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4856b expref: 26709 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672307:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083655b00/0xdfc0fb148a39226 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4856b expref: 26709 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672318:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083655b00, rc 0) 00000100:00100000:0.0:1713481296.672330:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26709:1959:x1796714882421440:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.672335:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562422 00000100:00100000:0.0:1713481296.672388:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.672404:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882421696 00000100:00100000:0.0:1713481296.672407:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882421696 00000100:00100000:0.0:1713481296.672432:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562424 00000100:00100000:0.0:1713481296.672437:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26710:1959:x1796714882421696:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.672443:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.672453:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073553a80/0xdfc0fb148a39234 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeeb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48587 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.672463:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeeb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.672471:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672472:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672476:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073553a80/0xdfc0fb148a39234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48587 expref: 26712 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672484:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073553a80/0xdfc0fb148a39234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48587 expref: 26712 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672491:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073553a80, rc 0) 00000100:00100000:0.0:1713481296.672505:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26713:1959:x1796714882421696:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.672514:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562424 00000100:00100000:0.0:1713481296.672652:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.672688:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422080 00000100:00100000:2.0:1713481296.672692:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422080 00000100:00100000:2.0:1713481296.672711:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562427 00000100:00100000:2.0:1713481296.672715:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26714:1959:x1796714882422080:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.672721:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.672729:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008318a400/0xdfc0fb148a39249 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa485b1 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.672737:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.672739:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeee:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.672745:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.672746:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.672750:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008318a400/0xdfc0fb148a39249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485b1 expref: 26714 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.672757:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008318a400/0xdfc0fb148a39249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485b1 expref: 26714 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.672758:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.672762:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008318a400, rc 0) 00000100:00100000:2.0:1713481296.672774:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26714:1959:x1796714882422080:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 59us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.672779:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562427 00000100:00100000:0.0:1713481296.672782:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562428 00000100:00100000:0.0:1713481296.672787:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16593:1959:x1796714882420608:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.672792:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562429 00010000:00010000:0.0:1713481296.672793:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.672795:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16593:1959:x1796714882420736:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.672799:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.672801:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073552ac0/0xdfc0fb148a39250 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48510 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.672805:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083189d40/0xdfc0fb148a39257 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4851e expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.672811:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96c7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.672812:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96c8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.672818:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.672818:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672819:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.672819:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.672822:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083189d40/0xdfc0fb148a39257 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4851e expref: 16595 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672823:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073552ac0/0xdfc0fb148a39250 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48510 expref: 16595 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.672828:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880083189d40/0xdfc0fb148a39257 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4851e expref: 16595 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672831:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073552ac0/0xdfc0fb148a39250 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48510 expref: 16595 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.672832:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083189d40, rc 0) 00010000:00010000:0.0:1713481296.672837:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073552ac0, rc 0) 00000100:00100000:2.0:1713481296.672840:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16596:1959:x1796714882420736:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.672844:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562429 00000100:00100000:0.0:1713481296.672848:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16596:1959:x1796714882420608:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.672852:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562428 00000100:00100000:0.0:1713481296.672881:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.672889:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882420992 00000100:00100000:0.0:1713481296.672892:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882420992 00000100:00100000:0.0:1713481296.672903:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562431 00000100:00100000:0.0:1713481296.672907:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16595:1959:x1796714882420992:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.672912:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.672920:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073550240/0xdfc0fb148a39265 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4853a expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.672930:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ca:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.672938:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672939:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.672942:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073550240/0xdfc0fb148a39265 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4853a expref: 16596 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672948:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073550240/0xdfc0fb148a39265 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4853a expref: 16597 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.672952:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073550240, rc 0) 00000100:00100000:0.0:1713481296.672962:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16597:1959:x1796714882420992:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 55us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.672965:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562431 00000100:00100000:0.0:1713481296.672989:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.673001:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.673011:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.673026:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.673026:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882421248 00000100:00100000:2.0:1713481296.673030:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882421248 00000100:00100000:2.0:1713481296.673046:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882421632 00000100:00100000:2.0:1713481296.673047:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882421632 00000100:00100000:2.0:1713481296.673068:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562434 00000100:00100000:2.0:1713481296.673072:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16600:1959:x1796714882421504:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.673077:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.673084:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008318b180/0xdfc0fb148a3927a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48572 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.673084:0:16474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562435 00002000:00010000:2.0:1713481296.673092:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ce:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.673092:0:16474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16601:1959:x1796714882421632:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.673098:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.673099:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.673102:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008318b180/0xdfc0fb148a3927a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48572 expref: 16602 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.673102:0:16474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.673109:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008318b180/0xdfc0fb148a3927a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48572 expref: 16601 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.673113:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008318b180, rc 0) 00000100:00100000:2.0:1713481296.673137:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16601:1959:x1796714882421504:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.673142:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562434 00010000:00010000:3.0:1713481296.673143:0:16474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089419f80/0xdfc0fb148a39281 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48580 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.673147:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:3.0:1713481296.673163:0:16474:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96cf:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.673176:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.673177:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.673179:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.673180:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562437 00000100:00100000:2.0:1713481296.673184:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16602:1959:x1796714882421248:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.673184:0:16474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089419f80/0xdfc0fb148a39281 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48580 expref: 16602 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.673188:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.673195:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083188240/0xdfc0fb148a39288 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48556 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.673197:0:16474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880089419f80/0xdfc0fb148a39281 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48580 expref: 16603 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.673201:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.673202:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96cc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.673207:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.673207:0:16474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089419f80, rc 0) 00010000:00010000:2.0:1713481296.673208:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.673211:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083188240/0xdfc0fb148a39288 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48556 expref: 16604 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.673217:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880083188240/0xdfc0fb148a39288 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48556 expref: 16604 pid: 15507 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.673218:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.673222:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083188240, rc 0) 00000100:00100000:3.0:1713481296.673229:0:16474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16605:1959:x1796714882421632:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 138us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.673233:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16605:1959:x1796714882421248:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.673236:0:16474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562435 00000100:00100000:0.0:1713481296.673239:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.673241:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562437 00000100:00100000:0.0:1713481296.673257:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.673262:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422016 00000100:00100000:3.0:1713481296.673264:0:16474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422208 00000100:00100000:2.0:1713481296.673265:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422016 00000100:00100000:3.0:1713481296.673268:0:16474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422208 00000100:00100000:0.0:1713481296.673273:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.673292:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422592 00000100:00100000:2.0:1713481296.673294:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422592 00000100:00100000:3.0:1713481296.673302:0:16474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562439 00000100:00100000:3.0:1713481296.673308:0:16474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26717:1959:x1796714882422336:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.673313:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562441 00010000:00010000:3.0:1713481296.673316:0:16474:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.673319:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26717:1959:x1796714882422208:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.673319:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562442 00000100:00100000:2.0:1713481296.673323:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26717:1959:x1796714882422464:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.673327:0:16474:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008941aac0/0xdfc0fb148a3929d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaef0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa485cd expref: -99 pid: 16474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.673331:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.673340:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b9c4900/0xdfc0fb148a392a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaef1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa485db expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.673340:0:16474:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaef0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.673349:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713481296.673350:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaef1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.673350:0:16474:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.673355:0:16474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008941aac0/0xdfc0fb148a3929d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485cd expref: 26718 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.673358:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.673360:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.673364:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b9c4900/0xdfc0fb148a392a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485db expref: 26719 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.673369:0:16474:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008941aac0/0xdfc0fb148a3929d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485cd expref: 26719 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.673374:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b9c4900/0xdfc0fb148a392a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485db expref: 26719 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.673377:0:16474:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008941aac0, rc 0) 00010000:00010000:2.0:1713481296.673386:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b9c4900, rc 0) 00000100:00100000:3.0:1713481296.673394:0:16474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26719:1959:x1796714882422336:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.673401:0:16474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562439 00000100:00100000:2.0:1713481296.673402:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26720:1959:x1796714882422464:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 78us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.673408:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.673408:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562442 00010000:00010000:0.0:1713481296.673417:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073553180/0xdfc0fb148a392b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaeef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa485bf expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.673428:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaeef:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.673436:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.673437:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.673442:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073553180/0xdfc0fb148a392b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485bf expref: 26718 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.673452:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073553180/0xdfc0fb148a392b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaeef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485bf expref: 26718 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.673458:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073553180, rc 0) 00000100:00100000:0.0:1713481296.673471:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26718:1959:x1796714882422208:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 152us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.673476:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562441 00000100:00100000:0.0:1713481296.673542:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422720 00000100:00100000:0.0:1713481296.673545:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422720 00000100:00100000:2.0:1713481296.673735:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562445 00000100:00100000:2.0:1713481296.673741:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800801ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26721:1959:x1796714882422976:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.673748:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.673759:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b9c6f40/0xdfc0fb148a392c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaef5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48613 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.673770:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaef5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.673777:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.673778:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.673782:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b9c6f40/0xdfc0fb148a392c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48613 expref: 26721 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.673791:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b9c6f40/0xdfc0fb148a392c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48613 expref: 26721 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.673798:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b9c6f40, rc 0) 00000100:00100000:2.0:1713481296.673812:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800801ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26721:1959:x1796714882422976:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.673816:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562445 00000100:00100000:0.0:1713481296.673953:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.673963:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423232 00000100:00100000:0.0:1713481296.673966:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423232 00000100:00100000:0.0:1713481296.673983:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562448 00000100:00100000:0.0:1713481296.673987:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26722:1959:x1796714882423232:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.673993:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.674002:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9f73c0/0xdfc0fb148a392dc lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaef7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4862f expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.674012:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaef7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.674018:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.674019:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.674023:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f9f73c0/0xdfc0fb148a392dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4862f expref: 26723 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.674031:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f9f73c0/0xdfc0fb148a392dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4862f expref: 26724 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.674037:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f73c0, rc 0) 00000100:00100000:0.0:1713481296.674050:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26724:1959:x1796714882423232:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.674054:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562448 00000100:00100000:0.0:1713481296.674083:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.674092:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423488 00000100:00100000:0.0:1713481296.674094:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423488 00000100:00100000:0.0:1713481296.674204:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562450 00000100:00100000:0.0:1713481296.674213:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26724:1959:x1796714882423488:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.674219:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.674229:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9f7840/0xdfc0fb148a392ea lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaef9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4864b expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.674240:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaef9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.674262:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.674264:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.674269:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f9f7840/0xdfc0fb148a392ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4864b expref: 26726 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.674278:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f9f7840/0xdfc0fb148a392ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4864b expref: 26727 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.674285:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f7840, rc 0) 00000100:00100000:0.0:1713481296.674298:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26727:1959:x1796714882423488:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.674302:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562450 00000100:00100000:0.0:1713481296.674443:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.674459:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423744 00000100:00100000:0.0:1713481296.674462:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423744 00000100:00100000:0.0:1713481296.674485:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562452 00000100:00100000:0.0:1713481296.674489:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26727:1959:x1796714882423744:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.674496:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.674506:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9f7600/0xdfc0fb148a392f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaefb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48667 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.674516:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaefb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.674601:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.674603:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.674608:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f9f7600/0xdfc0fb148a392f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48667 expref: 26728 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.674696:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f9f7600/0xdfc0fb148a392f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48667 expref: 26730 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.674705:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9f7600, rc 0) 00000100:00100000:0.0:1713481296.674720:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26730:1959:x1796714882423744:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 229us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.674725:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562452 00000100:00100000:0.0:1713481296.674811:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.675145:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.675384:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.675412:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.675432:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562457 00000100:00100000:0.0:1713481296.675438:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26732:1959:x1796714882424384:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.675445:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.675454:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800914e5200/0xdfc0fb148a39322 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa486ad expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.675465:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf00:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.675472:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.675474:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.675478:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914e5200/0xdfc0fb148a39322 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486ad expref: 26734 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.675487:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800914e5200/0xdfc0fb148a39322 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486ad expref: 26734 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.675495:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914e5200, rc 0) 00000100:00100000:0.0:1713481296.675508:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26733:1959:x1796714882424384:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.675514:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562457 00000100:00100000:0.0:1713481296.675740:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882424768 00000100:00100000:0.0:1713481296.675744:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882424768 00000100:00100000:2.0:1713481296.675782:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784480768:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.675813:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.675892:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562461 00000100:00100000:2.0:1713481296.675896:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26734:1959:x1796714882424768:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.675916:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.675926:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b9c4480/0xdfc0fb148a3933e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf03:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa486d7 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.675936:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf03:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.675943:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.675944:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.675947:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b9c4480/0xdfc0fb148a3933e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486d7 expref: 26735 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.675953:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b9c4480/0xdfc0fb148a3933e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486d7 expref: 26735 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.675958:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b9c4480, rc 0) 00000100:00100000:2.0:1713481296.675969:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26735:1959:x1796714882424768:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.675974:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562461 00000100:00100000:0.0:1713481296.676032:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076afce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784480576:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.676062:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dca4000/0xdfc0fb148a38a07 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e48 expref: 16605 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.676071:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dca4000, rc 0) 00000100:00100000:0.0:1713481296.676087:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16605:11388:x1796714882402368:12345-192.168.202.24@tcp:101:dd.0 Request processed in 29182us (29226us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.676093:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562157 00000100:00100000:2.0:1713481296.676172:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422400 00000100:00100000:2.0:1713481296.676175:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422400 00000100:00100000:2.0:1713481296.676191:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562463 00000100:00100000:2.0:1713481296.676195:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16605:1959:x1796714882422400:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.676196:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882424832 00000100:00100000:0.0:1713481296.676200:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882424832 00010000:00010000:2.0:1713481296.676201:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.676209:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d371440/0xdfc0fb148a39345 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa485d4 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.676217:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96d5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.676223:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422528 00010000:00010000:2.0:1713481296.676223:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.676224:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.676225:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422528 00010000:00010000:2.0:1713481296.676227:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d371440/0xdfc0fb148a39345 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485d4 expref: 16607 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.676233:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d371440/0xdfc0fb148a39345 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485d4 expref: 16608 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.676238:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d371440, rc 0) 00000100:00100000:2.0:1713481296.676247:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16608:1959:x1796714882422400:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.676251:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562463 00000100:00100000:0.0:1713481296.676290:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562465 00000100:00100000:0.0:1713481296.676294:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16607:1959:x1796714882422528:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.676300:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.676309:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089b9e640/0xdfc0fb148a39353 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa485e2 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.676319:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96d6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.676327:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.676328:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.676330:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422656 00010000:00010000:0.0:1713481296.676332:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089b9e640/0xdfc0fb148a39353 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485e2 expref: 16608 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.676334:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422656 00010000:00010000:0.0:1713481296.676340:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880089b9e640/0xdfc0fb148a39353 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485e2 expref: 16609 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.676346:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089b9e640, rc 0) 00000100:00100000:2.0:1713481296.676353:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562466 00000100:00100000:2.0:1713481296.676357:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16610:1959:x1796714882422656:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.676358:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16610:1959:x1796714882422528:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.676363:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562465 00010000:00010000:2.0:1713481296.676364:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.676374:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d370240/0xdfc0fb148a3935a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa485f0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.676385:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96d7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.676395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.676396:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.676397:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.676402:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d370240/0xdfc0fb148a3935a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485f0 expref: 16611 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.676408:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882422912 00000100:00100000:0.0:1713481296.676411:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882422912 00010000:00010000:2.0:1713481296.676411:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d370240/0xdfc0fb148a3935a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa485f0 expref: 16611 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.676418:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d370240, rc 0) 00000100:00100000:2.0:1713481296.676433:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16611:1959:x1796714882422656:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.676439:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562466 00000100:00100000:0.0:1713481296.676448:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.676459:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423040 00000100:00100000:2.0:1713481296.676461:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423040 00000100:00100000:0.0:1713481296.676477:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.676482:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423168 00000100:00100000:2.0:1713481296.676484:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423168 00000100:00100000:0.0:1713481296.676492:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562470 00000100:00100000:0.0:1713481296.676496:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16612:1959:x1796714882423168:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.676504:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.676513:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089b9cd80/0xdfc0fb148a39376 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48628 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.676524:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96db:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.676530:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.676531:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.676534:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089b9cd80/0xdfc0fb148a39376 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48628 expref: 16614 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.676544:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880089b9cd80/0xdfc0fb148a39376 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48628 expref: 16613 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.676551:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089b9cd80, rc 0) 00000100:00100000:0.0:1713481296.676565:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16613:1959:x1796714882423168:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.676571:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562470 00000100:00100000:0.0:1713481296.676589:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423296 00000100:00100000:0.0:1713481296.676591:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423296 00000100:00100000:2.0:1713481296.676596:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423424 00000100:00100000:2.0:1713481296.676597:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423424 00000100:00100000:0.0:1713481296.676617:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562471 00000100:00100000:2.0:1713481296.676620:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562472 00000100:00100000:0.0:1713481296.676621:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16614:1959:x1796714882423296:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.676624:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16614:1959:x1796714882423424:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.676627:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.676629:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.676722:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089b9ed00/0xdfc0fb148a3937d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48636 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.676723:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d370b40/0xdfc0fb148a39384 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48644 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.676736:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96dd:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.676745:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.676746:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.676750:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d370b40/0xdfc0fb148a39384 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48644 expref: 16619 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.676761:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d370b40/0xdfc0fb148a39384 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48644 expref: 16619 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.676769:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d370b40, rc 0) 00000100:00100000:2.0:1713481296.676783:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16618:1959:x1796714882423424:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 158us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.676789:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562472 00000100:00100000:2.0:1713481296.676807:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562475 00000100:00100000:2.0:1713481296.676811:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16618:1959:x1796714882423808:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.676812:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96dc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.676817:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.676823:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.676824:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.676826:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d370d80/0xdfc0fb148a39399 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4866e expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.676829:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089b9ed00/0xdfc0fb148a3937d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48636 expref: 16618 pid: 16493 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.676836:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96e0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.676839:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880089b9ed00/0xdfc0fb148a3937d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48636 expref: 16618 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.676844:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.676846:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.676847:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089b9ed00, rc 0) 00010000:00010000:2.0:1713481296.676850:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d370d80/0xdfc0fb148a39399 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4866e expref: 16619 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.676860:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16619:1959:x1796714882423296:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 239us (294us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.676860:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d370d80/0xdfc0fb148a39399 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4866e expref: 16619 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.676865:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562471 00010000:00010000:2.0:1713481296.676867:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d370d80, rc 0) 00000100:00100000:2.0:1713481296.676880:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16618:1959:x1796714882423808:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.676887:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562475 00000100:00100000:0.0:1713481296.676890:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820153 00000100:00100000:0.0:1713481296.676894:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20864:1957:x1796714882424896:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.676901:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.676905:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c18ad00/0xdfc0fb148941a33 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6972:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00c4 expref: 20864 pid: 16469 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.676914:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c18ad00/0xdfc0fb148941a33 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6972:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00c4 expref: 20864 pid: 16469 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.676931:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c18ad00/0xdfc0fb148941a33 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6972:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00c4 expref: 20864 pid: 16469 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.676943:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.676944:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.676947:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dca4000/0xdfc0fb148a38a07 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e48 expref: 16617 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.676954:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dca4000/0xdfc0fb148a38a07 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e48 expref: 16617 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.676971:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007dca4000/0xdfc0fb148a38a07 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e48 expref: 16617 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.676980:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784483648:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.676998:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c7d3900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.677039:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.677055:0:15499:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15499:1796714784480960:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.677062:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882423936 00000100:00100000:0.0:1713481296.677065:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882423936 00000100:00100000:0.0:1713481296.677078:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562476 00000100:00100000:0.0:1713481296.677080:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16618:1959:x1796714882423936:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.677084:0:15499:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.677085:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.677092:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ac2d00/0xdfc0fb148a393a0 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4867c expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.677100:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96e1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.677105:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677106:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677108:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac2d00/0xdfc0fb148a393a0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4867c expref: 16619 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677113:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ac2d00/0xdfc0fb148a393a0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4867c expref: 16619 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677118:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac2d00, rc 0) 00000001:00080000:3.0:1713481296.677138:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040751 00000100:00100000:0.0:1713481296.677144:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16619:1959:x1796714882423936:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.677148:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562476 00000100:00100000:0.0:1713481296.677179:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.677192:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882424064 00000100:00100000:0.0:1713481296.677195:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882424064 00000100:00100000:0.0:1713481296.677209:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562477 00000100:00100000:0.0:1713481296.677214:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16619:1959:x1796714882424064:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00080000:3.0:1713481296.677215:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 55890 00010000:00010000:0.0:1713481296.677220:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.677229:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ac1b00/0xdfc0fb148a393a7 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4868a expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.677239:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96e2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.677247:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677248:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677253:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac1b00/0xdfc0fb148a393a7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4868a expref: 16620 pid: 16542 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1713481296.677259:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d5f480/2, rc 0, transno 1073456 00010000:00010000:0.0:1713481296.677262:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ac1b00/0xdfc0fb148a393a7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4868a expref: 16620 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.677265:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784480704:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.677269:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac1b00, rc 0) 00000100:00100000:0.0:1713481296.677282:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16620:1959:x1796714882424064:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.677288:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562477 00000100:00100000:2.0:1713481296.677301:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784483712:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.677317:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.677328:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562478 00000100:00100000:0.0:1713481296.677333:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16620:1959:x1796714882424192:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.677338:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.677347:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148a393ae lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48698 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.677356:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96e3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.677362:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677364:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677367:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148a393ae lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48698 expref: 16621 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677374:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ac2400/0xdfc0fb148a393ae lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48698 expref: 16621 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677380:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac2400, rc 0) 00000100:00100000:0.0:1713481296.677391:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16621:1959:x1796714882424192:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 57us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.677395:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562478 00000100:00100000:0.0:1713481296.677424:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.677438:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.677448:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562480 00000100:00100000:0.0:1713481296.677452:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16622:1959:x1796714882424320:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.677458:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.677465:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ac06c0/0xdfc0fb148a393bc lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa486a6 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.677474:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96e4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.677481:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677483:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677486:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac06c0/0xdfc0fb148a393bc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486a6 expref: 16624 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677495:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ac06c0/0xdfc0fb148a393bc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486a6 expref: 16624 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677507:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac06c0, rc 0) 00000100:00100000:0.0:1713481296.677520:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16624:1959:x1796714882424320:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.677526:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562480 00000100:00100000:0.0:1713481296.677563:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.677579:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882424576 00000100:00100000:0.0:1713481296.677582:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882424576 00000100:00100000:0.0:1713481296.677608:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562482 00000100:00100000:0.0:1713481296.677612:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16624:1959:x1796714882424576:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.677619:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.677630:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ac3600/0xdfc0fb148a393d1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa486c2 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.677640:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96e6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.677648:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677649:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677653:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac3600/0xdfc0fb148a393d1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486c2 expref: 16626 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677663:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ac3600/0xdfc0fb148a393d1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486c2 expref: 16626 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.677800:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac3600, rc 0) 00000100:00100000:0.0:1713481296.677819:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882425216 00000100:00100000:0.0:1713481296.677822:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882425216 00010000:00010000:0.0:1713481296.677834:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008901e1c0/0xdfc0fb148688a29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2877 expref: 26735 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.677845:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882425792 00000100:00100000:2.0:1713481296.677850:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882425792 00000100:00100000:2.0:1713481296.677873:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485772 00000100:00100000:2.0:1713481296.677879:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2011:18871:x1796714882425792:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:2.0:1713481296.677890:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.677901:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d370480/0xdfc0fb148a393d8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2cb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48732 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.677906:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820155 00000100:00100000:0.0:1713481296.677911:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26737:1958:x1796714882425216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.677918:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.677922:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008901e1c0/0xdfc0fb148688a29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2877 expref: 26737 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.677931:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008901e1c0/0xdfc0fb148688a29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2877 expref: 26737 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.677938:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d370480/0xdfc0fb148a393d8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48732 expref: 2012 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.677948:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008901e1c0/0xdfc0fb148688a29 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2877 expref: 26736 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.677949:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d370480/0xdfc0fb148a393d8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48732 expref: 2012 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.677958:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.677960:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.677961:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb8:0x0].0x0 (ffff880131419b00) 00010000:00010000:0.0:1713481296.677962:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.677964:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713481296.677966:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d370480, rc 0) 00010000:00010000:0.0:1713481296.677969:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.677980:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2012:18871:x1796714882425792:12345-192.168.202.24@tcp:101:touch.0 Request processed in 102us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.677988:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485772 00010000:00010000:0.0:1713481296.677995:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.678008:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26735:1958:x1796714882425216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (276us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.678013:0:15499:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.678014:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820155 00010000:00010000:2.0:1713481296.678019:0:15499:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678023:0:15499:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678027:0:15499:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678031:0:15499:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678034:0:15499:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c0b1680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.678036:0:15499:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678040:0:15499:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.678046:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086aa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784481088:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.678051:0:15499:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678058:0:15499:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0b1680/0xdfc0fb148a38a23 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.678151:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.678155:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784481280:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.678177:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086aa0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784481408:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.678195:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.678201:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.678217:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882424960 00000100:00100000:0.0:1713481296.678219:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882424960 00000100:00100000:2.0:1713481296.678264:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+2705:3491:x1796714784480896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 30712us (30754us total) trans 4295960644 rc 0/0 00000100:00100000:2.0:1713481296.678270:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562161 00010000:00010000:0.0:1713481296.678286:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880078281f80/0xdfc0fb148688a14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2869 expref: 26737 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.678301:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820156 00000100:00100000:0.0:1713481296.678304:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26737:1960:x1796714882424960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.678308:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.678310:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880078281f80/0xdfc0fb148688a14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2869 expref: 26736 pid: 16460 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.678320:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800728ef100/2, rc 0, transno 993348 00000100:00100000:2.0:1713481296.678335:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784480896:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.678362:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784481600:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.678377:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713481296.678384:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.678388:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784483840:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.678407:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784481536:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.678420:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880078281f80/0xdfc0fb148688a14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2869 expref: 26737 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.678423:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.678424:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.678439:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078281f80/0xdfc0fb148688a14 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2869 expref: 26737 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.678449:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.678451:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.678454:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.678461:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.678552:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.678555:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678560:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678564:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.678566:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26736:1960:x1796714882424960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 259us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.678571:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820156 00010000:00010000:2.0:1713481296.678571:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678575:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678578:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c0b33c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.678580:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678583:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.678594:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16625:1959:x1796714882424576:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 981us (1031us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.678596:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.678598:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562482 00010000:00010000:2.0:1713481296.678600:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0b33c0/0xdfc0fb148a38a15 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.678611:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562490 00000100:00100000:0.0:1713481296.678706:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26737:1960:x1796714882425600:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.678714:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.678723:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880122ac0000/0xdfc0fb148a39402 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48716 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.678727:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2706:3492:x1796714784480640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 31314us (31377us total) trans 4295960645 rc 0/0 00000100:00100000:2.0:1713481296.678732:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562159 00002000:00010000:0.0:1713481296.678734:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf07:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.678742:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.678743:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.678747:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122ac0000/0xdfc0fb148a39402 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48716 expref: 26739 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.678750:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562491 00000100:00100000:2.0:1713481296.678753:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26739:1960:x1796714882425728:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.678757:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880122ac0000/0xdfc0fb148a39402 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48716 expref: 26739 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.678759:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.678766:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d370fc0/0xdfc0fb148a39409 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48724 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.678769:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac0000, rc 0) 00002000:00010000:2.0:1713481296.678774:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf08:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.678780:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.678781:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.678784:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d370fc0/0xdfc0fb148a39409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48724 expref: 26741 pid: 15562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.678791:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d370fc0/0xdfc0fb148a39409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48724 expref: 26741 pid: 15562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.678796:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d370fc0, rc 0) 00000100:00100000:2.0:1713481296.678805:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26741:1960:x1796714882425728:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.678808:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562491 00000100:00100000:0.0:1713481296.678840:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26741:1960:x1796714882425600:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 223us (261us total) trans 0 rc 0/0 00000004:00080000:3.0:1713481296.678840:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800728ee300/2, rc 0, transno 993349 00000100:00100000:0.0:1713481296.678847:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562490 00000100:00100000:3.0:1713481296.678849:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784480640:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.678877:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784483968:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.678907:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.678948:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562494 00000100:00100000:2.0:1713481296.678951:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2706:3490:x1796714784483968:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.678959:0:16460:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43262 count 1 00010000:00010000:2.0:1713481296.678967:0:16460:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.678974:0:16460:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013463cfc0/0xdfc0fb148688a92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28e7 expref: 26741 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.678982:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.678983:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.678986:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679002:0:16460:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013463cfc0/0xdfc0fb148688a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28e7 expref: 26740 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.679011:0:16460:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013463cfc0/0xdfc0fb148688a92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28e7 expref: 26740 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.679020:0:16460:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784484032:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.679028:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.679037:0:16460:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801356046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.679060:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.679075:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882426240 00000100:00100000:2.0:1713481296.679078:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882426240 00000100:00100000:0.0:1713481296.679086:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.679097:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882426432 00000100:00100000:2.0:1713481296.679099:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882426432 00000100:00100000:2.0:1713481296.679108:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882426624 00000100:00100000:0.0:1713481296.679110:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.679110:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882426624 00000100:00100000:2.0:1713481296.679139:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882426688 00000100:00100000:2.0:1713481296.679141:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882426688 00000100:00100000:2.0:1713481296.679155:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562495 00000100:00100000:2.0:1713481296.679159:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26743:1960:x1796714882426240:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.679166:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.679175:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120a25f80/0xdfc0fb148a3943a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf0b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48755 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.679190:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562496 00002000:00010000:2.0:1713481296.679190:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf0b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.679195:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26744:1960:x1796714882426432:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.679197:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.679199:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.679202:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.679202:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120a25f80/0xdfc0fb148a3943a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48755 expref: 26744 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.679210:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880122ac0480/0xdfc0fb148a39448 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4876a expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679210:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120a25f80/0xdfc0fb148a3943a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48755 expref: 26744 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.679218:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120a25f80, rc 0) 00002000:00010000:0.0:1713481296.679221:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf0c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.679231:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26744:1960:x1796714882426240:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.679235:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562495 00000100:00100000:2.0:1713481296.679248:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562497 00000100:00100000:2.0:1713481296.679252:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26743:1960:x1796714882426624:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.679258:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.679266:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120a27180/0xdfc0fb148a3944f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48778 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.679277:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf0d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.679286:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.679287:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.679291:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120a27180/0xdfc0fb148a3944f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48778 expref: 26744 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.679305:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120a27180/0xdfc0fb148a3944f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48778 expref: 26745 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.679308:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.679309:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.679312:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122ac0480/0xdfc0fb148a39448 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4876a expref: 26745 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.679313:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120a27180, rc 0) 00010000:00010000:0.0:1713481296.679319:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880122ac0480/0xdfc0fb148a39448 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4876a expref: 26745 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.679324:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac0480, rc 0) 00000100:00100000:2.0:1713481296.679325:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26745:1960:x1796714882426624:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.679330:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562497 00000100:00100000:0.0:1713481296.679334:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26745:1960:x1796714882426432:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 140us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.679338:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562496 00000100:00100000:2.0:1713481296.679344:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562498 00000100:00100000:2.0:1713481296.679348:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007726ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16625:1960:x1796714882426688:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.679353:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.679360:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120a27600/0xdfc0fb148a39456 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4877f expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.679370:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96f2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.679377:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.679378:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.679382:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120a27600/0xdfc0fb148a39456 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4877f expref: 16626 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.679388:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120a27600/0xdfc0fb148a39456 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4877f expref: 16626 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.679393:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120a27600, rc 0) 00000100:00100000:2.0:1713481296.679401:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007726ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16626:1960:x1796714882426688:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.679405:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562498 00000100:00100000:0.0:1713481296.679530:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882426816 00000100:00100000:0.0:1713481296.679535:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882426816 00010000:00010000:0.0:1713481296.679548:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d5c8480/0xdfc0fb148688a53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28a1 expref: 26744 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.679569:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820158 00010000:00010000:2.0:1713481296.679576:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679584:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679591:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679597:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679603:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679607:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800834bf600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.679610:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679615:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679628:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679633:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800834bf600/0xdfc0fb148a38a7e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.679689:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26744:1960:x1796714882426816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.679695:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.679699:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d5c8480/0xdfc0fb148688a53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28a1 expref: 26744 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.679707:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d5c8480/0xdfc0fb148688a53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28a1 expref: 26743 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.679719:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d5c8480/0xdfc0fb148688a53 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28a1 expref: 26743 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.679733:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.679735:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.679737:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.679744:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.679765:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.679779:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2707:3491:x1796714784481472:12345-0@lo:6:osp-syn-1-1.0 Request processed in 30828us (30883us total) trans 4295960646 rc 0/0 00000100:00100000:2.0:1713481296.679786:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562168 00000004:00080000:2.0:1713481296.679867:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078190000/2, rc 0, transno 993350 00000100:00100000:0.0:1713481296.679868:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26742:1960:x1796714882426816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 179us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.679874:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784481472:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.679875:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820158 00010000:00010000:0.0:1713481296.679900:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.679902:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.679907:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784484096:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.679908:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.679925:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.679955:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562501 00000100:00100000:2.0:1713481296.679960:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2707:3490:x1796714784484096:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.679970:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43263 count 1 00010000:00010000:0.0:1713481296.679972:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679979:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.679980:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.679987:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.679989:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f83840/0xdfc0fb148688a99 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28f5 expref: 26741 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.679994:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.679995:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.679997:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.680010:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f83840/0xdfc0fb148688a99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28f5 expref: 26741 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.680022:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f83840/0xdfc0fb148688a99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28f5 expref: 26741 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.680030:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784484160:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.680039:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092840000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.680042:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.680042:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d00a000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.680049:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.680068:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.680074:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092840000/0xdfc0fb148a38a4d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.680421:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2708:3493:x1796714784481216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 31812us (31895us total) trans 4295960647 rc 0/0 00000100:00100000:0.0:1713481296.680428:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562165 00000004:00080000:2.0:1713481296.680434:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f91dc00/2, rc 0, transno 993351 00000100:00100000:2.0:1713481296.680442:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784481216:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.680479:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.680486:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784484224:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.680509:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.680573:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.680586:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882425280 00000100:00100000:0.0:1713481296.680588:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882425280 00000100:00100000:0.0:1713481296.680656:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882425408 00000100:00100000:0.0:1713481296.680659:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882425408 00000100:00100000:2.0:1713481296.680679:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882425536 00000100:00100000:2.0:1713481296.680683:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882425536 00000100:00100000:0.0:1713481296.680689:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562506 00000100:00100000:0.0:1713481296.680693:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16633:1960:x1796714882425280:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.680700:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.680700:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882425664 00010000:00010000:0.0:1713481296.680710:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ac0fc0/0xdfc0fb148a3948e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa486f3 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.680720:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96e9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.680728:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.680730:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.680732:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882425664 00010000:00010000:0.0:1713481296.680734:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ac0fc0/0xdfc0fb148a3948e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486f3 expref: 16635 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.680749:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ac0fc0/0xdfc0fb148a3948e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa486f3 expref: 16638 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.680752:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562507 00010000:00010000:0.0:1713481296.680756:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ac0fc0, rc 0) 00000100:00100000:2.0:1713481296.680757:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16638:1960:x1796714882425408:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.680768:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.680769:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16638:1960:x1796714882425280:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.680775:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562506 00010000:00010000:2.0:1713481296.680780:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c23c6c0/0xdfc0fb148a39495 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48701 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.680789:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562510 00002000:00010000:2.0:1713481296.680792:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ea:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.680801:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.680802:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.680807:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c23c6c0/0xdfc0fb148a39495 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48701 expref: 16639 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.680822:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c23c6c0/0xdfc0fb148a39495 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48701 expref: 16639 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.680829:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c23c6c0, rc 0) 00000100:00100000:2.0:1713481296.680845:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16639:1960:x1796714882425408:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.680885:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16639:1960:x1796714882425984:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.680885:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562507 00010000:00010000:0.0:1713481296.680893:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.680900:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562512 00010000:00010000:0.0:1713481296.680903:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999e0900/0xdfc0fb148a394a3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48740 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.680904:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16637:1960:x1796714882426176:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.680911:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1713481296.680913:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ee:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.680919:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.680920:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c23c480/0xdfc0fb148a394b1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4874e expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.680921:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.680924:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999e0900/0xdfc0fb148a394a3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48740 expref: 16639 pid: 16545 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.680929:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ef:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.680932:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999e0900/0xdfc0fb148a394a3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48740 expref: 16639 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.680937:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.680938:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.680939:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999e0900, rc 0) 00010000:00010000:2.0:1713481296.680942:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c23c480/0xdfc0fb148a394b1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4874e expref: 16640 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.680949:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c23c480/0xdfc0fb148a394b1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4874e expref: 16640 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.680950:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16640:1960:x1796714882425984:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.680955:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562510 00010000:00010000:2.0:1713481296.680955:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c23c480, rc 0) 00000100:00100000:2.0:1713481296.680966:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16639:1960:x1796714882426176:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.680971:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562512 00000100:00100000:0.0:1713481296.681288:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.681359:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.681374:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882426560 00000100:00100000:0.0:1713481296.681377:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882426560 00010000:00010000:0.0:1713481296.681387:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008901e640/0xdfc0fb148688a30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2885 expref: 26742 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.681501:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820159 00000100:00100000:0.0:1713481296.681508:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007726aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26743:1960:x1796714882426560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.681516:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.681520:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008901e640/0xdfc0fb148688a30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2885 expref: 26743 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.681526:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008901e640/0xdfc0fb148688a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2885 expref: 26743 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.681537:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008901e640/0xdfc0fb148688a30 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2885 expref: 26743 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.681544:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.681545:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.681547:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681551:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681563:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.681573:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007726aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26741:1960:x1796714882426560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.681577:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820159 00010000:00010000:0.0:1713481296.681592:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681596:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681597:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681600:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681603:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681604:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681607:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681608:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681611:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800928421c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.681611:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681612:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681615:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681616:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681619:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135ad3840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.681620:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681624:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681630:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681634:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800928421c0/0xdfc0fb148a38a3f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681634:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681638:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ad3840/0xdfc0fb148a38a46 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.681742:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2710:3490:x1796714784481024:12345-0@lo:6:osp-syn-1-1.0 Request processed in 33560us (33672us total) trans 4295960648 rc 0/0 00000100:00100000:0.0:1713481296.681746:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562163 00000100:00100000:2.0:1713481296.681761:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2709:3493:x1796714784481152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 33205us (33299us total) trans 4295960649 rc 0/0 00000100:00100000:2.0:1713481296.681766:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562164 00000100:00100000:0.0:1713481296.681778:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882427008 00000100:00100000:0.0:1713481296.681780:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882427008 00000100:00100000:0.0:1713481296.681794:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882427200 00000100:00100000:0.0:1713481296.681796:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882427200 00000004:00080000:2.0:1713481296.681796:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800728eed80/2, rc 0, transno 993353 00000100:00100000:2.0:1713481296.681800:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784481152:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.681810:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562515 00000100:00100000:0.0:1713481296.681813:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26740:1960:x1796714882427008:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.681818:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.681824:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999e2f40/0xdfc0fb148a394cd lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48786 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.681829:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784484352:0@lo:6:osp-syn-1-1.0 00002000:00010000:0.0:1713481296.681831:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf0e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.681837:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.681838:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.681841:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999e2f40/0xdfc0fb148a394cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48786 expref: 26742 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.681843:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.681847:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999e2f40/0xdfc0fb148a394cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48786 expref: 26742 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.681855:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999e2f40, rc 0) 00000004:00080000:2.0:1713481296.681868:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800728ece00/2, rc 0, transno 993352 00000100:00100000:0.0:1713481296.681872:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26742:1960:x1796714882427008:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 57us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.681872:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784481024:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.681878:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562515 00000100:00100000:2.0:1713481296.681887:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784484416:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.681897:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.681907:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784484416 00000100:00100000:0.0:1713481296.681910:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784484416 00010000:00010000:2.0:1713481296.681923:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681928:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.681929:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562518 00010000:00010000:2.0:1713481296.681932:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.681933:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2710:3490:x1796714784484416:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.681936:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681939:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681943:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c0b0d80 already unused, calling callback (ffffffffa084eb20) 00002000:00080000:0.0:1713481296.681944:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43266 count 1 00010000:00010000:2.0:1713481296.681945:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681949:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681954:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.681962:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681964:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f83cc0/0xdfc0fb148688aae lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d291f expref: 26740 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.681965:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0b0d80/0xdfc0fb148a38a5b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681970:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.681972:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.681974:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.681990:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f83cc0/0xdfc0fb148688aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d291f expref: 26741 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682001:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f83cc0/0xdfc0fb148688aae lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d291f expref: 26741 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.682016:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e406a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784484544:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.682035:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.682056:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2711:3491:x1796714784481344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 33234us (33283us total) trans 4295960650 rc 0/0 00000100:00100000:0.0:1713481296.682060:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.682060:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562166 00000100:00100000:0.0:1713481296.682093:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.682100:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882427712 00000100:00100000:0.0:1713481296.682102:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882427712 00000100:00100000:0.0:1713481296.682115:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562521 00000100:00100000:0.0:1713481296.682135:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16640:1960:x1796714882427712:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.682140:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.682147:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086a4f180/0xdfc0fb148a394f7 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487c5 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.682156:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96f7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.682164:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682165:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682169:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086a4f180/0xdfc0fb148a394f7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487c5 expref: 16641 pid: 15562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682178:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086a4f180/0xdfc0fb148a394f7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487c5 expref: 16641 pid: 15562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682185:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086a4f180, rc 0) 00000100:00100000:0.0:1713481296.682199:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16642:1960:x1796714882427712:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 78us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.682204:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562521 00000100:00100000:0.0:1713481296.682240:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.682253:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882427968 00000100:00100000:0.0:1713481296.682256:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882427968 00000100:00100000:0.0:1713481296.682268:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562523 00000100:00100000:0.0:1713481296.682272:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16642:1960:x1796714882427968:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.682277:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.682285:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086a4c6c0/0xdfc0fb148a39505 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487e1 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.682294:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96f9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.682300:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682302:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682305:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086a4c6c0/0xdfc0fb148a39505 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487e1 expref: 16643 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682313:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086a4c6c0/0xdfc0fb148a39505 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487e1 expref: 16643 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682319:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086a4c6c0, rc 0) 00000100:00100000:2.0:1713481296.682330:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562524 00000100:00100000:0.0:1713481296.682331:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16644:1960:x1796714882427968:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.682336:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562523 00000100:00100000:2.0:1713481296.682336:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800782f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16644:1960:x1796714882428096:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.682343:0:16491:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.682353:0:16491:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c23d680/0xdfc0fb148a3950c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487ef expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.682361:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.682364:0:16491:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96fa:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.682369:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428224 00000100:00100000:0.0:1713481296.682371:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428224 00010000:00010000:2.0:1713481296.682373:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682374:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682379:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c23d680/0xdfc0fb148a3950c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487ef expref: 16645 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.682387:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562525 00010000:00010000:2.0:1713481296.682389:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c23d680/0xdfc0fb148a3950c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487ef expref: 16645 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.682390:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16645:1960:x1796714882428224:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.682396:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.682397:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c23d680, rc 0) 00010000:00010000:0.0:1713481296.682402:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086a4c900/0xdfc0fb148a39513 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487fd expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.682409:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96fb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.682412:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800782f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16646:1960:x1796714882428096:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 76us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.682414:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682415:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682418:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086a4c900/0xdfc0fb148a39513 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487fd expref: 16646 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.682418:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562524 00010000:00010000:0.0:1713481296.682423:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086a4c900/0xdfc0fb148a39513 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487fd expref: 16646 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682428:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086a4c900, rc 0) 00000100:00100000:0.0:1713481296.682437:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16645:1960:x1796714882428224:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.682440:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562525 00000100:00100000:0.0:1713481296.682462:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.682470:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882427776 00000100:00100000:2.0:1713481296.682474:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882427776 00000100:00100000:0.0:1713481296.682477:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.682482:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882427904 00000100:00100000:0.0:1713481296.682484:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882427904 00000100:00100000:2.0:1713481296.682489:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562527 00000100:00100000:2.0:1713481296.682493:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26746:1960:x1796714882427776:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.682495:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562528 00000100:00100000:0.0:1713481296.682497:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26746:1960:x1796714882427904:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.682499:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.682501:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.682507:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009154eac0/0xdfc0fb148a39528 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487da expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.682507:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c23db00/0xdfc0fb148a39521 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487cc expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.682517:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf14:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.682517:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf13:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.682522:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682523:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682524:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682525:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682526:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009154eac0/0xdfc0fb148a39528 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487da expref: 26747 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.682528:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c23db00/0xdfc0fb148a39521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487cc expref: 26747 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682531:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009154eac0/0xdfc0fb148a39528 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487da expref: 26747 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.682534:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c23db00/0xdfc0fb148a39521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487cc expref: 26747 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682535:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009154eac0, rc 0) 00010000:00010000:2.0:1713481296.682542:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c23db00, rc 0) 00000100:00100000:0.0:1713481296.682543:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26747:1960:x1796714882427904:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.682547:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562528 00000100:00100000:2.0:1713481296.682552:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26747:1960:x1796714882427776:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 59us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.682555:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562527 00000100:00100000:2.0:1713481296.682576:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428032 00000100:00100000:2.0:1713481296.682578:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428032 00000100:00100000:2.0:1713481296.682589:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428160 00000100:00100000:2.0:1713481296.682590:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428160 00000100:00100000:0.0:1713481296.682597:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562529 00000100:00100000:0.0:1713481296.682601:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800782f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26747:1960:x1796714882428032:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.682602:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562530 00000100:00100000:2.0:1713481296.682605:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800782fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26747:1960:x1796714882428160:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.682608:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.682609:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.682615:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c18ad00/0xdfc0fb148a3952f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487f6 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.682618:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a154240/0xdfc0fb148a39536 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa487e8 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.682621:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf16:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.682627:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682628:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713481296.682629:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf15:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.682630:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c18ad00/0xdfc0fb148a3952f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487f6 expref: 26748 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.682635:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007c18ad00/0xdfc0fb148a3952f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487f6 expref: 26750 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682636:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682638:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682640:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c18ad00, rc 0) 00010000:00010000:0.0:1713481296.682642:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a154240/0xdfc0fb148a39536 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487e8 expref: 26750 pid: 15562 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.682648:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800782fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26750:1960:x1796714882428160:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.682651:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562530 00010000:00010000:0.0:1713481296.682656:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a154240/0xdfc0fb148a39536 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa487e8 expref: 26750 pid: 15562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682663:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a154240, rc 0) 00000004:00080000:2.0:1713481296.682685:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078192300/2, rc 0, transno 993354 00000100:00100000:0.0:1713481296.682689:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800782f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26749:1960:x1796714882428032:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 88us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.682690:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784481344:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.682695:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562529 00000100:00100000:2.0:1713481296.682711:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.682715:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784484608:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.682726:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.682736:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428352 00000100:00100000:2.0:1713481296.682738:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428352 00000100:00100000:0.0:1713481296.682750:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.682758:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428480 00000100:00100000:2.0:1713481296.682760:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428480 00000100:00100000:2.0:1713481296.682771:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562533 00000100:00100000:2.0:1713481296.682774:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16647:1960:x1796714882428480:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.682778:0:16491:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.682785:0:16491:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122530240/0xdfc0fb148a3954b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48819 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.682788:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.682792:0:16491:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96fd:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.682798:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428608 00010000:00010000:2.0:1713481296.682798:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682799:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.682800:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428608 00010000:00010000:2.0:1713481296.682801:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122530240/0xdfc0fb148a3954b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48819 expref: 16648 pid: 16491 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.682807:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122530240/0xdfc0fb148a3954b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48819 expref: 16649 pid: 16491 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.682812:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122530240, rc 0) 00000100:00100000:2.0:1713481296.682824:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16648:1960:x1796714882428480:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.682829:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562533 00000100:00100000:0.0:1713481296.682834:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.682844:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428736 00000100:00100000:2.0:1713481296.682847:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428736 00000100:00100000:2.0:1713481296.682869:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562535 00000100:00100000:2.0:1713481296.682873:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16648:1960:x1796714882428736:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.682880:0:16491:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.682885:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.682888:0:16491:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122532f40/0xdfc0fb148a39559 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x96ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48835 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.682896:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.682899:0:16491:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x96ff:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.682902:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428416 00000100:00100000:0.0:1713481296.682904:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428416 00010000:00010000:2.0:1713481296.682906:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682907:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.682912:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122532f40/0xdfc0fb148a39559 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48835 expref: 16650 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.682917:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562537 00010000:00010000:2.0:1713481296.682920:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122532f40/0xdfc0fb148a39559 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x96ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48835 expref: 16650 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.682922:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26749:1960:x1796714882428416:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.682925:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122532f40, rc 0) 00010000:00010000:0.0:1713481296.682928:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.682935:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16651:1960:x1796714882428736:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (102us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.682937:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a155200/0xdfc0fb148a39567 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48812 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.682939:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562535 00002000:00010000:0.0:1713481296.682947:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf18:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.682953:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.682955:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.682956:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.682958:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a155200/0xdfc0fb148a39567 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48812 expref: 26750 pid: 15562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.682967:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a155200/0xdfc0fb148a39567 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48812 expref: 26750 pid: 15562 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.682971:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784484608 00010000:00010000:0.0:1713481296.682973:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a155200, rc 0) 00000100:00100000:2.0:1713481296.682973:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784484608 00000100:00100000:2.0:1713481296.682983:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562538 00000100:00100000:0.0:1713481296.682985:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26750:1960:x1796714882428416:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.682986:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2711:3490:x1796714784484608:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.682990:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562537 00002000:00080000:2.0:1713481296.682994:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43267 count 1 00010000:00010000:2.0:1713481296.683003:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.683013:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013463c000/0xdfc0fb148688ab5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d292d expref: 26749 pid: 16478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683019:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683020:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683023:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.683039:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013463c000/0xdfc0fb148688ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d292d expref: 26749 pid: 16478 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683047:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013463c000/0xdfc0fb148688ab5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d292d expref: 26749 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.683056:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784484672:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.683072:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800816266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.683154:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.683186:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428544 00000100:00100000:2.0:1713481296.683188:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428544 00000100:00100000:0.0:1713481296.683189:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.683200:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428672 00000100:00100000:2.0:1713481296.683202:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428672 00000100:00100000:0.0:1713481296.683205:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562539 00000100:00100000:0.0:1713481296.683209:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26751:1960:x1796714882428544:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.683216:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.683223:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428800 00010000:00010000:0.0:1713481296.683224:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800883006c0/0xdfc0fb148a39575 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48820 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.683225:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428800 00002000:00010000:0.0:1713481296.683233:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf19:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.683239:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562541 00010000:00010000:0.0:1713481296.683240:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.683241:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.683244:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26753:1960:x1796714882428800:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.683245:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800883006c0/0xdfc0fb148a39575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48820 expref: 26753 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683251:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.683253:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800883006c0/0xdfc0fb148a39575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48820 expref: 26753 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683262:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800837e3a80/0xdfc0fb148a39583 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4883c expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.683264:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800883006c0, rc 0) 00002000:00010000:2.0:1713481296.683273:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf1b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.683274:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26754:1960:x1796714882428544:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.683278:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562539 00010000:00010000:2.0:1713481296.683281:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683282:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683287:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800837e3a80/0xdfc0fb148a39583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4883c expref: 26755 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683296:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800837e3a80/0xdfc0fb148a39583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4883c expref: 26754 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683302:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800837e3a80, rc 0) 00000100:00100000:0.0:1713481296.683306:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.683314:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26753:1960:x1796714882428800:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.683319:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562541 00000100:00100000:0.0:1713481296.683330:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.683339:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882428992 00000100:00100000:2.0:1713481296.683341:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882428992 00000100:00100000:0.0:1713481296.683352:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.683359:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429120 00000100:00100000:2.0:1713481296.683361:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429120 00000100:00100000:0.0:1713481296.683363:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562543 00000100:00100000:0.0:1713481296.683366:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16651:1960:x1796714882428992:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.683370:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.683370:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562544 00000100:00100000:2.0:1713481296.683374:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16651:1960:x1796714882429120:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.683377:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088302f40/0xdfc0fb148a39591 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48851 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.683379:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1713481296.683383:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9701:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.683389:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.683390:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683391:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800837e0fc0/0xdfc0fb148a39598 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4885f expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.683392:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088302f40/0xdfc0fb148a39591 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48851 expref: 16652 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683398:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088302f40/0xdfc0fb148a39591 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48851 expref: 16652 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683403:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088302f40, rc 0) 00002000:00010000:2.0:1713481296.683405:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9702:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.683411:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16653:1960:x1796714882428992:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (81us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.683411:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683412:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.683415:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562543 00010000:00010000:2.0:1713481296.683415:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800837e0fc0/0xdfc0fb148a39598 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4885f expref: 16653 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683421:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800837e0fc0/0xdfc0fb148a39598 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4885f expref: 16653 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683425:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800837e0fc0, rc 0) 00000100:00100000:2.0:1713481296.683435:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16652:1960:x1796714882429120:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.683439:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562544 00000100:00100000:0.0:1713481296.683440:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.683449:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429248 00000100:00100000:0.0:1713481296.683451:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429248 00000100:00100000:0.0:1713481296.683471:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429056 00000100:00100000:0.0:1713481296.683473:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429056 00000100:00100000:2.0:1713481296.683474:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562545 00000100:00100000:2.0:1713481296.683477:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16652:1960:x1796714882429248:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.683487:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562546 00000100:00100000:0.0:1713481296.683491:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26754:1960:x1796714882429056:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.683496:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429184 00010000:00010000:0.0:1713481296.683497:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.683498:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429184 00010000:00010000:0.0:1713481296.683506:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088300900/0xdfc0fb148a3959f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48858 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.683507:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562547 00000100:00100000:2.0:1713481296.683510:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26755:1960:x1796714882429184:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.683513:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1713481296.683517:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf1d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.683520:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120b84d80/0xdfc0fb148a395a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48866 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.683524:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.683526:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713481296.683526:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf1e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.683530:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088300900/0xdfc0fb148a3959f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48858 expref: 26756 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683532:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683533:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683536:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120b84d80/0xdfc0fb148a395a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48866 expref: 26757 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683539:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088300900/0xdfc0fb148a3959f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48858 expref: 26757 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683542:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120b84d80/0xdfc0fb148a395a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48866 expref: 26757 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683545:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088300900, rc 0) 00010000:00010000:2.0:1713481296.683546:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120b84d80, rc 0) 00000100:00100000:2.0:1713481296.683555:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26757:1960:x1796714882429184:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (65us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.683558:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562547 00000100:00100000:0.0:1713481296.683560:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26758:1960:x1796714882429056:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.683565:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562546 00000100:00100000:2.0:1713481296.683570:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429504 00000100:00100000:2.0:1713481296.683571:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429504 00000100:00100000:2.0:1713481296.683581:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562549 00000100:00100000:2.0:1713481296.683583:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16654:1960:x1796714882429376:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.683584:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562550 00010000:00010000:2.0:1713481296.683587:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.683588:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16654:1960:x1796714882429504:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.683592:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120b861c0/0xdfc0fb148a395b4 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4887b expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.683594:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.683598:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9704:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.683601:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088301f80/0xdfc0fb148a395bb lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48889 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.683603:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683604:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683606:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120b861c0/0xdfc0fb148a395b4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4887b expref: 16655 pid: 16528 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.683609:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9705:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.683611:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120b861c0/0xdfc0fb148a395b4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4887b expref: 16655 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683616:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683616:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120b861c0, rc 0) 00010000:00010000:0.0:1713481296.683618:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.683622:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088301f80/0xdfc0fb148a395bb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48889 expref: 16656 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.683624:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16656:1960:x1796714882429376:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.683628:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562549 00010000:00010000:0.0:1713481296.683630:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088301f80/0xdfc0fb148a395bb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48889 expref: 16656 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683637:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088301f80, rc 0) 00010000:00010000:2.0:1713481296.683646:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.683649:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16655:1960:x1796714882429504:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (101us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.683652:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120b86ac0/0xdfc0fb148a395c2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4886d expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.683654:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562550 00002000:00010000:2.0:1713481296.683659:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9703:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.683663:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683677:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683681:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120b86ac0/0xdfc0fb148a395c2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4886d expref: 16655 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683686:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120b86ac0/0xdfc0fb148a395c2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4886d expref: 16655 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683691:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120b86ac0, rc 0) 00000100:00100000:2.0:1713481296.683701:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16655:1960:x1796714882429248:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 224us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.683703:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429440 00000100:00100000:2.0:1713481296.683705:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562545 00000100:00100000:0.0:1713481296.683706:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429440 00000100:00100000:2.0:1713481296.683722:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429568 00000100:00100000:0.0:1713481296.683723:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429632 00000100:00100000:2.0:1713481296.683724:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429568 00000100:00100000:0.0:1713481296.683725:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429632 00000100:00100000:2.0:1713481296.683732:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429696 00000100:00100000:2.0:1713481296.683733:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429696 00000100:00100000:0.0:1713481296.683740:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562551 00000100:00100000:2.0:1713481296.683741:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429760 00000100:00100000:2.0:1713481296.683742:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429760 00000100:00100000:0.0:1713481296.683745:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26759:1960:x1796714882429440:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.683752:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.683753:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562553 00000100:00100000:2.0:1713481296.683755:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26759:1960:x1796714882429696:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.683759:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.683762:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088303180/0xdfc0fb148a395c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48882 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.683765:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120b873c0/0xdfc0fb148a395d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4889e expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.683773:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf22:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:0.0:1713481296.683777:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf20:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.683778:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683779:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683781:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120b873c0/0xdfc0fb148a395d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4889e expref: 26761 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683784:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.683786:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683787:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120b873c0/0xdfc0fb148a395d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4889e expref: 26761 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.683790:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088303180/0xdfc0fb148a395c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48882 expref: 26761 pid: 15562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683791:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120b873c0, rc 0) 00010000:00010000:0.0:1713481296.683799:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088303180/0xdfc0fb148a395c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48882 expref: 26761 pid: 15562 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.683801:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26761:1960:x1796714882429696:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.683805:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562553 00010000:00010000:0.0:1713481296.683806:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088303180, rc 0) 00000100:00100000:0.0:1713481296.683818:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26760:1960:x1796714882429440:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.683823:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562551 00000100:00100000:2.0:1713481296.683832:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562555 00000100:00100000:2.0:1713481296.683834:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26759:1960:x1796714882429568:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.683838:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.683843:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120b86400/0xdfc0fb148a395e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48890 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.683849:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf21:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.683854:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683855:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.683857:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120b86400/0xdfc0fb148a395e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48890 expref: 26760 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683863:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120b86400/0xdfc0fb148a395e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48890 expref: 26760 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.683867:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120b86400, rc 0) 00000100:00100000:2.0:1713481296.683875:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26760:1960:x1796714882429568:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.683879:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562555 00000100:00100000:0.0:1713481296.683880:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.683899:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429952 00000100:00100000:2.0:1713481296.683901:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429952 00000100:00100000:2.0:1713481296.683931:0:16464:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_036:lustre-OST0000_UUID:16464:1796714784481792:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.683935:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.683953:0:16464:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.683961:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.683970:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485773 00000100:00100000:0.0:1713481296.683973:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430016 00000100:00100000:2.0:1713481296.683973:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2012:18604:x1796714882429952:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.683975:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430016 00010000:00010000:0.0:1713481296.683985:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083348000/0xdfc0fb14880219a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96277e expref: 20862 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.684001:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.684006:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820162 00000100:00100000:0.0:1713481296.684011:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20862:1957:x1796714882430016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.684013:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801241b2640/0xdfc0fb148a34947 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3477:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45c05 expref: 2012 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.684017:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.684020:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083348000/0xdfc0fb14880219a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96277e expref: 20862 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.684026:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083348000/0xdfc0fb14880219a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96277e expref: 20862 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.684029:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3477:0x0].0x0 (ffff8800833b9900) 00010000:00010000:2.0:1713481296.684032:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.684037:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083348000/0xdfc0fb14880219a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96277e expref: 20862 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.684045:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684046:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684048:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.684052:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.684056:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882429888 00000100:00100000:2.0:1713481296.684059:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882429888 00010000:00010000:0.0:1713481296.684065:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.684074:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20861:1957:x1796714882430016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.684077:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820162 00000100:00100000:2.0:1713481296.684083:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430080 00000100:00100000:2.0:1713481296.684085:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430080 00000100:00100000:2.0:1713481296.684100:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562557 00000100:00100000:2.0:1713481296.684104:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16657:1959:x1796714882430080:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.684111:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.684140:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.684141:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800822c3cc0/0xdfc0fb148a395f3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa488b3 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.684149:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430144 00000100:00100000:0.0:1713481296.684151:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430144 00002000:00010000:2.0:1713481296.684151:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9708:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.684158:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.684160:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.684162:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562558 00010000:00010000:2.0:1713481296.684164:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800822c3cc0/0xdfc0fb148a395f3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488b3 expref: 16658 pid: 16528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.684166:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26762:1960:x1796714882430144:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.684172:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.684173:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800822c3cc0/0xdfc0fb148a395f3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488b3 expref: 16658 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.684179:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800822c3cc0, rc 0) 00010000:00010000:0.0:1713481296.684182:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083615d40/0xdfc0fb148a395fa lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa488ba expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.684192:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16658:1959:x1796714882430080:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 87us (158us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.684197:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf24:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.684197:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562557 00010000:00010000:0.0:1713481296.684205:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684206:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684210:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083615d40/0xdfc0fb148a395fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488ba expref: 26762 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.684219:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083615d40/0xdfc0fb148a395fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488ba expref: 26762 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.684219:0:16464:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.684224:0:16464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.684226:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083615d40, rc 0) 00010000:00010000:2.0:1713481296.684232:0:16464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.684236:0:16464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.684240:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26762:1960:x1796714882430144:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (100us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.684240:0:16464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.684243:0:16464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096b7b3c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.684245:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562558 00010000:00010000:2.0:1713481296.684245:0:16464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.684249:0:16464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.684260:0:16464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.684263:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430208 00010000:00010000:2.0:1713481296.684263:0:16464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b7b3c0/0xdfc0fb148a38b0a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.684266:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430208 00000100:00100000:0.0:1713481296.684287:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430272 00000100:00100000:0.0:1713481296.684290:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430272 00000100:00100000:0.0:1713481296.684391:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562560 00000100:00100000:0.0:1713481296.684394:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26762:1960:x1796714882430272:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.684399:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.684405:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083616640/0xdfc0fb148a39608 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa488c8 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.684412:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf25:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.684418:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684419:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.684421:0:16464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:lustre-MDT0001-mdtlov_UUID+94:3492:x1796714784481664:12345-0@lo:6:osp-syn-0-1.0 Request processed in 34432us (34467us total) trans 4296040754 rc 0/0 00010000:00010000:0.0:1713481296.684422:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083616640/0xdfc0fb148a39608 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488c8 expref: 26763 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.684428:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083616640/0xdfc0fb148a39608 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488c8 expref: 26763 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.684428:0:16464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562186 00010000:00010000:0.0:1713481296.684432:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083616640, rc 0) 00000004:00080000:3.0:1713481296.684432:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009faa6680/2, rc 0, transno 1073458 00000100:00100000:3.0:1713481296.684441:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784481664:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.684442:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26763:1960:x1796714882430272:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.684446:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562560 00010000:00010000:2.0:1713481296.684461:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.684470:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684476:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684479:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.684492:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784484736:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.684498:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c33c0/0xdfc0fb148a3961d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3474:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.684502:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c33c0/0xdfc0fb148a3961d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684505:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c33c0/0xdfc0fb148a3961d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:3.0:1713481296.684517:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.684541:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784484736 00010000:00010000:2.0:1713481296.684543:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.684545:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784484736 00010000:00010000:2.0:1713481296.684547:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684550:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684562:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562563 00000100:00100000:0.0:1713481296.684566:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+94:3492:x1796714784484736:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.684577:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9916 count 1 00010000:00010000:0.0:1713481296.684588:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.684598:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800904333c0/0xdfc0fb1488021d2 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627ee expref: 20860 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.684604:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684605:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684608:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.684622:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800904333c0/0xdfc0fb1488021d2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627ee expref: 20860 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.684630:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800904333c0/0xdfc0fb1488021d2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627ee expref: 20860 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.684638:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800783fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784484800:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.684653:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f540 going to sleep for 11 seconds 00000040:00080000:2.0:1713481296.684677:0:15484:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3429, 64 off227648 00000100:00100000:0.0:1713481296.684683:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.684694:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430400 00000100:00100000:0.0:1713481296.684696:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430400 00010000:00010000:2.0:1713481296.684710:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.684716:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684717:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430528 00000100:00100000:0.0:1713481296.684720:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430528 00010000:00010000:2.0:1713481296.684723:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684729:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684732:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562564 00010000:00010000:2.0:1713481296.684733:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684736:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684737:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26764:1960:x1796714882430400:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.684738:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684741:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099f26ac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.684743:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.684743:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684745:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684750:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3477:0x0].0x0 (ffff8800833b9900) 00010000:00010000:2.0:1713481296.684751:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1713481296.684752:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fd99680/0xdfc0fb148a39647 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa488d6 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.684753:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684756:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099f26ac0/0xdfc0fb148a39639 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3477:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT1 00002000:00010000:0.0:1713481296.684762:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf26:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.684770:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684771:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.684773:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684775:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fd99680/0xdfc0fb148a39647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488d6 expref: 26766 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.684776:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684779:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684782:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099f25d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.684784:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007fd99680/0xdfc0fb148a39647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488d6 expref: 26766 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.684784:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684787:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684790:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3477:0x0].0x0 (ffff8800833b9900) 00010000:00010000:2.0:1713481296.684792:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.684793:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684795:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fd99680, rc 0) 00010000:00010000:2.0:1713481296.684795:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099f25d40/0xdfc0fb148a3962b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3477:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684807:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26765:1960:x1796714882430400:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.684812:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562564 00000100:00100000:0.0:1713481296.684890:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430592 00000100:00100000:0.0:1713481296.684893:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430592 00010000:00010000:2.0:1713481296.684894:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000001:00080000:3.0:1713481296.684895:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040753 00010000:00010000:2.0:1713481296.684900:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684904:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562566 00010000:00010000:2.0:1713481296.684904:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.684906:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16661:1960:x1796714882430592:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.684909:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684911:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.684913:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800822c0900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.684915:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684918:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fd98480/0xdfc0fb148a3964e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x970c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa488eb expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.684920:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.684927:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00002000:00010000:0.0:1713481296.684928:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x970c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.684930:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.684932:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684936:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.684937:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.684938:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c0900/0xdfc0fb148a39616 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684941:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fd98480/0xdfc0fb148a3964e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x970c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488eb expref: 16662 pid: 16463 timeout: 0 lvb_type: 1 00000004:00010000:2.0:1713481296.684948:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800921d4e00 reply state ffff88009cc69000 transno 4295107567 ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c33c0/0xdfc0fb148a3961d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684950:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007fd98480/0xdfc0fb148a3964e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x970c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa488eb expref: 16662 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.684955:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800822c33c0/0xdfc0fb148a3961d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.684956:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fd98480, rc 0) 00010000:00010000:2.0:1713481296.684959:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x34 (ffff880083243000) 00010000:00010000:2.0:1713481296.684961:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.684963:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00002000:00080000:3.0:1713481296.684966:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56018 00000100:00100000:0.0:1713481296.684969:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16662:1960:x1796714882430592:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.684974:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562566 00000100:00100000:2.0:1713481296.684982:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2013:18604:x1796714882429952:12345-192.168.202.24@tcp:36:rm.0 Request processed in 1007us (1102us total) trans 4295107567 rc 0/0 00000100:00100000:2.0:1713481296.684987:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485773 00000100:00100000:0.0:1713481296.685025:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.685081:0:16548:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0000_UUID:16548:1796714784481856:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.685100:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.685100:0:16548:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.685111:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430784 00000100:00100000:2.0:1713481296.685113:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430784 00000100:00100000:0.0:1713481296.685157:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562569 00000100:00100000:0.0:1713481296.685161:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26766:1960:x1796714882430784:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.685169:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.685180:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801225c21c0/0xdfc0fb148a39663 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48900 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.685191:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf29:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.685199:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.685201:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.685205:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801225c21c0/0xdfc0fb148a39663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48900 expref: 26767 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685214:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801225c21c0/0xdfc0fb148a39663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48900 expref: 26767 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685221:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801225c21c0, rc 0) 00000100:00100000:0.0:1713481296.685235:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26767:1960:x1796714882430784:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.685240:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562569 00000100:00100000:0.0:1713481296.685308:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.685320:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431040 00010000:00010000:1.0:1713481296.685320:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090991f80/0xdfc0fb148a39671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4890e expref: 26768 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.685323:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431040 00010000:00010000:1.0:1713481296.685328:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090991f80/0xdfc0fb148a39671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4890e expref: 26768 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685332:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090991f80, rc 0) 00010000:00010000:0.0:1713481296.685334:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086cd5d40/0xdfc0fb1488021a1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96278c expref: 20861 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.685341:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26768:1960:x1796714882430912:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.685343:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562571 00000100:00100000:0.0:1713481296.685353:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820163 00000100:00100000:0.0:1713481296.685357:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20861:1958:x1796714882431040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.685363:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.685366:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086cd5d40/0xdfc0fb1488021a1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96278c expref: 20861 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.685369:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.685375:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086cd5d40/0xdfc0fb1488021a1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96278c expref: 20861 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.685377:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882430976 00000100:00100000:1.0:1713481296.685378:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882430976 00010000:00010000:0.0:1713481296.685386:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086cd5d40/0xdfc0fb1488021a1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96278c expref: 20861 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.685386:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562572 00000100:00100000:1.0:1713481296.685389:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16664:1960:x1796714882430976:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.685392:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.685398:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685398:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909933c0/0xdfc0fb148a39678 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x970f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48915 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.685399:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.685400:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.685405:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.685405:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x970f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.685409:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685410:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685412:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909933c0/0xdfc0fb148a39678 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x970f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48915 expref: 16665 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685418:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909933c0/0xdfc0fb148a39678 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x970f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48915 expref: 16665 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685425:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.685426:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909933c0, rc 0) 00000100:00100000:1.0:1713481296.685433:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16665:1960:x1796714882430976:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (64us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.685436:0:16548:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.685437:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20860:1958:x1796714882431040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 79us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.685437:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562572 00000100:00100000:0.0:1713481296.685440:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820163 00010000:00010000:2.0:1713481296.685442:0:16548:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.685446:0:16548:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.685450:0:16548:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.685454:0:16548:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.685456:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.685457:0:16548:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120f161c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.685459:0:16548:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.685462:0:16548:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.685470:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431168 00000100:00100000:0.0:1713481296.685472:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431168 00010000:00010000:2.0:1713481296.685472:0:16548:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.685475:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.685475:0:16548:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a38b26 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.685481:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431104 00000100:00100000:0.0:1713481296.685482:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431104 00000100:00100000:1.0:1713481296.685483:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562573 00000100:00100000:1.0:1713481296.685486:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16665:1960:x1796714882431168:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.685490:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562574 00010000:00010000:1.0:1713481296.685490:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.685492:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26768:1960:x1796714882431104:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.685497:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.685497:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013059e1c0/0xdfc0fb148a3967f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48923 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.685503:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801225c1b00/0xdfc0fb148a39686 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4891c expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.685503:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9710:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.685509:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713481296.685510:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf2b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.685510:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685512:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013059e1c0/0xdfc0fb148a3967f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48923 expref: 16666 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685515:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.685516:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685518:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013059e1c0/0xdfc0fb148a3967f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48923 expref: 16666 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685519:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801225c1b00/0xdfc0fb148a39686 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4891c expref: 26769 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685522:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013059e1c0, rc 0) 00010000:00010000:0.0:1713481296.685524:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801225c1b00/0xdfc0fb148a39686 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4891c expref: 26769 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685529:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801225c1b00, rc 0) 00000100:00100000:1.0:1713481296.685530:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16666:1960:x1796714882431168:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.685535:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562573 00000100:00100000:0.0:1713481296.685537:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26769:1960:x1796714882431104:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.685540:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562574 00000100:00100000:1.0:1713481296.685558:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.685581:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0001-mdtlov_UUID+96:3493:x1796714784481728:12345-0@lo:6:osp-syn-0-1.0 Request processed in 35417us (35516us total) trans 4296040756 rc 0/0 00000100:00100000:2.0:1713481296.685585:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562189 00000100:00100000:0.0:1713481296.685591:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431232 00000100:00100000:0.0:1713481296.685595:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431232 00000100:00100000:1.0:1713481296.685597:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.685601:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431296 00000100:00100000:2.0:1713481296.685603:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431296 00000100:00100000:1.0:1713481296.685608:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.685620:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431424 00000100:00100000:0.0:1713481296.685622:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431424 00000100:00100000:2.0:1713481296.685623:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562575 00000100:00100000:1.0:1713481296.685626:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562576 00000100:00100000:2.0:1713481296.685626:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26769:1960:x1796714882431232:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.685629:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16667:1960:x1796714882431296:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.685632:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.685634:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.685636:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562577 00010000:00010000:2.0:1713481296.685639:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f25200/0xdfc0fb148a3968d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4892a expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.685640:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013059d200/0xdfc0fb148a39694 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48931 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.685641:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16667:1960:x1796714882431424:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.685646:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf2c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.685647:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9711:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.685648:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.685652:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685653:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.685653:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685654:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.685655:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f25200/0xdfc0fb148a3968d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4892a expref: 26770 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685656:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013059d200/0xdfc0fb148a39694 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48931 expref: 16668 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685658:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009867f840/0xdfc0fb148a3969b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4893f expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.685662:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013059d200/0xdfc0fb148a39694 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48931 expref: 16668 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.685662:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f25200/0xdfc0fb148a3968d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4892a expref: 26770 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685676:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013059d200, rc 0) 00002000:00010000:0.0:1713481296.685679:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9712:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.685680:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f25200, rc 0) 00000100:00100000:1.0:1713481296.685685:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16669:1960:x1796714882431296:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (88us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.685689:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.685689:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562576 00000100:00100000:2.0:1713481296.685690:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26770:1960:x1796714882431232:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (131us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.685691:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.685694:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562575 00010000:00010000:0.0:1713481296.685695:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009867f840/0xdfc0fb148a3969b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4893f expref: 16669 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685705:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009867f840/0xdfc0fb148a3969b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4893f expref: 16668 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.685712:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867f840, rc 0) 00000100:00100000:1.0:1713481296.685713:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.685723:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009faa5180/2, rc 0, transno 1073460 00000100:00100000:0.0:1713481296.685726:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16668:1960:x1796714882431424:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 84us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.685727:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.685729:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784481728:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.685731:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562577 00000100:00100000:1.0:1713481296.685733:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431552 00000100:00100000:1.0:1713481296.685734:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431552 00000100:00100000:2.0:1713481296.685739:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431680 00000100:00100000:2.0:1713481296.685741:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431680 00000100:00100000:1.0:1713481296.685743:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562578 00000100:00100000:1.0:1713481296.685746:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16669:1960:x1796714882431552:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.685750:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.685753:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562579 00010000:00010000:1.0:1713481296.685756:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013059c480/0xdfc0fb148a396a2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4894d expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.685756:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16669:1960:x1796714882431680:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.685760:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.685763:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9713:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.685766:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099f24fc0/0xdfc0fb148a396a9 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4895b expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.685769:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685769:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685772:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013059c480/0xdfc0fb148a396a2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4894d expref: 16670 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685778:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013059c480/0xdfc0fb148a396a2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4894d expref: 16670 pid: 16535 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.685778:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9714:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.685782:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013059c480, rc 0) 00010000:00010000:2.0:1713481296.685783:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.685784:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.685787:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099f24fc0/0xdfc0fb148a396a9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4895b expref: 16671 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.685790:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16671:1960:x1796714882431552:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (76us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.685793:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099f24fc0/0xdfc0fb148a396a9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4895b expref: 16671 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.685794:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.685794:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562578 00010000:00010000:2.0:1713481296.685797:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f24fc0, rc 0) 00000100:00100000:1.0:1713481296.685802:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431360 00000100:00100000:1.0:1713481296.685804:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431360 00000100:00100000:2.0:1713481296.685806:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16670:1960:x1796714882431680:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.685810:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562579 00000100:00100000:1.0:1713481296.685818:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562580 00000100:00100000:1.0:1713481296.685821:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26770:1960:x1796714882431360:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.685825:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.685830:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013059d680/0xdfc0fb148a396b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48938 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.685833:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.685840:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf2d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.685843:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431488 00010000:00010000:1.0:1713481296.685844:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685845:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.685845:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431488 00010000:00010000:1.0:1713481296.685848:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013059d680/0xdfc0fb148a396b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48938 expref: 26772 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685853:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013059d680/0xdfc0fb148a396b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48938 expref: 26772 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.685857:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.685857:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013059d680, rc 0) 00000100:00100000:2.0:1713481296.685858:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562581 00000100:00100000:2.0:1713481296.685861:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26772:1960:x1796714882431488:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.685865:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.685866:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26772:1960:x1796714882431360:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.685869:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562580 00010000:00010000:2.0:1713481296.685871:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801315c2400/0xdfc0fb148a396b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48946 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.685876:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431616 00000100:00100000:1.0:1713481296.685878:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431616 00002000:00010000:2.0:1713481296.685878:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf2e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.685883:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.685884:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.685887:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801315c2400/0xdfc0fb148a396b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48946 expref: 26773 pid: 16528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.685892:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562582 00000100:00100000:1.0:1713481296.685896:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007726aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26773:1960:x1796714882431616:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.685897:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801315c2400/0xdfc0fb148a396b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48946 expref: 26773 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685901:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.685904:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801315c2400, rc 0) 00010000:00010000:1.0:1713481296.685910:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013059c000/0xdfc0fb148a396be lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48954 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.685919:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf2f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.685926:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685928:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.685932:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013059c000/0xdfc0fb148a396be lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48954 expref: 26774 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685944:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013059c000/0xdfc0fb148a396be lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48954 expref: 26774 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.685950:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013059c000, rc 0) 00000100:00100000:1.0:1713481296.685963:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007726aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26774:1960:x1796714882431616:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.685963:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26774:1960:x1796714882431488:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 99us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.685969:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562581 00000100:00100000:1.0:1713481296.685972:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562582 00000100:00100000:0.0:1713481296.685979:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.685985:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431808 00000100:00100000:2.0:1713481296.685988:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431808 00000100:00100000:2.0:1713481296.686013:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562583 00000100:00100000:2.0:1713481296.686017:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16670:1960:x1796714882431808:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.686024:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.686034:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801315c3180/0xdfc0fb148a396c5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48969 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.686044:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9715:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.686045:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.686052:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.686054:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.686059:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801315c3180/0xdfc0fb148a396c5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48969 expref: 16671 pid: 16528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.686061:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431936 00000100:00100000:1.0:1713481296.686064:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431936 00010000:00010000:2.0:1713481296.686068:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801315c3180/0xdfc0fb148a396c5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48969 expref: 16672 pid: 16528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.686072:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.686075:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801315c3180, rc 0) 00000100:00100000:1.0:1713481296.686081:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431744 00000100:00100000:1.0:1713481296.686083:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431744 00000100:00100000:2.0:1713481296.686088:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16672:1960:x1796714882431808:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.686090:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562584 00000100:00100000:0.0:1713481296.686094:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16672:1960:x1796714882431936:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.686094:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562585 00000100:00100000:1.0:1713481296.686097:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26773:1960:x1796714882431744:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.686097:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562583 00010000:00010000:0.0:1713481296.686099:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.686102:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.686107:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009867f180/0xdfc0fb148a396cc lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48977 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.686108:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013059c900/0xdfc0fb148a396d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48962 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.686114:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9716:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.686116:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf30:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.686135:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.686136:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.686139:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009867f180/0xdfc0fb148a396cc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48977 expref: 16672 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686140:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686141:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686145:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013059c900/0xdfc0fb148a396d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48962 expref: 26774 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.686146:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009867f180/0xdfc0fb148a396cc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48977 expref: 16672 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.686150:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867f180, rc 0) 00010000:00010000:1.0:1713481296.686151:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013059c900/0xdfc0fb148a396d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48962 expref: 26774 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686159:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013059c900, rc 0) 00000100:00100000:0.0:1713481296.686161:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16672:1960:x1796714882431936:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.686166:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562584 00000100:00100000:1.0:1713481296.686169:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26774:1960:x1796714882431744:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.686172:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562585 00000100:00100000:2.0:1713481296.686177:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784484864:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.686192:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.686203:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784484864 00000100:00100000:1.0:1713481296.686204:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784484864 00000100:00100000:1.0:1713481296.686213:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562586 00000100:00100000:1.0:1713481296.686215:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+96:3493:x1796714784484864:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.686223:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9917 count 1 00010000:00010000:1.0:1713481296.686230:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.686237:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0db00/0xdfc0fb1488021d9 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627fc expref: 20859 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686241:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686242:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686243:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.686255:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0db00/0xdfc0fb1488021d9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627fc expref: 20859 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686259:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0db00/0xdfc0fb1488021d9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627fc expref: 20859 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.686268:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:16535:1796714784484928:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.686279:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084a64b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.686297:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.686307:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882431872 00000100:00100000:1.0:1713481296.686309:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882431872 00000100:00100000:1.0:1713481296.686325:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562587 00000100:00100000:1.0:1713481296.686327:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26774:1960:x1796714882431872:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.686331:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.686339:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.686339:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800830ac6c0/0xdfc0fb148a396e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48970 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.686346:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf31:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.686349:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432000 00010000:00010000:1.0:1713481296.686351:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.686352:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432000 00010000:00010000:1.0:1713481296.686352:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686355:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800830ac6c0/0xdfc0fb148a396e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48970 expref: 26776 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686360:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800830ac6c0/0xdfc0fb148a396e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48970 expref: 26776 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.686364:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562588 00010000:00010000:1.0:1713481296.686364:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800830ac6c0, rc 0) 00000100:00100000:0.0:1713481296.686368:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26776:1960:x1796714882432000:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.686373:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26776:1960:x1796714882431872:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (76us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.686374:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.686377:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562587 00010000:00010000:0.0:1713481296.686381:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009867dd40/0xdfc0fb148a396e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4897e expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.686391:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf32:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.686397:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.686398:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.686399:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.686402:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009867dd40/0xdfc0fb148a396e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4897e expref: 26776 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.686407:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432064 00000100:00100000:1.0:1713481296.686409:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432064 00010000:00010000:0.0:1713481296.686410:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009867dd40/0xdfc0fb148a396e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4897e expref: 26776 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.686417:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867dd40, rc 0) 00000100:00100000:1.0:1713481296.686424:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562589 00000100:00100000:0.0:1713481296.686427:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26776:1960:x1796714882432000:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 59us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.686427:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16672:1960:x1796714882432064:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.686431:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.686432:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562588 00010000:00010000:1.0:1713481296.686438:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800830ae400/0xdfc0fb148a396ef lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48985 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.686446:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9717:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.686451:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686452:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686454:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800830ae400/0xdfc0fb148a396ef lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48985 expref: 16673 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686460:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800830ae400/0xdfc0fb148a396ef lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48985 expref: 16673 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686465:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800830ae400, rc 0) 00000100:00100000:0.0:1713481296.686473:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.686474:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16673:1960:x1796714882432064:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.686477:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562589 00000100:00100000:0.0:1713481296.686482:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432192 00000100:00100000:0.0:1713481296.686484:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432192 00000100:00100000:0.0:1713481296.686501:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562590 00000100:00100000:0.0:1713481296.686504:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16673:1960:x1796714882432192:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.686508:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.686512:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.686516:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009867cd80/0xdfc0fb148a396f6 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48993 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.686520:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432320 00000100:00100000:1.0:1713481296.686521:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432320 00002000:00010000:0.0:1713481296.686527:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9718:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.686530:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562591 00000100:00100000:1.0:1713481296.686532:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16675:1960:x1796714882432320:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.686534:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.686536:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686536:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.686540:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009867cd80/0xdfc0fb148a396f6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48993 expref: 16675 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686543:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800830ad8c0/0xdfc0fb148a396fd lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489a1 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.686549:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009867cd80/0xdfc0fb148a396f6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48993 expref: 16675 pid: 16545 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.686549:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9719:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.686554:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686555:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686558:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800830ad8c0/0xdfc0fb148a396fd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489a1 expref: 16676 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.686561:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867cd80, rc 0) 00010000:00010000:1.0:1713481296.686563:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800830ad8c0/0xdfc0fb148a396fd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489a1 expref: 16676 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.686568:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800830ad8c0, rc 0) 00000100:00100000:0.0:1713481296.686574:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16676:1960:x1796714882432192:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.686576:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16676:1960:x1796714882432320:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.686580:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562590 00000100:00100000:1.0:1713481296.686582:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562591 00000100:00100000:1.0:1713481296.686621:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.686659:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432128 00000100:00100000:1.0:1713481296.686662:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.686663:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432128 00000100:00100000:0.0:1713481296.686698:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432256 00000100:00100000:0.0:1713481296.686700:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432256 00000100:00100000:0.0:1713481296.686720:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562592 00000100:00100000:0.0:1713481296.686724:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26777:1960:x1796714882432128:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.686731:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.686740:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d29dd40/0xdfc0fb148a39704 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4898c expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.686748:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:0.0:1713481296.686750:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf33:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.686759:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.686760:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.686761:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432448 00010000:00010000:0.0:1713481296.686765:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d29dd40/0xdfc0fb148a39704 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4898c expref: 26778 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.686766:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432448 00010000:00010000:0.0:1713481296.686773:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d29dd40/0xdfc0fb148a39704 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4898c expref: 26778 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.686776:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562593 00010000:00010000:0.0:1713481296.686781:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d29dd40, rc 0) 00000100:00100000:1.0:1713481296.686781:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1960:x1796714882432256:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.686787:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.686794:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1960:x1796714882432128:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.686796:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800830af840/0xdfc0fb148a3970b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4899a expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.686798:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562594 00000100:00100000:0.0:1713481296.686802:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562592 00000100:00100000:2.0:1713481296.686803:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16675:1960:x1796714882432448:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.686807:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf34:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.686809:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.686815:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686817:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.686818:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800794661c0/0xdfc0fb148a39712 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x971a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489af expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.686821:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800830af840/0xdfc0fb148a3970b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4899a expref: 26778 pid: 16493 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.686828:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x971a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.686830:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800830af840/0xdfc0fb148a3970b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4899a expref: 26778 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.686835:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686836:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800830af840, rc 0) 00010000:00010000:2.0:1713481296.686836:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.686839:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800794661c0/0xdfc0fb148a39712 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489af expref: 16676 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.686847:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.686847:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800794661c0/0xdfc0fb148a39712 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489af expref: 16676 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.686850:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1960:x1796714882432256:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (187us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.686852:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800794661c0, rc 0) 00000100:00100000:1.0:1713481296.686856:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562593 00000100:00100000:0.0:1713481296.686858:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432384 00000100:00100000:0.0:1713481296.686861:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432384 00000100:00100000:2.0:1713481296.686865:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16676:1960:x1796714882432448:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.686870:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562594 00000100:00100000:0.0:1713481296.686874:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562595 00000100:00100000:0.0:1713481296.686878:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1960:x1796714882432384:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.686883:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.686890:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092300900/0xdfc0fb148a39719 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489a8 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.686899:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.686914:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432512 00000100:00100000:2.0:1713481296.686918:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432512 00000100:00100000:1.0:1713481296.686919:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.686934:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432576 00000100:00100000:1.0:1713481296.686936:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.686936:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432576 00000100:00100000:1.0:1713481296.686944:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432704 00000100:00100000:1.0:1713481296.686946:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432704 00000100:00100000:2.0:1713481296.686953:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562596 00000100:00100000:2.0:1713481296.686957:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16677:1960:x1796714882432576:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.686960:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562597 00000100:00100000:1.0:1713481296.686963:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16677:1960:x1796714882432704:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.686964:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.686968:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.686973:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079464000/0xdfc0fb148a39720 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x971b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489bd expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.686975:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800770586c0/0xdfc0fb148a39727 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x971c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489cb expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.686981:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf35:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.686983:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x971c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.686983:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x971b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.686988:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686988:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686989:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.686990:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.686990:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.686992:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800770586c0/0xdfc0fb148a39727 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489cb expref: 16679 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.686992:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.686994:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092300900/0xdfc0fb148a39719 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489a8 expref: 26780 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.686996:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079464000/0xdfc0fb148a39720 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489bd expref: 16679 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687000:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800770586c0/0xdfc0fb148a39727 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489cb expref: 16679 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687002:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092300900/0xdfc0fb148a39719 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489a8 expref: 26780 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687005:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800770586c0, rc 0) 00010000:00010000:2.0:1713481296.687005:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079464000/0xdfc0fb148a39720 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489bd expref: 16679 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687009:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092300900, rc 0) 00010000:00010000:2.0:1713481296.687011:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079464000, rc 0) 00000100:00100000:1.0:1713481296.687014:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16679:1960:x1796714882432704:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 50us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.687017:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562597 00000100:00100000:0.0:1713481296.687022:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26780:1960:x1796714882432384:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 143us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.687024:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16679:1960:x1796714882432576:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.687028:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562595 00000100:00100000:2.0:1713481296.687031:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562596 00000100:00100000:1.0:1713481296.687043:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.687050:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432832 00000100:00100000:2.0:1713481296.687052:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432832 00000100:00100000:1.0:1713481296.687055:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.687071:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.687074:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432640 00000100:00100000:2.0:1713481296.687074:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432768 00000100:00100000:0.0:1713481296.687076:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432640 00000100:00100000:2.0:1713481296.687076:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432768 00000100:00100000:1.0:1713481296.687078:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562598 00000100:00100000:1.0:1713481296.687081:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16678:1960:x1796714882432832:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.687086:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562599 00010000:00010000:1.0:1713481296.687086:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.687090:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26781:1960:x1796714882432640:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.687090:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562600 00010000:00010000:1.0:1713481296.687093:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007705a640/0xdfc0fb148a3972e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x971d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489d9 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.687093:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26781:1960:x1796714882432768:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.687094:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.687098:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.687099:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x971d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.687100:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923018c0/0xdfc0fb148a39735 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489c4 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.687104:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079465680/0xdfc0fb148a3973c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489d2 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.687105:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687106:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713481296.687107:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf37:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.687108:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007705a640/0xdfc0fb148a3972e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489d9 expref: 16679 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687112:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713481296.687112:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf38:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.687113:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687114:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007705a640/0xdfc0fb148a3972e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489d9 expref: 16679 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687116:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923018c0/0xdfc0fb148a39735 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489c4 expref: 26783 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.687118:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.687133:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.687136:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079465680/0xdfc0fb148a3973c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489d2 expref: 26783 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687137:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007705a640, rc 0) 00010000:00010000:0.0:1713481296.687140:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923018c0/0xdfc0fb148a39735 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489c4 expref: 26783 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.687143:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880079465680/0xdfc0fb148a3973c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489d2 expref: 26783 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.687146:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16679:1960:x1796714882432832:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (103us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.687147:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923018c0, rc 0) 00010000:00010000:2.0:1713481296.687148:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079465680, rc 0) 00000100:00100000:1.0:1713481296.687150:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562598 00000100:00100000:2.0:1713481296.687158:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26783:1960:x1796714882432768:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.687162:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26783:1960:x1796714882432640:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.687162:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562600 00000100:00100000:0.0:1713481296.687168:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562599 00000100:00100000:1.0:1713481296.687173:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.687177:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432896 00000100:00100000:2.0:1713481296.687178:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432896 00000100:00100000:1.0:1713481296.687186:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.687189:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562601 00000100:00100000:2.0:1713481296.687191:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26782:1960:x1796714882432896:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.687192:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882432960 00000100:00100000:1.0:1713481296.687194:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882432960 00010000:00010000:2.0:1713481296.687195:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.687201:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800794658c0/0xdfc0fb148a39743 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489e0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.687208:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf39:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.687210:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562602 00000100:00100000:1.0:1713481296.687212:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16679:1960:x1796714882432960:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.687215:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.687215:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687216:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.687218:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800794658c0/0xdfc0fb148a39743 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489e0 expref: 26783 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687223:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092bfcb40/0xdfc0fb148a3974a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x971e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489e7 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.687223:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800794658c0/0xdfc0fb148a39743 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489e0 expref: 26783 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.687227:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800794658c0, rc 0) 00002000:00010000:1.0:1713481296.687229:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x971e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.687235:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.687235:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26783:1960:x1796714882432896:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (62us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.687236:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687238:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092bfcb40/0xdfc0fb148a3974a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489e7 expref: 16680 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.687239:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562601 00010000:00010000:1.0:1713481296.687244:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092bfcb40/0xdfc0fb148a3974a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489e7 expref: 16680 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.687247:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.687248:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092bfcb40, rc 0) 00000100:00100000:1.0:1713481296.687257:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16680:1960:x1796714882432960:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.687260:0:16537:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433088 00000100:00100000:1.0:1713481296.687261:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562602 00000100:00100000:2.0:1713481296.687262:0:16537:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433088 00000100:00100000:1.0:1713481296.687273:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562603 00000100:00100000:1.0:1713481296.687276:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16680:1960:x1796714882433088:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.687279:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.687285:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c63fa80/0xdfc0fb148a39751 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x971f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489f5 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.687290:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562604 00002000:00010000:1.0:1713481296.687291:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x971f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.687293:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26782:1960:x1796714882432512:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.687294:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.687296:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687296:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.687297:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.687299:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63fa80/0xdfc0fb148a39751 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489f5 expref: 16681 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687304:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c63fa80/0xdfc0fb148a39751 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x971f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489f5 expref: 16681 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.687304:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079465b00/0xdfc0fb148a39758 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489b6 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.687308:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63fa80, rc 0) 00002000:00010000:2.0:1713481296.687311:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf36:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.687315:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16681:1960:x1796714882433088:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 39us (70us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.687316:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.687317:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.687317:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.687318:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562603 00010000:00010000:2.0:1713481296.687319:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079465b00/0xdfc0fb148a39758 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489b6 expref: 26783 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.687325:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880079465b00/0xdfc0fb148a39758 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489b6 expref: 26783 pid: 16528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.687328:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433024 00000100:00100000:1.0:1713481296.687329:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433024 00010000:00010000:2.0:1713481296.687330:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079465b00, rc 0) 00000100:00100000:2.0:1713481296.687339:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26784:1960:x1796714882432512:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.687342:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.687342:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433152 00000100:00100000:2.0:1713481296.687343:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562604 00000100:00100000:1.0:1713481296.687344:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433152 00000100:00100000:1.0:1713481296.687351:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433216 00000100:00100000:1.0:1713481296.687352:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433216 00000100:00100000:2.0:1713481296.687353:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562605 00000100:00100000:0.0:1713481296.687356:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562606 00000100:00100000:2.0:1713481296.687356:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26784:1960:x1796714882433024:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.687359:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.687361:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26784:1960:x1796714882433152:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.687363:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562607 00010000:00010000:2.0:1713481296.687364:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079466f40/0xdfc0fb148a3975f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489ee expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.687365:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16681:1960:x1796714882433216:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.687367:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.687369:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.687370:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf3a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.687374:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687375:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c63dd40/0xdfc0fb148a39766 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a03 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.687375:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687376:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132091f80/0xdfc0fb148a3976d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa489fc expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.687377:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079466f40/0xdfc0fb148a3975f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489ee expref: 26785 pid: 16528 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.687381:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9720:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.687382:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880079466f40/0xdfc0fb148a3975f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489ee expref: 26785 pid: 16528 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.687386:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf3b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.687386:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.687386:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079466f40, rc 0) 00010000:00010000:1.0:1713481296.687387:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687389:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63dd40/0xdfc0fb148a39766 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a03 expref: 16682 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.687392:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26786:1960:x1796714882433024:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 36us (100us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.687393:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687394:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687395:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c63dd40/0xdfc0fb148a39766 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a03 expref: 16682 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.687395:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562605 00010000:00010000:0.0:1713481296.687397:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132091f80/0xdfc0fb148a3976d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489fc expref: 26786 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687399:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63dd40, rc 0) 00010000:00010000:0.0:1713481296.687405:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132091f80/0xdfc0fb148a3976d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa489fc expref: 26785 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.687408:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16682:1960:x1796714882433216:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.687411:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562607 00010000:00010000:0.0:1713481296.687412:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132091f80, rc 0) 00000100:00100000:0.0:1713481296.687423:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26785:1960:x1796714882433152:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.687427:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562606 00000100:00100000:1.0:1713481296.687434:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.687439:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433344 00000100:00100000:0.0:1713481296.687441:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433344 00000100:00100000:1.0:1713481296.687447:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.687458:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433280 00000100:00100000:0.0:1713481296.687460:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433280 00000100:00100000:1.0:1713481296.687464:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562608 00000100:00100000:1.0:1713481296.687467:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16682:1960:x1796714882433344:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.687471:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.687472:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562609 00000100:00100000:0.0:1713481296.687476:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26785:1960:x1796714882433280:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.687477:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ebef40/0xdfc0fb148a39774 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a11 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.687481:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.687486:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9721:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.687489:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b28d80/0xdfc0fb148a3977b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a0a expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.687491:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687492:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687494:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebef40/0xdfc0fb148a39774 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a11 expref: 16683 pid: 16462 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.687496:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf3c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.687500:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ebef40/0xdfc0fb148a39774 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a11 expref: 16683 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687501:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687502:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687504:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebef40, rc 0) 00010000:00010000:0.0:1713481296.687505:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b28d80/0xdfc0fb148a3977b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a0a expref: 26786 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687510:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b28d80/0xdfc0fb148a3977b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a0a expref: 26786 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.687512:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16683:1960:x1796714882433344:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (78us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.687514:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b28d80, rc 0) 00000100:00100000:1.0:1713481296.687515:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562608 00000100:00100000:0.0:1713481296.687523:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26786:1960:x1796714882433280:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.687527:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562609 00000100:00100000:1.0:1713481296.687538:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.687552:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433408 00000100:00100000:0.0:1713481296.687554:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433408 00000100:00100000:0.0:1713481296.687562:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562610 00000100:00100000:0.0:1713481296.687564:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26786:1960:x1796714882433408:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.687568:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.687573:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b2b600/0xdfc0fb148a39782 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a18 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.687580:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf3d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.687584:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687584:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687587:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b2b600/0xdfc0fb148a39782 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a18 expref: 26787 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687592:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b2b600/0xdfc0fb148a39782 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a18 expref: 26787 pid: 16463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.687600:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b2b600, rc 0) 00000100:00100000:0.0:1713481296.687611:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26787:1960:x1796714882433408:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.687615:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562610 00000100:00100000:1.0:1713481296.687616:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.687625:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433472 00000100:00100000:1.0:1713481296.687627:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433472 00000100:00100000:1.0:1713481296.687644:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562611 00000100:00100000:1.0:1713481296.687646:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16683:1960:x1796714882433472:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.687651:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.687658:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ebf600/0xdfc0fb148a39789 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a1f expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.687675:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9722:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.687678:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.687681:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687682:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687685:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebf600/0xdfc0fb148a39789 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a1f expref: 16684 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687691:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ebf600/0xdfc0fb148a39789 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a1f expref: 16684 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.687694:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433536 00010000:00010000:1.0:1713481296.687695:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebf600, rc 0) 00000100:00100000:0.0:1713481296.687697:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433536 00000100:00100000:1.0:1713481296.687704:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16684:1960:x1796714882433472:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 57us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.687708:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562611 00000100:00100000:0.0:1713481296.687711:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562612 00000100:00100000:0.0:1713481296.687716:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26787:1960:x1796714882433536:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.687723:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.687731:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b2bcc0/0xdfc0fb148a39790 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a26 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.687733:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:0.0:1713481296.687741:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf3e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.687742:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433600 00000100:00100000:1.0:1713481296.687744:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433600 00010000:00010000:0.0:1713481296.687748:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687749:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.687751:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562613 00010000:00010000:0.0:1713481296.687753:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b2bcc0/0xdfc0fb148a39790 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a26 expref: 26788 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.687754:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16684:1960:x1796714882433600:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.687758:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.687761:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b2bcc0/0xdfc0fb148a39790 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a26 expref: 26788 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687763:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ebc240/0xdfc0fb148a39797 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a2d expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.687768:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b2bcc0, rc 0) 00002000:00010000:1.0:1713481296.687772:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9723:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.687779:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:1960:x1796714882433536:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (102us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.687779:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687780:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687784:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebc240/0xdfc0fb148a39797 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a2d expref: 16685 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.687787:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562612 00010000:00010000:1.0:1713481296.687793:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ebc240/0xdfc0fb148a39797 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a2d expref: 16685 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687805:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebc240, rc 0) 00000100:00100000:1.0:1713481296.687819:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16685:1960:x1796714882433600:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.687825:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562613 00000100:00100000:0.0:1713481296.687829:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.687839:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433664 00000100:00100000:1.0:1713481296.687841:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433664 00000100:00100000:1.0:1713481296.687863:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562614 00000100:00100000:1.0:1713481296.687868:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:1960:x1796714882433664:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.687874:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.687882:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ebe880/0xdfc0fb148a3979e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a34 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.687885:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.687892:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf3f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.687897:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433728 00010000:00010000:1.0:1713481296.687899:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.687900:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433728 00010000:00010000:1.0:1713481296.687900:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687903:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ebe880/0xdfc0fb148a3979e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a34 expref: 26789 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687909:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ebe880/0xdfc0fb148a3979e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a34 expref: 26789 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.687914:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebe880, rc 0) 00000100:00100000:0.0:1713481296.687915:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562615 00000100:00100000:0.0:1713481296.687919:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16685:1960:x1796714882433728:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.687923:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26789:1960:x1796714882433664:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.687925:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.687927:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562614 00010000:00010000:0.0:1713481296.687935:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b2a1c0/0xdfc0fb148a397a5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a3b expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.687945:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9724:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.687952:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.687953:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687954:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.687959:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b2a1c0/0xdfc0fb148a397a5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a3b expref: 16686 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.687964:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433792 00000100:00100000:1.0:1713481296.687966:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433792 00010000:00010000:0.0:1713481296.687968:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b2a1c0/0xdfc0fb148a397a5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a3b expref: 16686 pid: 16463 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.687974:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562616 00010000:00010000:0.0:1713481296.687975:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b2a1c0, rc 0) 00000100:00100000:1.0:1713481296.687976:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26789:1959:x1796714882433792:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.687980:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.687987:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ebe1c0/0xdfc0fb148a397ac lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a42 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.687989:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16686:1960:x1796714882433728:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (103us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.687993:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf40:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.687994:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562615 00010000:00010000:1.0:1713481296.687998:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.687999:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688002:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ebe1c0/0xdfc0fb148a397ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a42 expref: 26790 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688007:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ebe1c0/0xdfc0fb148a397ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a42 expref: 26790 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688011:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebe1c0, rc 0) 00000100:00100000:1.0:1713481296.688019:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:1959:x1796714882433792:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.688022:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562616 00000100:00100000:0.0:1713481296.688076:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.688091:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433856 00000100:00100000:1.0:1713481296.688093:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433856 00000100:00100000:1.0:1713481296.688102:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562617 00000100:00100000:1.0:1713481296.688105:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16686:1960:x1796714882433856:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.688109:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.688115:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.688115:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ebd440/0xdfc0fb148a397b3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a49 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.688138:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9725:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.688143:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688144:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688147:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebd440/0xdfc0fb148a397b3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a49 expref: 16687 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.688151:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433920 00010000:00010000:1.0:1713481296.688153:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ebd440/0xdfc0fb148a397b3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a49 expref: 16687 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.688155:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433920 00010000:00010000:1.0:1713481296.688157:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebd440, rc 0) 00000100:00100000:1.0:1713481296.688166:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16687:1960:x1796714882433856:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.688171:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562618 00000100:00100000:1.0:1713481296.688174:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562617 00000100:00100000:0.0:1713481296.688175:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:1960:x1796714882433920:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.688181:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.688190:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801204d7180/0xdfc0fb148a397ba lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a50 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.688199:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf41:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.688200:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.688206:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.688207:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.688210:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882433984 00010000:00010000:0.0:1713481296.688211:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801204d7180/0xdfc0fb148a397ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a50 expref: 26791 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.688212:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882433984 00010000:00010000:0.0:1713481296.688219:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801204d7180/0xdfc0fb148a397ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a50 expref: 26791 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.688219:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562619 00000100:00100000:1.0:1713481296.688221:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16687:1960:x1796714882433984:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.688225:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801204d7180, rc 0) 00010000:00010000:1.0:1713481296.688225:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.688231:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ebc900/0xdfc0fb148a397c1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a57 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.688236:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:1960:x1796714882433920:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (121us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.688237:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9726:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.688241:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562618 00010000:00010000:1.0:1713481296.688242:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688243:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688246:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebc900/0xdfc0fb148a397c1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a57 expref: 16688 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688251:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ebc900/0xdfc0fb148a397c1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a57 expref: 16688 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688255:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebc900, rc 0) 00000100:00100000:1.0:1713481296.688263:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16688:1960:x1796714882433984:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.688266:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562619 00000100:00100000:0.0:1713481296.688282:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.688297:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434048 00000100:00100000:1.0:1713481296.688299:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434048 00000100:00100000:1.0:1713481296.688308:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562620 00000100:00100000:1.0:1713481296.688310:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:1960:x1796714882434048:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.688314:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.688319:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ebcb40/0xdfc0fb148a397c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a5e expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.688321:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.688326:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf42:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.688331:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688332:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688334:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ebcb40/0xdfc0fb148a397c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a5e expref: 26792 pid: 16493 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688340:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ebcb40/0xdfc0fb148a397c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a5e expref: 26792 pid: 16493 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.688345:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.688347:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebcb40, rc 0) 00000100:00100000:0.0:1713481296.688354:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434176 00000100:00100000:0.0:1713481296.688356:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434176 00000100:00100000:1.0:1713481296.688356:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26792:1960:x1796714882434048:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.688356:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434112 00000100:00100000:1.0:1713481296.688359:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562620 00000100:00100000:2.0:1713481296.688359:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434112 00000100:00100000:0.0:1713481296.688366:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562621 00000100:00100000:0.0:1713481296.688368:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16688:17935:x1796714882434176:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.688373:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.688378:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485774 00010000:00010000:0.0:1713481296.688380:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096f3f3c0/0xdfc0fb148a397cf lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a6c expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.688382:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.688382:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2186:18578:x1796714882434112:12345-192.168.202.24@tcp:101:rm.0 00002000:00010000:0.0:1713481296.688388:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.688389:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.688390:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434240 00000100:00100000:1.0:1713481296.688392:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434240 00010000:00010000:0.0:1713481296.688394:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.688395:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.688397:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800794646c0/0xdfc0fb148a397d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a65 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.688399:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096f3f3c0/0xdfc0fb148a397cf lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a6c expref: 16690 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.688399:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562622 00000100:00100000:1.0:1713481296.688402:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16690:1960:x1796714882434240:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.688406:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.688407:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096f3f3c0/0xdfc0fb148a397cf lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a6c expref: 16690 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.688413:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ebd8c0/0xdfc0fb148a397dd lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a73 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.688414:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f3f3c0, rc 0) 00002000:00010000:1.0:1713481296.688419:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9727:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.688424:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688425:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.688427:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16691:17935:x1796714882434176:12345-192.168.202.24@tcp:101:dd.0 Request processed in 57us (80us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.688427:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebd8c0/0xdfc0fb148a397dd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a73 expref: 16691 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.688432:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562621 00010000:00010000:1.0:1713481296.688433:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ebd8c0/0xdfc0fb148a397dd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a73 expref: 16691 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688437:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebd8c0, rc 0) 00000100:00100000:1.0:1713481296.688445:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a41b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16690:1960:x1796714882434240:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (63us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.688446:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.688451:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562622 00010000:00010000:2.0:1713481296.688455:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688461:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688470:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688476:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688480:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688522:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880086c546c0/0xdfc0fb148a397f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688530:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086c546c0/0xdfc0fb148a397f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688536:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880086c546c0/0xdfc0fb148a397f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000004:00200000:2.0:1713481296.688564:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51e6:0x0]: returning size 5 00000004:00200000:2.0:1713481296.688567:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713481296.688579:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880086c546c0/0xdfc0fb148a397f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.688584:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784481920:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.688587:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086c546c0/0xdfc0fb148a397f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.688589:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.688592:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688597:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688602:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.688603:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.688606:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688610:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079464900 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.688611:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20859:1959:x1796714882406016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 37064us (37198us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.688612:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.688615:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820143 00010000:00010000:2.0:1713481296.688616:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688622:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x0 (ffff8800897e3f00) 00010000:00010000:2.0:1713481296.688625:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.688627:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688631:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079464900/0xdfc0fb148a397e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.688640:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434368 00000100:00100000:1.0:1713481296.688641:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434368 00010000:00010000:2.0:1713481296.688648:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.688649:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562623 00000100:00100000:1.0:1713481296.688651:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20859:18792:x1796714882434368:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.688652:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.688656:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.688657:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688660:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007723f3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.688662:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ebd200/0xdfc0fb148a397f9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc50a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a81 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.688662:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688679:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.688684:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x38 (ffff8801344dce00) 00002000:00010000:1.0:1713481296.688685:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc50a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.688686:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.688688:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.688692:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.688692:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007723f3c0/0xdfc0fb148a397eb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.688693:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.688696:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.688697:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebd200/0xdfc0fb148a397f9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a81 expref: 20860 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.688703:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ebd200/0xdfc0fb148a397f9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a81 expref: 20860 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.688707:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ebd200, rc 0) 00000100:00100000:0.0:1713481296.688710:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434304 00000100:00100000:0.0:1713481296.688713:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434304 00000100:00100000:1.0:1713481296.688716:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20860:18792:x1796714882434368:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.688722:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562623 00010000:00010000:2.0:1713481296.688724:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800794646c0/0xdfc0fb148a397d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a65 expref: 2188 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.688725:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562624 00000100:00100000:0.0:1713481296.688729:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26792:1960:x1796714882434304:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.688734:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880086c546c0/0xdfc0fb148a397f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a65 expref: 2187 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.688735:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.688740:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e6:0x0].0x0 (ffff880095c72f00) 00010000:00010000:0.0:1713481296.688742:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096f3d8c0/0xdfc0fb148a39800 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a7a expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.688742:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713481296.688744:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c546c0, rc 0) 00000100:00100000:1.0:1713481296.688748:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:0.0:1713481296.688757:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf43:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.688757:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2187:18578:x1796714882434112:12345-192.168.202.24@tcp:101:rm.0 Request processed in 375us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.688761:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434432 00000100:00100000:2.0:1713481296.688762:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485774 00000100:00100000:1.0:1713481296.688763:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434432 00010000:00010000:0.0:1713481296.688764:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.688765:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.688769:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096f3d8c0/0xdfc0fb148a39800 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a7a expref: 26793 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.688771:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562625 00000100:00100000:1.0:1713481296.688773:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16690:1960:x1796714882434432:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.688777:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096f3d8c0/0xdfc0fb148a39800 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a7a expref: 26793 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688777:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.688783:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f3d8c0, rc 0) 00010000:00010000:1.0:1713481296.688784:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a52db00/0xdfc0fb148a39807 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a88 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.688791:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9728:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.688797:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688797:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.688800:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a52db00/0xdfc0fb148a39807 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a88 expref: 16691 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688805:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a52db00/0xdfc0fb148a39807 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a88 expref: 16691 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.688810:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a52db00, rc 0) 00000100:00100000:1.0:1713481296.688874:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16691:1960:x1796714882434432:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 100us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.688875:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26793:1960:x1796714882434304:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 144us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.688877:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562625 00000100:00100000:0.0:1713481296.688881:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562624 00000100:00100000:0.0:1713481296.688924:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007727ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784481984:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.688948:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.688957:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16690:1959:x1796714882406144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 37406us (37504us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.688962:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820144 00000100:00100000:1.0:1713481296.689032:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.689048:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.689051:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434560 00000100:00100000:0.0:1713481296.689055:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434560 00000100:00100000:0.0:1713481296.689076:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434624 00000100:00100000:0.0:1713481296.689078:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434624 00000100:00100000:1.0:1713481296.689079:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562626 00000100:00100000:1.0:1713481296.689082:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16690:18836:x1796714882434560:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.689087:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.689091:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562627 00010000:00010000:1.0:1713481296.689092:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2eb840/0xdfc0fb148a3980e lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a96 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.689095:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26793:11552:x1796714882434624:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.689101:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.689102:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f0dad00/0xdfc0fb14891e31e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb237 expref: 20859 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.689106:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.689107:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.689108:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096f3f600/0xdfc0fb148a39815 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a9d expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.689109:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2eb840/0xdfc0fb148a3980e lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a96 expref: 16691 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.689137:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a09440/0xdfc0fb148959c1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeba6 expref: 26794 pid: 16501 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.689138:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f0dad00/0xdfc0fb14891e31e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb237 expref: 20859 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.689142:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689143:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f0dad00/0xdfc0fb14891e31e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb237 expref: 20859 pid: 16509 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.689144:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.689146:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096f3f600/0xdfc0fb148a39815 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a9d expref: 26794 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.689149:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007684c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784484992:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.689160:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e003e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.689161:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a09440/0xdfc0fb148959c1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeba6 expref: 26794 pid: 16501 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.689169:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a09440/0xdfc0fb148959c1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeba6 expref: 26794 pid: 16501 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.689177:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007287df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784485056:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.689183:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.689194:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434496 00000100:00100000:0.0:1713481296.689195:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fc000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.689196:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434496 00000100:00100000:1.0:1713481296.689213:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562628 00000100:00100000:1.0:1713481296.689215:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26795:1960:x1796714882434496:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.689222:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.689228:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801304d5200/0xdfc0fb148a3981c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48a8f expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.689234:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.689235:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf44:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.689240:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689241:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689244:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801304d5200/0xdfc0fb148a3981c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a8f expref: 26796 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.689247:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434688 00010000:00010000:1.0:1713481296.689250:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801304d5200/0xdfc0fb148a3981c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a8f expref: 26796 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.689250:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434688 00000100:00100000:0.0:1713481296.689253:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.689255:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801304d5200, rc 0) 00000100:00100000:1.0:1713481296.689263:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26796:1960:x1796714882434496:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.689264:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434816 00000100:00100000:2.0:1713481296.689266:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562629 00000100:00100000:0.0:1713481296.689267:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434816 00000100:00100000:1.0:1713481296.689269:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562628 00000100:00100000:2.0:1713481296.689270:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16693:1960:x1796714882434688:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.689275:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.689282:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c57840/0xdfc0fb148a39823 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48aa4 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.689283:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562630 00000100:00100000:1.0:1713481296.689285:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16693:1960:x1796714882434816:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.689289:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.689290:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9729:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.689295:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124ecf180/0xdfc0fb148a3982a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x972a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ab2 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.689295:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.689296:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.689299:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c57840/0xdfc0fb148a39823 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aa4 expref: 16694 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.689302:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.689302:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x972a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.689305:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c57840/0xdfc0fb148a39823 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aa4 expref: 16695 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.689306:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689307:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689310:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124ecf180/0xdfc0fb148a3982a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ab2 expref: 16695 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.689310:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c57840, rc 0) 00000100:00100000:0.0:1713481296.689312:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434752 00000100:00100000:0.0:1713481296.689315:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434752 00010000:00010000:1.0:1713481296.689315:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124ecf180/0xdfc0fb148a3982a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ab2 expref: 16695 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.689319:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124ecf180, rc 0) 00000100:00100000:2.0:1713481296.689320:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16695:1960:x1796714882434688:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.689324:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562629 00000100:00100000:1.0:1713481296.689326:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16695:1960:x1796714882434816:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.689329:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562631 00000100:00100000:1.0:1713481296.689332:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562630 00000100:00100000:0.0:1713481296.689333:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26796:1960:x1796714882434752:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.689339:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.689349:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098380000/0xdfc0fb148a39831 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48aab expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.689360:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf45:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.689367:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.689368:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.689371:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.689372:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098380000/0xdfc0fb148a39831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aab expref: 26797 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.689381:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098380000/0xdfc0fb148a39831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aab expref: 26797 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.689381:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434944 00000100:00100000:1.0:1713481296.689382:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434944 00010000:00010000:0.0:1713481296.689388:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098380000, rc 0) 00000100:00100000:1.0:1713481296.689391:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562632 00000100:00100000:1.0:1713481296.689394:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16694:1960:x1796714882434944:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.689398:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.689402:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26797:1960:x1796714882434752:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (100us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.689405:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099dd4480/0xdfc0fb148a39838 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x972b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ac0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.689408:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562631 00002000:00010000:1.0:1713481296.689413:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x972b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.689418:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689419:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689421:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099dd4480/0xdfc0fb148a39838 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ac0 expref: 16695 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.689427:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099dd4480/0xdfc0fb148a39838 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ac0 expref: 16695 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.689434:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099dd4480, rc 0) 00000100:00100000:1.0:1713481296.689529:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16695:1960:x1796714882434944:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 135us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.689532:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.689533:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562632 00000100:00100000:1.0:1713481296.689542:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435072 00000100:00100000:1.0:1713481296.689544:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435072 00000100:00100000:0.0:1713481296.689551:0:16537:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562633 00000100:00100000:0.0:1713481296.689555:0:16537:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16695:1960:x1796714882435072:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.689561:0:16537:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.689570:0:16537:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090be98c0/0xdfc0fb148a3983f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x972c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ace expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.689579:0:16537:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x972c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.689586:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.689586:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.689588:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.689592:0:16537:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090be98c0/0xdfc0fb148a3983f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ace expref: 16696 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.689600:0:16537:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090be98c0/0xdfc0fb148a3983f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ace expref: 16696 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.689602:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882434880 00000100:00100000:1.0:1713481296.689605:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882434880 00010000:00010000:0.0:1713481296.689608:0:16537:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090be98c0, rc 0) 00000100:00100000:0.0:1713481296.689621:0:16537:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16696:1960:x1796714882435072:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.689626:0:16537:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562633 00000100:00100000:1.0:1713481296.689630:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562634 00000100:00100000:1.0:1713481296.689635:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26797:1960:x1796714882434880:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.689642:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.689653:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099dd61c0/0xdfc0fb148a39846 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ab9 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.689663:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf46:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.689680:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.689685:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689687:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689691:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099dd61c0/0xdfc0fb148a39846 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ab9 expref: 26798 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.689695:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435008 00000100:00100000:0.0:1713481296.689697:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435008 00010000:00010000:1.0:1713481296.689701:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099dd61c0/0xdfc0fb148a39846 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ab9 expref: 26799 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.689707:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099dd61c0, rc 0) 00000100:00100000:0.0:1713481296.689712:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562635 00000100:00100000:0.0:1713481296.689716:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:1960:x1796714882435008:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.689722:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.689722:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:1960:x1796714882434880:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.689728:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562634 00010000:00010000:0.0:1713481296.689731:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a926d00/0xdfc0fb148a3984d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ac7 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.689739:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf47:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.689746:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.689748:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.689751:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a926d00/0xdfc0fb148a3984d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ac7 expref: 26799 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.689759:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a926d00/0xdfc0fb148a3984d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ac7 expref: 26799 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.689770:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a926d00, rc 0) 00000100:00100000:0.0:1713481296.689781:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:1960:x1796714882435008:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.689785:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562635 00000100:00100000:1.0:1713481296.689841:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.689856:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.689865:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435136 00000100:00100000:1.0:1713481296.689867:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435136 00000100:00100000:1.0:1713481296.689884:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435200 00000100:00100000:1.0:1713481296.689885:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435200 00000100:00100000:1.0:1713481296.689892:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562636 00000100:00100000:1.0:1713481296.689895:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:1960:x1796714882435136:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.689898:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562637 00010000:00010000:1.0:1713481296.689900:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.689902:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a07b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16696:1960:x1796714882435200:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.689906:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099dd7cc0/0xdfc0fb148a39854 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ad5 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.689907:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.689914:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf48:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.689915:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c55f80/0xdfc0fb148a3985b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x972d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48adc expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.689919:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689920:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689922:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099dd7cc0/0xdfc0fb148a39854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ad5 expref: 26800 pid: 16462 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.689923:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x972d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.689928:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099dd7cc0/0xdfc0fb148a39854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ad5 expref: 26800 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.689929:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.689930:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.689933:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099dd7cc0, rc 0) 00010000:00010000:2.0:1713481296.689933:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c55f80/0xdfc0fb148a3985b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48adc expref: 16697 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.689939:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c55f80/0xdfc0fb148a3985b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48adc expref: 16697 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.689942:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26800:1960:x1796714882435136:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (102us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.689943:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c55f80, rc 0) 00000100:00100000:1.0:1713481296.689949:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562636 00000100:00100000:0.0:1713481296.689951:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.689953:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a07b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16697:1960:x1796714882435200:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.689957:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562637 00000100:00100000:1.0:1713481296.689959:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435328 00000100:00100000:1.0:1713481296.689961:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435328 00000100:00100000:2.0:1713481296.689969:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562638 00000100:00100000:2.0:1713481296.689972:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16697:1960:x1796714882435328:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.689975:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.689981:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c56ac0/0xdfc0fb148a39862 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x972e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48aea expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.689987:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x972e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.689992:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.689993:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.689995:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c56ac0/0xdfc0fb148a39862 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aea expref: 16698 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.690000:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c56ac0/0xdfc0fb148a39862 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aea expref: 16698 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.690004:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c56ac0, rc 0) 00000100:00100000:2.0:1713481296.690051:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16698:1960:x1796714882435328:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 79us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.690053:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.690054:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562638 00000100:00100000:2.0:1713481296.690065:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435264 00000100:00100000:2.0:1713481296.690067:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435264 00000100:00100000:2.0:1713481296.690082:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562639 00000100:00100000:2.0:1713481296.690084:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26800:1960:x1796714882435264:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.690088:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.690094:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.690094:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086c56d00/0xdfc0fb148a39869 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ae3 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.690101:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf49:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.690105:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435392 00010000:00010000:2.0:1713481296.690105:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.690106:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.690107:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435392 00010000:00010000:2.0:1713481296.690109:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086c56d00/0xdfc0fb148a39869 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ae3 expref: 26801 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.690113:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.690114:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086c56d00/0xdfc0fb148a39869 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ae3 expref: 26802 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.690136:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435456 00000100:00100000:1.0:1713481296.690138:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435456 00010000:00010000:2.0:1713481296.690142:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c56d00, rc 0) 00000100:00100000:0.0:1713481296.690143:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562640 00000100:00100000:0.0:1713481296.690147:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26802:1960:x1796714882435392:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.690152:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.690154:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562641 00000100:00100000:1.0:1713481296.690157:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16698:1960:x1796714882435456:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.690161:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a924d80/0xdfc0fb148a39870 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48af1 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.690161:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.690167:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099dd7600/0xdfc0fb148a39877 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x972f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48af8 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.690170:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf4a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.690172:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26802:1960:x1796714882435264:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 85us (117us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.690174:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x972f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.690177:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.690178:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.690178:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562639 00010000:00010000:1.0:1713481296.690179:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690180:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.690182:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a924d80/0xdfc0fb148a39870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48af1 expref: 26803 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.690183:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099dd7600/0xdfc0fb148a39877 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48af8 expref: 16699 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.690188:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099dd7600/0xdfc0fb148a39877 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x972f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48af8 expref: 16699 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.690190:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a924d80/0xdfc0fb148a39870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48af1 expref: 26803 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.690193:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099dd7600, rc 0) 00010000:00010000:0.0:1713481296.690196:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a924d80, rc 0) 00000100:00100000:1.0:1713481296.690201:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16699:1960:x1796714882435456:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.690205:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562641 00000100:00100000:0.0:1713481296.690207:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26802:1960:x1796714882435392:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.690213:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562640 00000100:00100000:1.0:1713481296.690255:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.690275:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.690277:0:16537:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435520 00000100:00100000:0.0:1713481296.690280:0:16537:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435520 00000100:00100000:1.0:1713481296.690292:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.690299:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435584 00000100:00100000:1.0:1713481296.690301:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435584 00000100:00100000:1.0:1713481296.690317:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435648 00000100:00100000:1.0:1713481296.690318:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435648 00000100:00100000:1.0:1713481296.690325:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562642 00000100:00100000:1.0:1713481296.690328:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16699:1960:x1796714882435584:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.690332:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.690334:0:16464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562643 00010000:00010000:1.0:1713481296.690338:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099dd5680/0xdfc0fb148a3987e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b06 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.690340:0:16464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26803:1960:x1796714882435648:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.690345:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9730:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.690347:0:16464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.690350:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690351:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690353:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099dd5680/0xdfc0fb148a3987e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b06 expref: 16700 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.690356:0:16464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907f5f80/0xdfc0fb148a39885 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b0d expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.690359:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099dd5680/0xdfc0fb148a3987e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b06 expref: 16700 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.690363:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099dd5680, rc 0) 00002000:00010000:2.0:1713481296.690367:0:16464:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf4c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.690371:0:16537:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562644 00000100:00100000:1.0:1713481296.690371:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16700:1960:x1796714882435584:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.690375:0:16537:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26804:1960:x1796714882435520:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.690375:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562642 00010000:00010000:2.0:1713481296.690376:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.690377:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.690381:0:16537:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.690382:0:16464:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907f5f80/0xdfc0fb148a39885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b0d expref: 26804 pid: 16464 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.690389:0:16537:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a924b40/0xdfc0fb148a3988c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48aff expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.690391:0:16464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800907f5f80/0xdfc0fb148a39885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b0d expref: 26804 pid: 16464 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.690397:0:16537:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf4b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.690397:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.690398:0:16464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907f5f80, rc 0) 00010000:00010000:0.0:1713481296.690404:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.690404:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435712 00010000:00010000:0.0:1713481296.690405:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.690406:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435712 00010000:00010000:0.0:1713481296.690409:0:16537:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a924b40/0xdfc0fb148a3988c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aff expref: 26805 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.690412:0:16464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26805:1960:x1796714882435648:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.690414:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562645 00010000:00010000:0.0:1713481296.690417:0:16537:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a924b40/0xdfc0fb148a3988c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48aff expref: 26805 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.690417:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16700:1960:x1796714882435712:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.690418:0:16464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562643 00010000:00010000:1.0:1713481296.690421:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.690424:0:16537:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a924b40, rc 0) 00010000:00010000:1.0:1713481296.690426:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fd7840/0xdfc0fb148a39893 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b14 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.690435:0:16537:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26804:1960:x1796714882435520:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (179us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.690435:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9731:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.690440:0:16537:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562644 00010000:00010000:1.0:1713481296.690443:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690444:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690448:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fd7840/0xdfc0fb148a39893 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b14 expref: 16701 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.690457:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fd7840/0xdfc0fb148a39893 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b14 expref: 16701 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.690464:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fd7840, rc 0) 00000100:00100000:1.0:1713481296.690477:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16701:1960:x1796714882435712:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.690482:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562645 00000100:00100000:2.0:1713481296.690500:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078411180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784482112:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.690525:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.690528:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.690533:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001_UUID:15514:1796714784482176:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.690546:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.690556:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.690557:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.690558:0:16508:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800796de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16508:1796714784482240:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.690563:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435776 00000100:00100000:0.0:1713481296.690565:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435776 00000100:00100000:0.0:1713481296.690573:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435968 00000100:00100000:0.0:1713481296.690574:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435968 00000100:00100000:1.0:1713481296.690574:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436096 00000100:00100000:1.0:1713481296.690577:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436096 00010000:00010000:2.0:1713481296.690580:0:16508:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3b7180/0xdfc0fb148a38be3 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f7c expref: 24481 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.690581:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562646 00000100:00100000:0.0:1713481296.690584:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26805:1960:x1796714882435776:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.690587:0:16508:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3b7180, rc 0) 00010000:00010000:0.0:1713481296.690588:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.690594:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a924000/0xdfc0fb148a3989a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b1b expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.690595:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562647 00000100:00100000:2.0:1713481296.690598:0:16508:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:17924:x1796714882406720:12345-192.168.202.24@tcp:101:dd.0 Request processed in 38410us (38585us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.690600:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16701:1960:x1796714882435968:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.690602:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf4d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.690602:0:16508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562209 00010000:00010000:0.0:1713481296.690607:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690607:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.690608:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.690611:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a924000/0xdfc0fb148a3989a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b1b expref: 26806 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.690616:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fd5f80/0xdfc0fb148a398a1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b22 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.690620:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a924000/0xdfc0fb148a3989a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b1b expref: 26806 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.690620:0:16508:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562648 00000100:00100000:2.0:1713481296.690623:0:16508:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1960:x1796714882436096:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.690624:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9732:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.690627:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a924000, rc 0) 00010000:00010000:2.0:1713481296.690627:0:16508:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.690631:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690632:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.690634:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fd5f80/0xdfc0fb148a398a1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b22 expref: 16702 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.690634:0:16508:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907f58c0/0xdfc0fb148a398a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b29 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.690640:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1960:x1796714882435776:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 54us (112us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.690641:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fd5f80/0xdfc0fb148a398a1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b22 expref: 16702 pid: 16462 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.690641:0:16508:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf4e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.690645:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fd5f80, rc 0) 00000100:00100000:0.0:1713481296.690646:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562646 00010000:00010000:2.0:1713481296.690647:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.690648:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.690651:0:16508:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907f58c0/0xdfc0fb148a398a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b29 expref: 26807 pid: 16508 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.690655:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16702:1960:x1796714882435968:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.690656:0:16508:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800907f58c0/0xdfc0fb148a398a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b29 expref: 26806 pid: 16508 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.690659:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562647 00010000:00010000:2.0:1713481296.690681:0:16508:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907f58c0, rc 0) 00000100:00100000:2.0:1713481296.690692:0:16508:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1960:x1796714882436096:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.690693:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.690696:0:16508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562648 00000100:00100000:2.0:1713481296.690707:0:16508:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436224 00000100:00100000:2.0:1713481296.690709:0:16508:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436224 00000100:00100000:0.0:1713481296.690716:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.690726:0:16508:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562649 00000100:00100000:2.0:1713481296.690728:0:16508:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1960:x1796714882436224:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.690733:0:16508:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.690739:0:16508:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8dc900/0xdfc0fb148a398af lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b37 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.690746:0:16508:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf4f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.690751:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.690753:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.690755:0:16508:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8dc900/0xdfc0fb148a398af lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b37 expref: 26807 pid: 16508 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.690760:0:16508:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d8dc900/0xdfc0fb148a398af lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b37 expref: 26807 pid: 16508 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.690764:0:16508:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d8dc900, rc 0) 00000100:00100000:2.0:1713481296.690798:0:16508:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26807:1960:x1796714882436224:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.690801:0:16508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562649 00000100:00100000:0.0:1713481296.690811:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.690818:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436288 00000100:00100000:2.0:1713481296.690820:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436288 00000100:00100000:0.0:1713481296.690825:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435904 00000100:00100000:0.0:1713481296.690828:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435904 00000100:00100000:2.0:1713481296.690831:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485775 00000100:00100000:1.0:1713481296.690833:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.690833:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18867:x1796714882436288:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:0.0:1713481296.690839:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121ad4900/0xdfc0fb148a350c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45e2e expref: 2369 pid: 15484 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.690839:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.690845:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800933fb600/0xdfc0fb148a398b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b45 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.690846:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436032 00000100:00100000:1.0:1713481296.690847:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436032 00000100:00100000:0.0:1713481296.690852:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820164 00000100:00100000:0.0:1713481296.690856:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:1960:x1796714882435904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.690856:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120fd86c0/0xdfc0fb148a16249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39805 expref: 24481 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.690862:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.690866:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880121ad4900/0xdfc0fb148a350c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45e2e expref: 2369 pid: 15484 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.690866:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820165 00000100:00100000:1.0:1713481296.690869:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1960:x1796714882436032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.690873:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880121ad4900/0xdfc0fb148a350c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45e2e expref: 2369 pid: 15484 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.690873:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.690876:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120fd86c0/0xdfc0fb148a16249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39805 expref: 24481 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.690881:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120fd86c0/0xdfc0fb148a16249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39805 expref: 24481 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.690884:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121ad4900/0xdfc0fb148a350c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45e2e expref: 2369 pid: 15484 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.690884:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690889:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.690891:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120fd86c0/0xdfc0fb148a16249 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39805 expref: 24481 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.690893:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690899:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.690900:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff880096d87000) 00010000:00010000:1.0:1713481296.690902:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.690903:0:16580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.690903:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.690903:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.690905:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3b7180/0xdfc0fb148a38be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f7c expref: 24480 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.690906:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.690909:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.690910:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3b7180/0xdfc0fb148a38be3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f7c expref: 24480 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.690914:0:16580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.690921:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3b7180/0xdfc0fb148a38be3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f7c expref: 24480 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.690923:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098df9f80/0xdfc0fb148a398cb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.690927:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f941180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784485120:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.690928:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098df9f80/0xdfc0fb148a398cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.690930:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.690931:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098df9f80/0xdfc0fb148a398cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.690937:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b98900 going to sleep for 11 seconds 00000004:00010000:2.0:1713481296.690941:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098df9f80/0xdfc0fb148a398cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.690944:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:1960:x1796714882435904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (132us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.690946:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.690949:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820164 00010000:00010000:2.0:1713481296.690949:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.690950:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.690952:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.690954:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.690955:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690958:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800933faf40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.690960:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690963:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690967:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.690968:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.690970:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.690971:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.690972:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800933faf40/0xdfc0fb148a398bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.690975:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.690979:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.690984:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.690986:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.690986:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f943b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784485184:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.690986:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690990:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690992:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800933f8240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.690995:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.690998:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.691001:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff88009cd56400) 00010000:00010000:2.0:1713481296.691002:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.691003:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.691006:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.691006:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800933f8240/0xdfc0fb148a398c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.691022:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084b660c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.691033:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800933fb600/0xdfc0fb148a398b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b45 expref: 2795 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.691038:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784485184 00000100:00100000:1.0:1713481296.691041:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784485184 00010000:00010000:2.0:1713481296.691043:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098df9f80/0xdfc0fb148a398cb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b45 expref: 2794 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.691046:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff880131402e00) 00010000:00010000:2.0:1713481296.691048:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.691049:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098df9f80, rc 0) 00000100:00100000:2.0:1713481296.691059:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436160 00000100:00100000:2.0:1713481296.691061:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436160 00000100:00100000:0.0:1713481296.691068:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.691073:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436352 00000100:00100000:2.0:1713481296.691075:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436352 00000100:00100000:1.0:1713481296.691076:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82884 00000100:00100000:1.0:1713481296.691081:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784485184:12345-0@lo:101:mdt_io00_009.0 00000100:00100000:2.0:1713481296.691083:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562650 00000100:00100000:2.0:1713481296.691085:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16703:1960:x1796714882436160:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.691089:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.691089:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.691093:0:6936:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.691095:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098dfaac0/0xdfc0fb148a398d9 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b30 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.691102:0:6936:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123670d80/0xdfc0fb148a398e0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a398d2 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.691103:0:16537:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436416 00002000:00010000:2.0:1713481296.691103:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9733:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.691105:0:16537:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436416 00010000:00010000:2.0:1713481296.691108:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.691109:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.691111:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098dfaac0/0xdfc0fb148a398d9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b30 expref: 16704 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.691112:0:6936:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123670d80/0xdfc0fb148a398e0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a398d2 expref: 13 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.691117:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098dfaac0/0xdfc0fb148a398d9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b30 expref: 16704 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.691118:0:6936:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880123670d80/0xdfc0fb148a398e0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a398d2 expref: 13 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.691137:0:16537:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562651 00010000:00010000:1.0:1713481296.691138:0:6936:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88007da00600) 00010000:00010000:1.0:1713481296.691139:0:6936:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1713481296.691141:0:6936:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123670d80, rc 0) 00000100:00100000:0.0:1713481296.691142:0:16537:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16704:1960:x1796714882436352:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.691146:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098dfaac0, rc 0) 00010000:00010000:0.0:1713481296.691149:0:16537:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.691157:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16704:1960:x1796714882436160:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (172us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.691158:0:16537:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a925680/0xdfc0fb148a398e7 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b3e expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.691160:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562650 00000100:00100000:1.0:1713481296.691163:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:15514:x1796714784485184:12345-0@lo:101:mdt_io00_009.0 Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.691166:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82884 00002000:00010000:0.0:1713481296.691169:0:16537:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9734:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.691173:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562652 00000100:00100000:2.0:1713481296.691175:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26807:1960:x1796714882436416:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.691176:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.691177:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.691179:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.691184:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098dfad00/0xdfc0fb148a398ee lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b4c expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.691191:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f943b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784485184:0@lo:101:mdt_io00_009.0 00002000:00010000:2.0:1713481296.691191:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf50:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.691196:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.691197:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.691199:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098dfad00/0xdfc0fb148a398ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b4c expref: 26808 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.691202:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.691205:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098dfad00/0xdfc0fb148a398ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b4c expref: 26808 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.691207:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.691209:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098dfad00, rc 0) 00000100:00100000:2.0:1713481296.691215:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:1960:x1796714882436416:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.691219:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562652 00000004:00080000:1.0:1713481296.691220:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000404:0x3899:0x0] 00010000:00010000:1.0:1713481296.691229:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.691233:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.691233:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18867:x1796714882436288:12345-192.168.202.24@tcp:101:touch.0 Request processed in 399us (517us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.691236:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.691237:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485775 00000100:00100000:1.0:1713481296.691260:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f943b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784485248:0@lo:1000:mdt_io00_009.0 00010000:00010000:0.0:1713481296.691266:0:16537:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a925680/0xdfc0fb148a398e7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b3e expref: 16704 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.691275:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.691277:0:16537:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007a925680/0xdfc0fb148a398e7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b3e expref: 16704 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.691283:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084b66a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.691285:0:16537:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a925680, rc 0) 00000100:00100000:1.0:1713481296.691292:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784485248 00000100:00100000:1.0:1713481296.691294:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784485248 00000100:00100000:0.0:1713481296.691299:0:16537:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16704:1960:x1796714882436352:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 157us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.691305:0:16537:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562651 00000100:00100000:1.0:1713481296.691305:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82885 00000100:00100000:1.0:1713481296.691308:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:15514:x1796714784485248:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.691344:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.691348:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:15514:x1796714784485248:12345-0@lo:1000:mdt_io00_009.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.691351:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82885 00000100:00100000:0.0:1713481296.691357:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436544 00000100:00100000:0.0:1713481296.691359:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436544 00000100:00100000:1.0:1713481296.691371:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f943b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784485248:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.691372:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562653 00000100:00100000:0.0:1713481296.691376:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:1960:x1796714882436544:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.691384:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.691392:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a924240/0xdfc0fb148a398fc lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b5a expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.691401:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf51:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.691407:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.691409:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.691412:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a924240/0xdfc0fb148a398fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b5a expref: 26809 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.691420:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a924240/0xdfc0fb148a398fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b5a expref: 26809 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.691426:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a924240, rc 0) 00000100:00100000:0.0:1713481296.691436:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26809:1960:x1796714882436544:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 59us (93us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.691439:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.691440:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562653 00010000:00010000:1.0:1713481296.691443:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691447:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691449:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800941b4d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.691451:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691454:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691459:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x349a:0x0].0x0 (ffff88009cf9a900) 00010000:00010000:1.0:1713481296.691460:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.691462:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691465:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a398f5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x349a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691484:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691487:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.691488:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.691490:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691492:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007da92d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.691493:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.691497:0:16537:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436672 00000100:00100000:0.0:1713481296.691499:0:16537:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436672 00010000:00010000:1.0:1713481296.691499:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691503:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff880096d87000) 00010000:00010000:1.0:1713481296.691504:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.691505:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691508:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007da92d00/0xdfc0fb148a38bdc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.691509:0:16537:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562654 00000100:00100000:0.0:1713481296.691513:0:16537:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26809:1960:x1796714882436672:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.691517:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784482304:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.691518:0:16537:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.691525:0:16537:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a926ac0/0xdfc0fb148a39903 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b68 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.691525:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000404:0x3899:0x0] 00010000:00010000:1.0:1713481296.691528:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.691533:0:16537:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf52:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.691533:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.691538:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.691540:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.691541:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.691544:0:16537:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a926ac0/0xdfc0fb148a39903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b68 expref: 26810 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.691551:0:16537:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a926ac0/0xdfc0fb148a39903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b68 expref: 26810 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.691551:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713481296.691556:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880089419b00/0xdfc0fb148a38bf8 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f83 expref: 26810 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.691558:0:16537:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a926ac0, rc 0) 00010000:00010000:1.0:1713481296.691558:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007da933c0/0xdfc0fb148a38bd5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691563:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007da933c0/0xdfc0fb148a38bd5 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.691566:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880089419b00, rc 0) 00010000:00010000:1.0:1713481296.691568:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007da933c0/0xdfc0fb148a38bd5 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.691569:0:16537:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26810:1960:x1796714882436672:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 55us (81us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.691572:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007da933c0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.691573:0:16537:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562654 00010000:00010000:1.0:1713481296.691575:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007da933c0/0xdfc0fb148a38bd5 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691579:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007da933c0/0xdfc0fb148a38bd5 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.691582:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26810:18817:x1796714882407296:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 39167us (39246us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.691587:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff880097816200) 00000100:00100000:2.0:1713481296.691587:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562210 00010000:00010000:1.0:1713481296.691589:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.691592:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007da933c0/0xdfc0fb148a38bd5 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691596:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007da933c0/0xdfc0fb148a38bd5 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.691612:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713481296.691617:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.691619:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.691624:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120be3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784482496:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.691625:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.691627:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095fd4b40 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.691629:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.691630:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.691634:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000004:00010000:2.0:1713481296.691636:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.691638:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092b018c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.691641:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691645:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691652:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.691654:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.691654:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.691657:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.691659:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.691661:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092b018c0/0xdfc0fb148a38bc0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.691680:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 1/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.691684:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095fd4b40/0xdfc0fb148a398d2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a398e0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.691694:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880092b02880/0xdfc0fb148a38bce lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691699:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092b02880/0xdfc0fb148a38bce lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691704:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880092b02880/0xdfc0fb148a38bce lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.691704:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.691705:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.691706:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.691708:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092b02880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.691711:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.691711:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092b02880/0xdfc0fb148a38bce lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.691713:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784485312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.691716:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880092b02880/0xdfc0fb148a38bce lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.691723:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff88011d025d00) 00000100:00100000:0.0:1713481296.691724:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4018c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20859:1960:x1796714882407104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 38686us (38738us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.691725:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.691728:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880092b02880/0xdfc0fb148a38bce lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.691730:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820149 00000100:00100000:2.0:1713481296.691730:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.691732:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092b02880/0xdfc0fb148a38bce lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713481296.691774:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2012:18879:x1796714882406400:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 39792us (39835us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.691779:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26099 00000100:00100000:0.0:1713481296.691837:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784485312 00000100:00100000:0.0:1713481296.691840:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784485312 00000100:00100000:1.0:1713481296.691851:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.691856:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98347 00000100:00100000:0.0:1713481296.691859:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800796de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0001-mdtlov_UUID+13:3490:x1796714784485312:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.691864:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436480 00010000:00010000:0.0:1713481296.691866:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.691866:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436480 00010000:00010000:0.0:1713481296.691874:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123670d80/0xdfc0fb148a398e0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a398d2 expref: 13 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.691875:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562655 00000100:00100000:1.0:1713481296.691878:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16704:1960:x1796714882436480:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.691883:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.691891:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941b61c0/0xdfc0fb148a3990a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b53 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.691898:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9735:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.691904:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.691905:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.691907:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941b61c0/0xdfc0fb148a3990a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b53 expref: 16705 pid: 16528 timeout: 0 lvb_type: 1 00000001:00080000:3.0:1713481296.691910:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040755 00010000:00010000:1.0:1713481296.691914:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941b61c0/0xdfc0fb148a3990a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b53 expref: 16705 pid: 16528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.691918:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941b61c0, rc 0) 00000100:00100000:1.0:1713481296.691926:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16705:1960:x1796714882436480:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (76us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.691928:0:16582:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88007da00600) 00000100:00100000:1.0:1713481296.691930:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562655 00010000:00010000:0.0:1713481296.691931:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.691955:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800796de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0001-mdtlov_UUID+12:3490:x1796714784485312:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.691959:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98347 00000100:00100000:1.0:1713481296.691965:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.691968:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784485312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.691976:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436608 00000100:00100000:1.0:1713481296.691977:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436608 00002000:00080000:3.0:1713481296.691981:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56146 00000100:00100000:0.0:1713481296.691984:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.691985:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562656 00000100:00100000:1.0:1713481296.691988:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16705:1960:x1796714882436608:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.691992:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.691993:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436736 00000100:00100000:0.0:1713481296.691995:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436736 00010000:00010000:1.0:1713481296.691998:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941b7180/0xdfc0fb148a39911 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b61 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692001:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f998480/0xdfc0fb1489cf576 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2206d expref: 24481 pid: 16505 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1713481296.692006:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9736:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.692010:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820166 00010000:00010000:1.0:1713481296.692011:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.692012:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.692013:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1960:x1796714882436736:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.692015:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941b7180/0xdfc0fb148a39911 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b61 expref: 16706 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.692017:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.692020:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f998480/0xdfc0fb1489cf576 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2206d expref: 24481 pid: 16505 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.692021:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941b7180/0xdfc0fb148a39911 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b61 expref: 16706 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.692025:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f998480/0xdfc0fb1489cf576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2206d expref: 24481 pid: 16505 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.692025:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941b7180, rc 0) 00000100:00100000:1.0:1713481296.692033:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16706:1960:x1796714882436608:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.692036:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562656 00010000:00010000:0.0:1713481296.692038:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f998480/0xdfc0fb1489cf576 lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2206d expref: 24481 pid: 16505 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.692044:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692045:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692047:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880089419b00/0xdfc0fb148a38bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f83 expref: 26808 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692052:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880089419b00/0xdfc0fb148a38bf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f83 expref: 26808 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692064:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880089419b00/0xdfc0fb148a38bf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f83 expref: 26808 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692070:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077015880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16580:1796714784485376:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.692080:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.692086:0:15498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076afd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15498:1796714784482560:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.692106:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.692108:0:15498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692114:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.692137:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436928 00000100:00100000:2.0:1713481296.692138:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436864 00000100:00100000:0.0:1713481296.692139:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436928 00000100:00100000:2.0:1713481296.692141:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436864 00000100:00100000:1.0:1713481296.692142:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800786d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784482624:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.692146:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f80240/0xdfc0fb148688a7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28cb expref: 26809 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.692155:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485776 00010000:00010000:1.0:1713481296.692156:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.692158:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820167 00000100:00100000:2.0:1713481296.692158:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:18729:x1796714882436864:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.692162:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077015180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26809:1960:x1796714882436928:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.692166:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120be1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16705:1960:x1796714882406912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 38917us (38948us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.692169:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.692170:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820151 00010000:00010000:0.0:1713481296.692173:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f80240/0xdfc0fb148688a7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28cb expref: 26809 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.692180:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f80240/0xdfc0fb148688a7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28cb expref: 26809 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.692180:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713481296.692188:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092929200/0xdfc0fb148a38338 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x348e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c57 expref: 2368 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692196:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f80240/0xdfc0fb148688a7d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28cb expref: 26809 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.692204:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120518900/0xdfc0fb148a0fb4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x348e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa365a0 expref: 2367 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692214:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692215:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.692215:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x348e:0x0].0x0 (ffff88012ce8da00) 00010000:00010000:0.0:1713481296.692218:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.692218:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.692226:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.692226:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.692228:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882435840 00000100:00100000:1.0:1713481296.692229:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882435840 00010000:00010000:2.0:1713481296.692235:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.692237:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800833486c0/0xdfc0fb1488021a8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96279a expref: 20859 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.692240:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.692243:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.692246:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820168 00010000:00010000:2.0:1713481296.692246:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713481296.692249:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20859:1959:x1796714882435840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.692253:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.692255:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077015180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:1960:x1796714882436928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (139us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.692255:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c2773c0/0xdfc0fb148a3991f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x347f:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.692256:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800833486c0/0xdfc0fb1488021a8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96279a expref: 20859 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.692261:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820167 00010000:00010000:1.0:1713481296.692261:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800833486c0/0xdfc0fb1488021a8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96279a expref: 20859 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.692261:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c2773c0/0xdfc0fb148a3991f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.692266:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c2773c0/0xdfc0fb148a3991f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713481296.692272:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800833486c0/0xdfc0fb1488021a8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96279a expref: 20859 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.692279:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.692280:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.692282:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692286:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692303:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.692308:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.692313:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:1959:x1796714882435840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (95us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.692316:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.692319:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820168 00010000:00010000:2.0:1713481296.692327:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.692333:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692339:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784482816:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.692340:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.692346:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079a40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784482688:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.692346:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c3b5f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.692349:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.692355:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079a43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784482752:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.692355:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692369:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012024cb40/0xdfc0fb148a38c68 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f91 expref: 24480 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.692371:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.692377:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3b5f80/0xdfc0fb148a38bc7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692379:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012024cb40, rc 0) 00010000:00010000:1.0:1713481296.692384:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086938d80/0xdfc0fb148a38c5a lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f8a expref: 24480 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692392:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:10479:x1796714882407552:12345-192.168.202.24@tcp:101:dd.0 Request processed in 38679us (38746us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.692394:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086938d80, rc 0) 00000100:00100000:0.0:1713481296.692397:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562213 00000100:00100000:1.0:1713481296.692409:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:10409:x1796714882407360:12345-192.168.202.24@tcp:101:dd.0 Request processed in 38898us (38923us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.692415:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562212 00010000:00010000:1.0:1713481296.692441:0:15498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692443:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.692448:0:15498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692455:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.692456:0:15498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692462:0:15498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692466:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.692468:0:15498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692478:0:15498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008693a880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.692480:0:15498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692484:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.692486:0:15498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692495:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437056 00000100:00100000:0.0:1713481296.692498:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437056 00010000:00010000:1.0:1713481296.692499:0:15498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692506:0:15498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a38c37 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692507:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb14893ab75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3d2 expref: 26808 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.692508:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+98:3490:x1796714784482048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 40449us (40510us total) trans 4296040758 rc 0/0 00000100:00100000:2.0:1713481296.692515:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562208 00000100:00100000:0.0:1713481296.692516:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437120 00000100:00100000:0.0:1713481296.692518:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437120 00010000:00010000:0.0:1713481296.692523:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dd17a80/0xdfc0fb148916d6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6553 expref: 24479 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.692530:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882436992 00000100:00100000:0.0:1713481296.692531:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882436992 00000100:00100000:2.0:1713481296.692533:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437248 00010000:00010000:0.0:1713481296.692536:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081d69200/0xdfc0fb14891d430 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d7 expref: 24480 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.692536:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437248 00000100:00100000:0.0:1713481296.692544:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820169 00000100:00100000:0.0:1713481296.692547:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:1958:x1796714882437056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.692552:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.692552:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562657 00010000:00010000:0.0:1713481296.692555:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb14893ab75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3d2 expref: 26808 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.692557:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16705:8499:x1796714882437248:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.692563:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb14893ab75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3d2 expref: 26808 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.692563:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.692571:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c276400/0xdfc0fb148a39926 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b6f expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692575:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb14893ab75 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3d2 expref: 26808 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.692584:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dab8000/0xdfc0fb1488e7e45 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54df expref: 16706 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.692590:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.692590:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.692591:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.692594:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c276400/0xdfc0fb148a39926 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b6f expref: 16706 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692602:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26807:1958:x1796714882437056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (158us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.692607:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dab8000/0xdfc0fb1488e7e45 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54df expref: 16706 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.692608:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820169 00010000:00010000:2.0:1713481296.692614:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dab8000/0xdfc0fb1488e7e45 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54df expref: 16706 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.692622:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784485440:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.692625:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820170 00000100:00100000:0.0:1713481296.692629:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1960:x1796714882437120:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.692635:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.692635:0:15498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f99a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+2712:3491:x1796714784482432:12345-0@lo:6:osp-syn-1-1.0 Request processed in 39551us (39601us total) trans 4295960651 rc 0/0 00000100:00100000:2.0:1713481296.692637:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.692639:0:15498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562211 00010000:00010000:0.0:1713481296.692645:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dd17a80/0xdfc0fb148916d6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6553 expref: 24480 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.692653:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dd17a80/0xdfc0fb148916d6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6553 expref: 24480 pid: 9203 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.692660:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f998a80/2, rc 0, transno 993355 00010000:00010000:0.0:1713481296.692677:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dd17a80/0xdfc0fb148916d6e lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6553 expref: 24480 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.692680:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079a41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784483328:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.692682:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784482432:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.692688:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692689:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692692:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012024cb40/0xdfc0fb148a38c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f91 expref: 24479 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692698:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012024cb40/0xdfc0fb148a38c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f91 expref: 24479 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692705:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692713:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012024cb40/0xdfc0fb148a38c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f91 expref: 24479 pid: 16541 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.692718:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009faa4700/2, rc 0, transno 1073462 00000100:00100000:0.0:1713481296.692720:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007727c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784485568:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.692720:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820171 00000100:00100000:2.0:1713481296.692723:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784482048:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.692724:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077016680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882436992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.692726:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713481296.692729:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.692731:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784485504:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.692732:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880081d69200/0xdfc0fb14891d430 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d7 expref: 24479 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.692734:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.692737:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880081d69200/0xdfc0fb14891d430 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d7 expref: 24479 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.692745:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.692749:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081d69200/0xdfc0fb14891d430 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6d7 expref: 24479 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.692754:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784485504 00000100:00100000:0.0:1713481296.692756:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784485504 00010000:00010000:1.0:1713481296.692758:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.692759:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.692761:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880086938d80/0xdfc0fb148a38c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f8a expref: 24478 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692766:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086938d80/0xdfc0fb148a38c5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f8a expref: 24478 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692768:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562658 00000100:00100000:0.0:1713481296.692771:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2712:3490:x1796714784485504:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.692771:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784483008:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.692777:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880086938d80/0xdfc0fb148a38c5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f8a expref: 24478 pid: 16488 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.692780:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43268 count 1 00000100:00100000:1.0:1713481296.692782:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800786d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784485632:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.692788:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.692793:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091cedc00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.692793:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692795:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880078280240/0xdfc0fb148688aed lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d293b expref: 26806 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.692799:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692800:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692801:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692810:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880078280240/0xdfc0fb148688aed lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d293b expref: 26806 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.692815:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880078280240/0xdfc0fb148688aed lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d293b expref: 26806 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.692820:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007727ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784485696:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.692827:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713481296.692831:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.692832:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784485760:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.692834:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.692845:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437184 00000100:00100000:2.0:1713481296.692846:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.692847:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437184 00000100:00100000:0.0:1713481296.692852:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784485760 00000100:00100000:0.0:1713481296.692854:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784485760 00010000:00010000:1.0:1713481296.692855:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086cd6ac0/0xdfc0fb1488021af lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627a8 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.692863:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.692864:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562659 00000100:00100000:1.0:1713481296.692866:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820172 00000100:00100000:0.0:1713481296.692867:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+98:3493:x1796714784485760:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.692868:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713481296.692869:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:1960:x1796714882437184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.692872:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00002000:00080000:0.0:1713481296.692873:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9918 count 1 00010000:00010000:1.0:1713481296.692873:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.692875:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086cd6ac0/0xdfc0fb1488021af lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627a8 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.692879:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692880:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086cd6ac0/0xdfc0fb1488021af lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627a8 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.692886:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008334ba80/0xdfc0fb1488021e0 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96280a expref: 20858 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.692889:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086cd6ac0/0xdfc0fb1488021af lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627a8 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.692890:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692891:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692892:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.692899:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.692900:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.692901:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008334ba80/0xdfc0fb1488021e0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96280a expref: 20857 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.692901:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.692906:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008334ba80/0xdfc0fb1488021e0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96280a expref: 20857 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.692906:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.692911:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007727f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784485824:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.692916:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.692919:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.692925:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20857:1960:x1796714882437184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.692928:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820172 00000100:00100000:0.0:1713481296.692941:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.692978:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784483392:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.692995:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693004:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784483456:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.693008:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437376 00000100:00100000:2.0:1713481296.693010:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437376 00000100:00100000:1.0:1713481296.693014:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.693021:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.693025:0:15498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437632 00000100:00100000:1.0:1713481296.693027:0:15498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437632 00000100:00100000:2.0:1713481296.693032:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485777 00000100:00100000:1.0:1713481296.693037:0:15498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562660 00000100:00100000:1.0:1713481296.693040:0:15498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16707:17009:x1796714882437632:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.693042:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2012:18678:x1796714882437376:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1713481296.693045:0:15498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.693051:0:15498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b811d40/0xdfc0fb148a39942 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b76 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693056:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.693059:0:15498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.693061:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1713481296.693066:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.693067:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.693069:0:15498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b811d40/0xdfc0fb148a39942 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b76 expref: 16708 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693073:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.693073:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929da640/0xdfc0fb148a389eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47e3a expref: 2012 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693075:0:15498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b811d40/0xdfc0fb148a39942 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b76 expref: 16708 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693080:0:15498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b811d40, rc 0) 00000100:00100000:0.0:1713481296.693086:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437440 00000100:00100000:1.0:1713481296.693088:0:15498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16708:17009:x1796714882437632:12345-192.168.202.24@tcp:101:dd.0 Request processed in 48us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.693089:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437440 00000100:00100000:1.0:1713481296.693092:0:15498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562660 00010000:00010000:2.0:1713481296.693095:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099f20fc0/0xdfc0fb148a383b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3463:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c88 expref: 2011 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693100:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008334bcc0/0xdfc0fb1488021b6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627c4 expref: 20857 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.693106:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437568 00000100:00100000:1.0:1713481296.693108:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437568 00010000:00010000:2.0:1713481296.693109:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:1.0:1713481296.693113:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801347c5440/0xdfc0fb1488021c4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627d2 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.693118:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081cc9b00/0xdfc0fb148a34955 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45be2 expref: 2010 pid: 6932 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693136:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820173 00000100:00100000:0.0:1713481296.693142:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:1958:x1796714882437440:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.693145:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820174 00000100:00100000:1.0:1713481296.693148:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:1958:x1796714882437568:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.693150:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.693152:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.693154:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008334bcc0/0xdfc0fb1488021b6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627c4 expref: 20858 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.693154:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801347c5440/0xdfc0fb1488021c4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627d2 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.693160:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801347c5440/0xdfc0fb1488021c4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627d2 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.693163:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008334bcc0/0xdfc0fb1488021b6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627c4 expref: 20858 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.693166:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x0 (ffff88007ab6ad00) 00010000:00010000:1.0:1713481296.693171:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801347c5440/0xdfc0fb1488021c4 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627d2 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.693180:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693181:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008334bcc0/0xdfc0fb1488021b6 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627c4 expref: 20857 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.693181:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.693182:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.693183:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693187:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693192:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693194:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.693194:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.693196:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693197:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.693199:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.693203:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693203:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.693205:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20856:1958:x1796714882437568:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.693208:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820174 00010000:00010000:2.0:1713481296.693209:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133007180/0xdfc0fb148a39950 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1cd:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.693212:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133007180/0xdfc0fb148a39950 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.693215:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133007180/0xdfc0fb148a39950 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.693219:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.693222:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693227:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693232:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20855:1958:x1796714882437440:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 90us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.693233:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693239:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820173 00010000:00010000:2.0:1713481296.693241:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.693243:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693249:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693249:0:15642:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9261c0/0xdfc0fb1489f728b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2d7 expref: 2366 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693253:0:15642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.693254:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099c59b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.693257:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693264:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693266:0:15642:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9261c0/0xdfc0fb1489f728b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2d7 expref: 2366 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693267:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693273:0:15642:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9261c0/0xdfc0fb1489f728b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2d7 expref: 2366 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.693274:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693278:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693281:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.693282:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076afdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15642:1796714784485888:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.693283:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c59b00/0xdfc0fb148a38c92 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693287:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693293:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.693297:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.693299:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012024db00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.693302:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693308:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693316:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693323:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693326:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693330:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693332:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012024db00/0xdfc0fb148a38c99 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693336:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693342:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693348:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008219dd40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.693351:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693357:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693373:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693379:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008219dd40/0xdfc0fb148a38c7d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.693436:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+100:3490:x1796714784483200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 38881us (39071us total) trans 4296040759 rc 0/0 00000004:00080000:2.0:1713481296.693441:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ddc6300/2, rc 0, transno 1073463 00000100:00100000:1.0:1713481296.693442:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562218 00000100:00100000:2.0:1713481296.693448:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ddc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784483200:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.693510:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+100:3491:x1796714784483264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 38944us (39079us total) trans 4296040760 rc 0/0 00000100:00100000:0.0:1713481296.693516:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562219 00000100:00100000:2.0:1713481296.693522:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784485952:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.693538:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713481296.693551:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083a3df80/2, rc 0, transno 1073464 00000100:00100000:0.0:1713481296.693556:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784483264:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.693566:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784485952 00000100:00100000:0.0:1713481296.693569:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784485952 00000100:00100000:2.0:1713481296.693583:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784486016:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.693588:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562661 00000100:00100000:0.0:1713481296.693592:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+100:3493:x1796714784485952:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.693603:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9919 count 1 00000100:00100000:2.0:1713481296.693610:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.693611:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.693619:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0d8c0/0xdfc0fb1488021e7 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962818 expref: 20854 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.693623:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693623:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693625:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.693627:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+100:3493:x1796714784482880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 39604us (39743us total) trans 4296040761 rc 0/0 00000100:00100000:3.0:1713481296.693636:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562215 00010000:00010000:0.0:1713481296.693639:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0d8c0/0xdfc0fb1488021e7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962818 expref: 20854 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.693644:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0d8c0/0xdfc0fb1488021e7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962818 expref: 20854 pid: 16538 timeout: 815 lvb_type: 1 00000040:00080000:2.0:1713481296.693646:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3430, 64 off227712 00000100:00100000:0.0:1713481296.693650:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784486080:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.693660:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.693661:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784486016 00000100:00100000:1.0:1713481296.693678:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784486016 00000100:00100000:0.0:1713481296.693691:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.693694:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.693699:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562662 00010000:00010000:2.0:1713481296.693702:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713481296.693703:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+100:3490:x1796714784486016:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.693705:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437504 00000100:00100000:0.0:1713481296.693707:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437504 00010000:00010000:2.0:1713481296.693707:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT1 00000004:00080000:3.0:1713481296.693709:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800796ddc00/2, rc 0, transno 1073465 00010000:00010000:2.0:1713481296.693713:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT1 00002000:00080000:1.0:1713481296.693714:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9920 count 1 00010000:00010000:0.0:1713481296.693716:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090432d00/0xdfc0fb1488021bd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627b6 expref: 20855 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.693717:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT1 00000100:00100000:3.0:1713481296.693719:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800796ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784482880:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.693722:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713481296.693724:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693727:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.693728:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820175 00010000:00010000:2.0:1713481296.693731:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c43600 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.693732:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20855:1958:x1796714882437504:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.693733:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713481296.693735:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff0c480/0xdfc0fb1488021ee lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962826 expref: 20855 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.693737:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.693738:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.693741:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090432d00/0xdfc0fb1488021bd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627b6 expref: 20855 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.693741:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.693741:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x348e:0x0].0x0 (ffff88009f9c3e00) 00010000:00010000:1.0:1713481296.693742:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.693743:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1713481296.693744:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693744:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.693747:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a39965 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x348e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.693749:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090432d00/0xdfc0fb1488021bd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627b6 expref: 20855 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.693761:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ff0c480/0xdfc0fb1488021ee lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962826 expref: 20855 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.693763:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090432d00/0xdfc0fb1488021bd lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627b6 expref: 20855 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.693764:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.693767:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:1.0:1713481296.693769:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ff0c480/0xdfc0fb1488021ee lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962826 expref: 20855 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.693770:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.693773:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c275440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.693774:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.693776:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693777:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.693777:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00000100:00100000:1.0:1713481296.693779:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e113100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784486144:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.693780:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693781:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x348e:0x0].0x0 (ffff88009f9c3e00) 00010000:00010000:2.0:1713481296.693782:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.693783:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.693785:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a39934 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x348e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.693787:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.693794:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121ef0300 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.693809:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.693811:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693815:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693819:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693821:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20854:1958:x1796714882437504:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 88us (129us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.693822:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693826:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693827:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820175 00000100:00100000:1.0:1713481296.693829:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.693833:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008219df80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.693834:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693838:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.693847:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.693848:0:15498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437696 00000100:00100000:1.0:1713481296.693851:0:15498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437696 00010000:00010000:2.0:1713481296.693851:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008219df80/0xdfc0fb148a38c8b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693857:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.693871:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.693871:0:15498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562663 00000100:00100000:1.0:1713481296.693875:0:15498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:14753:x1796714882437696:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.693880:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437888 00010000:00010000:1.0:1713481296.693882:0:15498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.693883:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437888 00010000:00010000:1.0:1713481296.693891:0:15498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b812d00/0xdfc0fb148a39973 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b7d expref: -99 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.693894:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562664 00000100:00100000:0.0:1713481296.693898:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26807:1959:x1796714882437888:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.693905:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.693906:0:15498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dab5f80/0xdfc0fb148a13d58 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f62 expref: 24480 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.693912:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693913:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800836b33c0/0xdfc0fb148a3997a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b92 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.693913:0:15498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.693916:0:15498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b812d00/0xdfc0fb148a39973 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b7d expref: 24480 pid: 15498 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.693921:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf53:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.693927:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693928:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.693931:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800836b33c0/0xdfc0fb148a3997a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b92 expref: 26808 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.693933:0:15498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dab5f80/0xdfc0fb148a13d58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f62 expref: 24480 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.693937:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800836b33c0/0xdfc0fb148a3997a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b92 expref: 26808 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.693941:0:15498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dab5f80/0xdfc0fb148a13d58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f62 expref: 24480 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.693942:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800836b33c0, rc 0) 00000100:00100000:0.0:1713481296.693950:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:1959:x1796714882437888:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.693950:0:15498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e0b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15498:1796714784486208:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.693954:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562664 00000100:00100000:3.0:1713481296.693956:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437760 00000100:00100000:3.0:1713481296.693961:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437760 00000100:00100000:1.0:1713481296.693965:0:15498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.693976:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.693998:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.694005:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438016 00000100:00100000:2.0:1713481296.694006:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ddc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+101:3493:x1796714784483136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 39455us (39712us total) trans 4296040762 rc 0/0 00000100:00100000:0.0:1713481296.694007:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438016 00000100:00100000:1.0:1713481296.694007:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485778 00000100:00100000:1.0:1713481296.694012:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:18869:x1796714882437760:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.694013:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562217 00000100:00100000:0.0:1713481296.694015:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438144 00000100:00100000:0.0:1713481296.694016:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438144 00000004:00080000:3.0:1713481296.694018:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ddc7100/2, rc 0, transno 1073466 00010000:00010000:1.0:1713481296.694022:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.694023:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ddc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784483136:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.694028:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562665 00010000:00010000:1.0:1713481296.694030:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009b810240/0xdfc0fb148a39981 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b8b expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.694032:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26809:1959:x1796714882438016:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.694038:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.694047:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800836b1440/0xdfc0fb148a39988 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ba0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.694058:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf54:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.694067:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694068:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694072:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800836b1440/0xdfc0fb148a39988 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ba0 expref: 26810 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.694079:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.694080:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800836b1440/0xdfc0fb148a39988 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ba0 expref: 26810 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.694087:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.694088:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800836b1440, rc 0) 00010000:00010000:1.0:1713481296.694093:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694103:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.694109:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694114:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694173:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.694181:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694188:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.694200:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26810:1959:x1796714882438016:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.694206:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562665 00000004:00200000:1.0:1713481296.694208:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3474:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.694210:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713481296.694221:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562666 00000004:00010000:1.0:1713481296.694221:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.694224:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26809:1959:x1796714882438144:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.694227:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.694230:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.694232:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694237:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.694238:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800836b2400/0xdfc0fb148a399a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bae expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.694246:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf55:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.694246:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694250:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b8118c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.694253:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.694253:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.694254:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694258:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800836b2400/0xdfc0fb148a399a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bae expref: 26810 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.694258:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.694265:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800836b2400/0xdfc0fb148a399a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bae expref: 26810 pid: 16488 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.694265:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.694267:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.694270:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.694271:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800836b2400, rc 0) 00010000:00010000:1.0:1713481296.694274:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a3998f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.694282:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26810:1959:x1796714882438144:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.694286:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562666 00010000:00010000:1.0:1713481296.694288:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694293:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.694294:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784486272:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.694298:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694302:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800785706c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.694305:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694310:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.694313:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.694319:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880084275f00) 00010000:00010000:1.0:1713481296.694321:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.694324:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.694328:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800785706c0/0xdfc0fb148a39996 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.694340:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784486272 00010000:00010000:1.0:1713481296.694363:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009b810240/0xdfc0fb148a39981 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2370 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.694368:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784486336:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.694380:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2369 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.694385:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:1.0:1713481296.694388:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.694389:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880078570fc0, rc 0) 00000100:00100000:3.0:1713481296.694395:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.694400:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784486272 00000100:00100000:1.0:1713481296.694406:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18869:x1796714882437760:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 393us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.694412:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485778 00000100:00100000:0.0:1713481296.694420:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784486336 00000100:00100000:0.0:1713481296.694422:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784486336 00010000:00010000:2.0:1713481296.694434:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.694440:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.694443:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.694446:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562667 00010000:00010000:2.0:1713481296.694446:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00000100:00100000:0.0:1713481296.694450:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+102:3492:x1796714784486336:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.694450:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c277a80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.694451:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.694454:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.694459:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00002000:00080000:0.0:1713481296.694460:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9922 count 1 00010000:00010000:2.0:1713481296.694461:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.694462:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.694465:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a39918 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.694471:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.694473:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880077014380 reply state ffff88009cc68000 transno 4295107568 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c2773c0/0xdfc0fb148a3991f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT1 00010000:00010000:2.0:1713481296.694478:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c2773c0/0xdfc0fb148a3991f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT1 00010000:00010000:0.0:1713481296.694480:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff0f3c0/0xdfc0fb1488021fc lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962842 expref: 20853 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.694481:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x35 (ffff88009f9c3800) 00010000:00010000:2.0:1713481296.694482:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.694483:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.694485:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694486:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694488:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.694501:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ff0f3c0/0xdfc0fb1488021fc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962842 expref: 20853 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.694503:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18729:x1796714882436864:12345-192.168.202.24@tcp:36:rm.0 Request processed in 2344us (2396us total) trans 4295107568 rc 0/0 00000100:00100000:2.0:1713481296.694507:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485776 00010000:00010000:0.0:1713481296.694508:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ff0f3c0/0xdfc0fb1488021fc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962842 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.694516:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784486400:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.694530:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fc300 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.694552:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562668 00000100:00100000:0.0:1713481296.694556:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+102:3491:x1796714784486272:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.694564:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9921 count 1 00010000:00010000:0.0:1713481296.694573:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.694581:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0fa80/0xdfc0fb1488021f5 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962834 expref: 20853 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.694586:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694587:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694590:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.694601:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0fa80/0xdfc0fb1488021f5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962834 expref: 20853 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.694607:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0fa80/0xdfc0fb1488021f5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962834 expref: 20853 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.694615:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784486464:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.694630:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.694646:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.694655:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438272 00000100:00100000:2.0:1713481296.694657:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438272 00000100:00100000:2.0:1713481296.694684:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562669 00000100:00100000:2.0:1713481296.694687:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26810:1959:x1796714882438272:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.694693:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.694700:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088076d00/0xdfc0fb148a399b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bbc expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.694710:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf56:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.694715:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.694716:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694717:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694720:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088076d00/0xdfc0fb148a399b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bbc expref: 26811 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.694726:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088076d00/0xdfc0fb148a399b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bbc expref: 26811 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.694727:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438400 00000100:00100000:0.0:1713481296.694730:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438400 00010000:00010000:2.0:1713481296.694731:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088076d00, rc 0) 00000100:00100000:2.0:1713481296.694740:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:1959:x1796714882438272:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.694744:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562669 00000100:00100000:0.0:1713481296.694748:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562670 00000100:00100000:1.0:1713481296.694751:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.694752:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:1959:x1796714882438400:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.694757:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438528 00010000:00010000:0.0:1713481296.694759:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.694759:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438528 00010000:00010000:0.0:1713481296.694768:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800836b1f80/0xdfc0fb148a399c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bca expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.694768:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562671 00000100:00100000:2.0:1713481296.694770:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:1959:x1796714882438528:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.694774:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.694779:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085efa880/0xdfc0fb148a399c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bd8 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.694783:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf57:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.694785:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.694786:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf58:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.694790:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694791:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694792:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694793:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694795:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800836b1f80/0xdfc0fb148a399c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bca expref: 26814 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.694796:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085efa880/0xdfc0fb148a399c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bd8 expref: 26814 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.694801:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085efa880/0xdfc0fb148a399c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bd8 expref: 26814 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.694803:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800836b1f80/0xdfc0fb148a399c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bca expref: 26814 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.694806:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085efa880, rc 0) 00010000:00010000:0.0:1713481296.694809:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800836b1f80, rc 0) 00000100:00100000:2.0:1713481296.694814:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:1959:x1796714882438528:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.694817:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.694818:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562671 00000100:00100000:0.0:1713481296.694821:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:1959:x1796714882438400:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.694826:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562670 00000100:00100000:2.0:1713481296.694826:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438656 00000100:00100000:2.0:1713481296.694827:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438656 00000100:00100000:2.0:1713481296.694836:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562672 00000100:00100000:2.0:1713481296.694838:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:1959:x1796714882438656:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.694841:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.694847:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085ef9b00/0xdfc0fb148a399ce lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48be6 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.694848:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.694856:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf59:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.694862:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694863:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.694867:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438784 00010000:00010000:2.0:1713481296.694867:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085ef9b00/0xdfc0fb148a399ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48be6 expref: 26814 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.694869:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438784 00000100:00100000:1.0:1713481296.694875:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.694876:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085ef9b00/0xdfc0fb148a399ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48be6 expref: 26815 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.694880:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438912 00000100:00100000:0.0:1713481296.694882:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438912 00010000:00010000:2.0:1713481296.694883:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085ef9b00, rc 0) 00000100:00100000:1.0:1713481296.694891:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.694895:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562673 00000100:00100000:2.0:1713481296.694896:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26816:1959:x1796714882438656:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.694898:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26816:1959:x1796714882438784:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.694902:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562672 00010000:00010000:0.0:1713481296.694903:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.694908:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.694911:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9b86c0/0xdfc0fb148a399d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bf4 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.694918:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf5a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.694919:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439040 00000100:00100000:2.0:1713481296.694921:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439040 00010000:00010000:0.0:1713481296.694924:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.694925:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.694925:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439168 00010000:00010000:0.0:1713481296.694928:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9b86c0/0xdfc0fb148a399d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bf4 expref: 26817 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.694929:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439168 00010000:00010000:0.0:1713481296.694933:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9b86c0/0xdfc0fb148a399d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bf4 expref: 26818 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.694936:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562674 00010000:00010000:0.0:1713481296.694938:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9b86c0, rc 0) 00000100:00100000:2.0:1713481296.694940:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26818:1959:x1796714882438912:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.694947:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26818:1959:x1796714882438784:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (100us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.694948:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.694949:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562675 00000100:00100000:1.0:1713481296.694954:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26818:1959:x1796714882439040:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.694957:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085ef9440/0xdfc0fb148a399dc lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c02 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.694961:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.694967:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf5b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.694970:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880078572d00/0xdfc0fb148a399e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c10 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.694975:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694976:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694980:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085ef9440/0xdfc0fb148a399dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c02 expref: 26819 pid: 15509 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.694982:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf5c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.694989:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085ef9440/0xdfc0fb148a399dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c02 expref: 26820 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.694991:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.694993:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.694997:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085ef9440, rc 0) 00010000:00010000:1.0:1713481296.694998:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880078572d00/0xdfc0fb148a399e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c10 expref: 26820 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.695007:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880078572d00/0xdfc0fb148a399e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c10 expref: 26820 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.695010:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26820:1959:x1796714882438912:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.695015:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880078572d00, rc 0) 00000100:00100000:2.0:1713481296.695015:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562674 00000100:00100000:0.0:1713481296.695026:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562673 00000100:00100000:1.0:1713481296.695030:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26820:1959:x1796714882439040:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.695036:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562675 00000100:00100000:2.0:1713481296.695040:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562676 00000100:00100000:2.0:1713481296.695044:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26818:1959:x1796714882439168:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.695050:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.695059:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085ef8000/0xdfc0fb148a399ea lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c1e expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.695069:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf5d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.695077:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.695079:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.695082:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085ef8000/0xdfc0fb148a399ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c1e expref: 26818 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.695091:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085ef8000/0xdfc0fb148a399ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c1e expref: 26818 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.695098:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085ef8000, rc 0) 00000100:00100000:1.0:1713481296.695109:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.695112:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26818:1959:x1796714882439168:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.695117:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562676 00000100:00100000:1.0:1713481296.695145:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439296 00000100:00100000:1.0:1713481296.695149:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439296 00000100:00100000:0.0:1713481296.695151:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.695166:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439424 00000100:00100000:1.0:1713481296.695167:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439424 00000100:00100000:2.0:1713481296.695171:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562677 00000100:00100000:2.0:1713481296.695176:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26819:1959:x1796714882439296:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.695182:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.695188:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562678 00010000:00010000:2.0:1713481296.695191:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085ef86c0/0xdfc0fb148a399f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c2c expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.695193:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26819:1959:x1796714882439424:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.695201:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf5e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.695202:0:16529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.695206:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.695209:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.695211:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695213:0:16529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c176400/0xdfc0fb148a399f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c3a expref: -99 pid: 16529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.695215:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085ef86c0/0xdfc0fb148a399f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c2c expref: 26820 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.695220:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439680 00000100:00100000:0.0:1713481296.695223:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439680 00002000:00010000:1.0:1713481296.695224:0:16529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf5f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.695224:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085ef86c0/0xdfc0fb148a399f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c2c expref: 26820 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.695231:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085ef86c0, rc 0) 00010000:00010000:1.0:1713481296.695232:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695234:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695238:0:16529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c176400/0xdfc0fb148a399f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c3a expref: 26822 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.695239:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562679 00000100:00100000:0.0:1713481296.695243:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882439680:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.695244:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882439296:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.695247:0:16529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007c176400/0xdfc0fb148a399f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c3a expref: 26822 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.695249:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.695250:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562677 00010000:00010000:1.0:1713481296.695254:0:16529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c176400, rc 0) 00000100:00100000:1.0:1713481296.695267:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26821:1959:x1796714882439424:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 74us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.695272:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562678 00000100:00100000:2.0:1713481296.695284:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439552 00000100:00100000:2.0:1713481296.695288:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439552 00000100:00100000:2.0:1713481296.695315:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485779 00000100:00100000:2.0:1713481296.695320:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18934:x1796714882439552:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:2.0:1713481296.695346:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.695347:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9b9200/0xdfc0fb148a399ff lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c48 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.695353:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.695357:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008219f840/0xdfc0fb148a38c53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x522e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa481dd expref: 2794 pid: 15642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.695359:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf60:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.695367:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.695368:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.695369:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439808 00000100:00100000:1.0:1713481296.695371:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439808 00010000:00010000:2.0:1713481296.695371:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x522e:0x0].0x0 (ffff88007aaaf800) 00010000:00010000:0.0:1713481296.695372:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9b9200/0xdfc0fb148a399ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c48 expref: 26821 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.695381:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9b9200/0xdfc0fb148a399ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c48 expref: 26822 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.695383:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562680 00010000:00010000:2.0:1713481296.695383:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.695387:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882439808:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.695388:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9b9200, rc 0) 00010000:00010000:1.0:1713481296.695393:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.695400:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b586c0/0xdfc0fb148a39a06 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c56 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.695401:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882439680:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 157us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.695405:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562679 00002000:00010000:1.0:1713481296.695410:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf61:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.695418:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695420:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695424:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b586c0/0xdfc0fb148a39a06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c56 expref: 26822 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.695433:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b586c0/0xdfc0fb148a39a06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c56 expref: 26822 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.695433:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x522e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.695439:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b586c0, rc 0) 00010000:00010000:2.0:1713481296.695441:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.695448:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.695449:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882439808:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.695453:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562680 00000004:00010000:2.0:1713481296.695500:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88011e0ba300 reply state ffff88009cd64000 transno 4295105900 ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.695504:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.695507:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.695512:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x522e:0x0].0x0 (ffff8801314b1200) 00010000:00010000:2.0:1713481296.695514:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.695516:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.695518:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439936 00000100:00100000:0.0:1713481296.695521:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439936 00000100:00100000:1.0:1713481296.695524:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.695533:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440064 00000100:00100000:0.0:1713481296.695535:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440064 00000100:00100000:1.0:1713481296.695541:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562681 00000100:00100000:2.0:1713481296.695543:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18934:x1796714882439552:12345-192.168.202.24@tcp:36:touch.0 Request processed in 223us (758us total) trans 4295105900 rc 0/0 00000100:00100000:1.0:1713481296.695545:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26823:1959:x1796714882439936:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.695547:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485779 00000100:00100000:0.0:1713481296.695548:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562682 00000100:00100000:0.0:1713481296.695552:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26823:1959:x1796714882440064:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.695552:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.695557:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.695562:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b58480/0xdfc0fb148a39a14 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c64 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.695566:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9b8000/0xdfc0fb148a39a1b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c72 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.695573:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf62:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:0.0:1713481296.695577:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf63:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.695582:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695583:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.695585:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.695586:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695588:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b58480/0xdfc0fb148a39a14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c64 expref: 26825 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.695589:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9b8000/0xdfc0fb148a39a1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c72 expref: 26825 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.695595:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9b8000/0xdfc0fb148a39a1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c72 expref: 26825 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.695597:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b58480/0xdfc0fb148a39a14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c64 expref: 26825 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.695600:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9b8000, rc 0) 00010000:00010000:1.0:1713481296.695605:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b58480, rc 0) 00000100:00100000:0.0:1713481296.695610:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26825:1959:x1796714882440064:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.695614:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562682 00000100:00100000:1.0:1713481296.695619:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26825:1959:x1796714882439936:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.695626:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562681 00000100:00100000:0.0:1713481296.695735:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.695758:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440192 00000100:00100000:0.0:1713481296.695761:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.695762:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440192 00000100:00100000:0.0:1713481296.695773:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.695780:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440320 00000100:00100000:1.0:1713481296.695781:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440320 00000100:00100000:0.0:1713481296.695785:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440448 00000100:00100000:0.0:1713481296.695788:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440448 00000100:00100000:1.0:1713481296.695789:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562683 00000100:00100000:1.0:1713481296.695792:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26826:1959:x1796714882440192:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.695797:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.695803:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b59440/0xdfc0fb148a39a22 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c80 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.695807:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562684 00000100:00100000:0.0:1713481296.695811:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26826:1959:x1796714882440320:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.695811:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf64:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.695817:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.695817:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695818:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695820:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b59440/0xdfc0fb148a39a22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c80 expref: 26827 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.695825:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ff5b3c0/0xdfc0fb148a39a29 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c8e expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.695826:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b59440/0xdfc0fb148a39a22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c80 expref: 26827 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.695830:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b59440, rc 0) 00000100:00100000:2.0:1713481296.695830:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562685 00000100:00100000:2.0:1713481296.695834:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26827:1959:x1796714882440448:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.695835:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf65:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.695840:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1959:x1796714882440192:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (107us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.695841:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.695842:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.695843:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.695844:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562683 00010000:00010000:0.0:1713481296.695847:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff5b3c0/0xdfc0fb148a39a29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c8e expref: 26828 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.695852:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085efaac0/0xdfc0fb148a39a30 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c9c expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.695855:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007ff5b3c0/0xdfc0fb148a39a29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c8e expref: 26827 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.695861:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff5b3c0, rc 0) 00002000:00010000:2.0:1713481296.695862:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf66:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.695870:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.695872:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.695873:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1959:x1796714882440320:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.695875:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.695876:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085efaac0/0xdfc0fb148a39a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c9c expref: 26828 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.695878:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562684 00000100:00100000:1.0:1713481296.695886:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440576 00010000:00010000:2.0:1713481296.695886:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085efaac0/0xdfc0fb148a39a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c9c expref: 26828 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.695888:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440576 00000100:00100000:1.0:1713481296.695898:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562686 00010000:00010000:2.0:1713481296.695898:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085efaac0, rc 0) 00000100:00100000:1.0:1713481296.695901:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1959:x1796714882440576:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.695905:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.695911:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b59680/0xdfc0fb148a39a37 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48caa expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.695914:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1959:x1796714882440448:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 79us (139us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.695917:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf67:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.695919:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562685 00010000:00010000:1.0:1713481296.695922:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.695923:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.695923:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.695926:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b59680/0xdfc0fb148a39a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48caa expref: 26829 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.695934:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b59680/0xdfc0fb148a39a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48caa expref: 26828 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.695935:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440704 00000100:00100000:0.0:1713481296.695938:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440704 00010000:00010000:1.0:1713481296.695941:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b59680, rc 0) 00000100:00100000:0.0:1713481296.695952:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562687 00000100:00100000:1.0:1713481296.695954:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:1959:x1796714882440576:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.695955:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ded0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:1959:x1796714882440704:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.695960:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562686 00010000:00010000:0.0:1713481296.695962:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.695970:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ff59f80/0xdfc0fb148a39a3e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cb8 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.695980:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf68:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.695988:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.695989:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.695993:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff59f80/0xdfc0fb148a39a3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cb8 expref: 26829 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696002:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007ff59f80/0xdfc0fb148a39a3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cb8 expref: 26829 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696010:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff59f80, rc 0) 00000100:00100000:1.0:1713481296.696018:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.696023:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ded0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:1959:x1796714882440704:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.696028:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562687 00000100:00100000:1.0:1713481296.696034:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440832 00000100:00100000:1.0:1713481296.696037:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440832 00000100:00100000:1.0:1713481296.696061:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562688 00000100:00100000:1.0:1713481296.696066:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:1959:x1796714882440832:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.696070:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.696073:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.696078:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440960 00000100:00100000:0.0:1713481296.696080:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440960 00010000:00010000:1.0:1713481296.696084:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b58d80/0xdfc0fb148a39a45 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cc6 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.696093:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562689 00002000:00010000:1.0:1713481296.696095:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf69:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.696097:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:1959:x1796714882440960:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.696103:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696104:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.696104:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696109:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b58d80/0xdfc0fb148a39a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cc6 expref: 26831 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696112:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ff5b600/0xdfc0fb148a39a4c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cd4 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.696141:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf6a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.696142:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b58d80/0xdfc0fb148a39a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cc6 expref: 26831 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696150:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696151:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696151:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b58d80, rc 0) 00010000:00010000:0.0:1713481296.696156:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff5b600/0xdfc0fb148a39a4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cd4 expref: 26832 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696165:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007ff5b600/0xdfc0fb148a39a4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cd4 expref: 26832 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.696165:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:1959:x1796714882440832:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.696170:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562688 00010000:00010000:0.0:1713481296.696172:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff5b600, rc 0) 00000100:00100000:0.0:1713481296.696186:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26831:1959:x1796714882440960:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 87us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.696191:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562689 00000100:00100000:0.0:1713481296.696248:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.696266:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441088 00000100:00100000:0.0:1713481296.696269:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441088 00000100:00100000:1.0:1713481296.696278:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.696291:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441216 00000100:00100000:0.0:1713481296.696293:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441216 00000100:00100000:2.0:1713481296.696302:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562690 00000100:00100000:2.0:1713481296.696307:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:1959:x1796714882441088:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.696308:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562691 00000100:00100000:1.0:1713481296.696313:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:1959:x1796714882441216:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.696314:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.696320:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.696324:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085efa640/0xdfc0fb148a39a53 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ce2 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.696329:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007aa8aac0/0xdfc0fb148a39a5a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cf0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.696333:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.696334:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf6b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.696340:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf6c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.696342:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.696344:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.696347:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441344 00010000:00010000:2.0:1713481296.696348:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085efa640/0xdfc0fb148a39a53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ce2 expref: 26834 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.696349:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441344 00010000:00010000:1.0:1713481296.696350:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696351:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696355:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa8aac0/0xdfc0fb148a39a5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cf0 expref: 26835 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.696357:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085efa640/0xdfc0fb148a39a53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ce2 expref: 26835 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.696360:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562692 00000100:00100000:0.0:1713481296.696364:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1959:x1796714882441344:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.696365:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007aa8aac0/0xdfc0fb148a39a5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cf0 expref: 26835 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.696365:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085efa640, rc 0) 00010000:00010000:0.0:1713481296.696370:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.696372:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007aa8aac0, rc 0) 00010000:00010000:0.0:1713481296.696377:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ff5aac0/0xdfc0fb148a39a61 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cfe expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.696378:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1959:x1796714882441088:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.696384:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562690 00000100:00100000:1.0:1713481296.696386:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1959:x1796714882441216:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (108us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.696388:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf6d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.696392:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562691 00010000:00010000:0.0:1713481296.696398:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696399:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696403:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff5aac0/0xdfc0fb148a39a61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cfe expref: 26835 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696412:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007ff5aac0/0xdfc0fb148a39a61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cfe expref: 26834 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696419:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff5aac0, rc 0) 00000100:00100000:0.0:1713481296.696436:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26834:1959:x1796714882441344:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.696442:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562692 00000100:00100000:1.0:1713481296.696445:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.696461:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441472 00000100:00100000:1.0:1713481296.696463:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441472 00000100:00100000:1.0:1713481296.696491:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562693 00000100:00100000:1.0:1713481296.696495:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26834:1959:x1796714882441472:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.696501:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.696504:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.696510:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c26b3c0/0xdfc0fb148a39a68 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d0c expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.696517:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441600 00000100:00100000:0.0:1713481296.696519:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441600 00002000:00010000:1.0:1713481296.696521:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf6e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.696528:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696529:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696533:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c26b3c0/0xdfc0fb148a39a68 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d0c expref: 26836 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.696536:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562694 00000100:00100000:0.0:1713481296.696541:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1959:x1796714882441600:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.696546:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c26b3c0/0xdfc0fb148a39a68 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d0c expref: 26836 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696547:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.696553:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c26b3c0, rc 0) 00010000:00010000:0.0:1713481296.696556:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a3d200/0xdfc0fb148a39a6f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d1a expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.696565:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf6f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.696565:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1959:x1796714882441472:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.696569:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562693 00010000:00010000:0.0:1713481296.696572:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696574:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696578:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a3d200/0xdfc0fb148a39a6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d1a expref: 26837 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696585:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a3d200/0xdfc0fb148a39a6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d1a expref: 26836 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696592:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a3d200, rc 0) 00000100:00100000:0.0:1713481296.696604:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1959:x1796714882441600:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.696608:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562694 00000100:00100000:1.0:1713481296.696609:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.696617:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441728 00000100:00100000:1.0:1713481296.696619:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441728 00000100:00100000:1.0:1713481296.696631:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562695 00000100:00100000:1.0:1713481296.696634:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1959:x1796714882441728:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.696638:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.696644:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c26a400/0xdfc0fb148a39a76 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d28 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.696651:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.696652:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf70:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.696657:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696658:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.696660:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441856 00010000:00010000:1.0:1713481296.696661:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c26a400/0xdfc0fb148a39a76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d28 expref: 26837 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.696663:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441856 00010000:00010000:1.0:1713481296.696682:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c26a400/0xdfc0fb148a39a76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d28 expref: 26838 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.696688:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562696 00010000:00010000:1.0:1713481296.696691:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c26a400, rc 0) 00000100:00100000:0.0:1713481296.696692:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26838:1959:x1796714882441856:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.696697:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.696702:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26838:1959:x1796714882441728:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (93us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.696705:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a3cfc0/0xdfc0fb148a39a7d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d36 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.696705:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562695 00002000:00010000:0.0:1713481296.696714:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf71:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.696721:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696722:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696725:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a3cfc0/0xdfc0fb148a39a7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d36 expref: 26838 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696733:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a3cfc0/0xdfc0fb148a39a7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d36 expref: 26838 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.696744:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a3cfc0, rc 0) 00000100:00100000:0.0:1713481296.696755:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26838:1959:x1796714882441856:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.696759:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562696 00000100:00100000:1.0:1713481296.696825:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.696841:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441984 00000100:00100000:0.0:1713481296.696844:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441984 00000100:00100000:0.0:1713481296.696854:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562697 00000100:00100000:1.0:1713481296.696857:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.696858:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26838:1959:x1796714882441984:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.696864:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.696869:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442112 00000100:00100000:1.0:1713481296.696872:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442112 00010000:00010000:0.0:1713481296.696873:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a3d440/0xdfc0fb148a39a84 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d44 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.696883:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf72:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.696890:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.696892:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.696894:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562698 00010000:00010000:0.0:1713481296.696896:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a3d440/0xdfc0fb148a39a84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d44 expref: 26840 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.696899:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26840:1959:x1796714882442112:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.696905:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a3d440/0xdfc0fb148a39a84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d44 expref: 26840 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.696905:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.696912:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a3d440, rc 0) 00010000:00010000:1.0:1713481296.696914:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c268000/0xdfc0fb148a39a8b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d52 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.696924:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf73:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.696926:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26840:1959:x1796714882441984:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.696931:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562697 00010000:00010000:1.0:1713481296.696932:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696934:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.696938:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c268000/0xdfc0fb148a39a8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d52 expref: 26841 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.696947:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c268000/0xdfc0fb148a39a8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d52 expref: 26840 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.696954:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c268000, rc 0) 00000100:00100000:1.0:1713481296.696967:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26840:1959:x1796714882442112:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.696973:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562698 00000100:00100000:0.0:1713481296.696975:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.696987:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442240 00000100:00100000:0.0:1713481296.696990:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442240 00000100:00100000:0.0:1713481296.697009:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562699 00000100:00100000:0.0:1713481296.697013:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26840:1959:x1796714882442240:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.697018:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.697026:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b3b180/0xdfc0fb148a39a92 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d60 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.697028:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:0.0:1713481296.697037:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf74:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.697041:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442368 00010000:00010000:0.0:1713481296.697043:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.697043:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442368 00010000:00010000:0.0:1713481296.697045:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697048:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3b180/0xdfc0fb148a39a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d60 expref: 26842 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.697055:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562700 00010000:00010000:0.0:1713481296.697056:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b3b180/0xdfc0fb148a39a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d60 expref: 26842 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.697059:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26842:1959:x1796714882442368:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.697062:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b3b180, rc 0) 00010000:00010000:1.0:1713481296.697066:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.697073:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26842:1959:x1796714882442240:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 59us (98us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.697075:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af9cd80/0xdfc0fb148a39a99 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d6e expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.697078:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562699 00002000:00010000:1.0:1713481296.697084:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf75:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.697090:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697091:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697094:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af9cd80/0xdfc0fb148a39a99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d6e expref: 26842 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697100:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af9cd80/0xdfc0fb148a39a99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d6e expref: 26842 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697104:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af9cd80, rc 0) 00000100:00100000:1.0:1713481296.697114:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26842:1959:x1796714882442368:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 55us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.697137:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562700 00000100:00100000:0.0:1713481296.697138:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.697150:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442496 00000100:00100000:1.0:1713481296.697152:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442496 00000100:00100000:1.0:1713481296.697165:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562701 00000100:00100000:1.0:1713481296.697168:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26842:1959:x1796714882442496:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.697172:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.697178:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af9ed00/0xdfc0fb148a39aa0 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d7c expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.697185:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf76:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.697187:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.697190:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697191:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697194:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af9ed00/0xdfc0fb148a39aa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d7c expref: 26843 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697199:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af9ed00/0xdfc0fb148a39aa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d7c expref: 26843 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.697200:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442624 00000100:00100000:0.0:1713481296.697203:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442624 00010000:00010000:1.0:1713481296.697204:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af9ed00, rc 0) 00000100:00100000:1.0:1713481296.697212:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26844:1959:x1796714882442496:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.697215:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562701 00000100:00100000:0.0:1713481296.697219:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562702 00000100:00100000:0.0:1713481296.697224:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26843:1959:x1796714882442624:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.697231:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.697238:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.697239:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b38480/0xdfc0fb148a39aa7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d8a expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.697246:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442752 00000100:00100000:1.0:1713481296.697248:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442752 00002000:00010000:0.0:1713481296.697250:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf77:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.697256:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562703 00000100:00100000:1.0:1713481296.697258:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:1959:x1796714882442752:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.697259:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697260:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697262:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.697264:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b38480/0xdfc0fb148a39aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d8a expref: 26845 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697268:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af9eac0/0xdfc0fb148a39aae lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d98 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.697273:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b38480/0xdfc0fb148a39aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d8a expref: 26845 pid: 16545 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.697278:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf78:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.697280:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b38480, rc 0) 00010000:00010000:1.0:1713481296.697284:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697285:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697287:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af9eac0/0xdfc0fb148a39aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d98 expref: 26846 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.697291:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26846:1959:x1796714882442624:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.697293:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af9eac0/0xdfc0fb148a39aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d98 expref: 26846 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.697296:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562702 00010000:00010000:1.0:1713481296.697297:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af9eac0, rc 0) 00000100:00100000:1.0:1713481296.697305:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:1959:x1796714882442752:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.697309:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562703 00000100:00100000:1.0:1713481296.697329:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.697341:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442880 00000100:00100000:1.0:1713481296.697343:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442880 00000100:00100000:1.0:1713481296.697357:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562704 00000100:00100000:1.0:1713481296.697359:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:1959:x1796714882442880:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.697364:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.697369:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800838ba400/0xdfc0fb148a39ab5 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48da6 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.697371:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.697376:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf79:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.697381:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697382:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.697383:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443008 00000100:00100000:0.0:1713481296.697385:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443008 00010000:00010000:1.0:1713481296.697385:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800838ba400/0xdfc0fb148a39ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48da6 expref: 26846 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697391:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800838ba400/0xdfc0fb148a39ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48da6 expref: 26847 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697395:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800838ba400, rc 0) 00000100:00100000:0.0:1713481296.697399:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562705 00000100:00100000:0.0:1713481296.697403:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26847:1959:x1796714882443008:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.697403:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26847:1959:x1796714882442880:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.697407:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562704 00010000:00010000:0.0:1713481296.697410:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.697418:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b38900/0xdfc0fb148a39abc lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48db4 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.697428:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf7a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.697437:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697439:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697443:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b38900/0xdfc0fb148a39abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48db4 expref: 26847 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.697452:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b38900/0xdfc0fb148a39abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48db4 expref: 26847 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.697459:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b38900, rc 0) 00000100:00100000:0.0:1713481296.697472:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26847:1959:x1796714882443008:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.697478:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562705 00000100:00100000:1.0:1713481296.697484:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.697494:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443136 00000100:00100000:1.0:1713481296.697497:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443136 00000100:00100000:1.0:1713481296.697513:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562706 00000100:00100000:1.0:1713481296.697516:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007861a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26847:1959:x1796714882443136:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.697520:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.697526:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800838ba640/0xdfc0fb148a39ac3 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dc2 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.697533:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf7b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.697539:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697540:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697542:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800838ba640/0xdfc0fb148a39ac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dc2 expref: 26848 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697548:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800838ba640/0xdfc0fb148a39ac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dc2 expref: 26848 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.697553:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.697555:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800838ba640, rc 0) 00000100:00100000:1.0:1713481296.697565:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007861a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26848:1959:x1796714882443136:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.697568:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443264 00000100:00100000:1.0:1713481296.697568:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562706 00000100:00100000:0.0:1713481296.697571:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443264 00000100:00100000:1.0:1713481296.697596:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562707 00000100:00100000:1.0:1713481296.697599:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26848:1959:x1796714882443264:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.697602:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.697608:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009919e640/0xdfc0fb148a39aca lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dd0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.697614:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf7c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.697619:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697620:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697622:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009919e640/0xdfc0fb148a39aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dd0 expref: 26849 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697627:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009919e640/0xdfc0fb148a39aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dd0 expref: 26849 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697631:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009919e640, rc 0) 00000100:00100000:1.0:1713481296.697640:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26849:1959:x1796714882443264:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.697643:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562707 00000100:00100000:1.0:1713481296.697685:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.697703:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443392 00000100:00100000:1.0:1713481296.697706:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443392 00000100:00100000:0.0:1713481296.697711:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.697722:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443520 00000100:00100000:1.0:1713481296.697724:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443520 00000100:00100000:0.0:1713481296.697726:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562708 00000100:00100000:0.0:1713481296.697731:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26850:1959:x1796714882443392:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.697737:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.697744:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b398c0/0xdfc0fb148a39ad1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dde expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.697745:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562709 00000100:00100000:1.0:1713481296.697750:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26850:1959:x1796714882443520:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.697754:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf7d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.697757:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.697761:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697762:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697766:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b398c0/0xdfc0fb148a39ad1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dde expref: 26851 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697768:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009919cb40/0xdfc0fb148a39ad8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dec expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.697777:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf7e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.697778:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b398c0/0xdfc0fb148a39ad1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dde expref: 26851 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.697784:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b398c0, rc 0) 00010000:00010000:1.0:1713481296.697786:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697788:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697792:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009919cb40/0xdfc0fb148a39ad8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dec expref: 26852 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.697794:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26852:1959:x1796714882443392:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.697798:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562708 00010000:00010000:1.0:1713481296.697802:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009919cb40/0xdfc0fb148a39ad8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dec expref: 26852 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.697809:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009919cb40, rc 0) 00000100:00100000:1.0:1713481296.697823:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26851:1959:x1796714882443520:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.697829:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562709 00000100:00100000:0.0:1713481296.697839:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.697850:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443648 00000100:00100000:1.0:1713481296.697852:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443648 00000100:00100000:1.0:1713481296.697877:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562710 00000100:00100000:1.0:1713481296.697882:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26851:1959:x1796714882443648:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.697890:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.697899:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009919f840/0xdfc0fb148a39adf lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dfa expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.697904:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.697909:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf7f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.697916:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443776 00000100:00100000:0.0:1713481296.697918:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443776 00010000:00010000:1.0:1713481296.697918:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697919:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.697924:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009919f840/0xdfc0fb148a39adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dfa expref: 26853 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.697930:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562711 00010000:00010000:1.0:1713481296.697933:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009919f840/0xdfc0fb148a39adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dfa expref: 26853 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.697934:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26853:1959:x1796714882443776:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.697939:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.697940:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009919f840, rc 0) 00010000:00010000:0.0:1713481296.697948:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b3a640/0xdfc0fb148a39ae6 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e08 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.697954:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26853:1959:x1796714882443648:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (115us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.697957:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf80:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.697960:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562710 00010000:00010000:0.0:1713481296.697964:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697965:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.697969:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3a640/0xdfc0fb148a39ae6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e08 expref: 26854 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.697976:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b3a640/0xdfc0fb148a39ae6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e08 expref: 26853 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.698000:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.698015:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443904 00000100:00100000:1.0:1713481296.698018:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443904 00000100:00100000:1.0:1713481296.698042:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562712 00000100:00100000:1.0:1713481296.698046:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26854:1959:x1796714882443904:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.698053:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.698063:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009919cfc0/0xdfc0fb148a39aed lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e16 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.698068:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b3a640, rc 0) 00002000:00010000:1.0:1713481296.698073:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf81:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.698081:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26855:1959:x1796714882443776:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 146us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.698082:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.698083:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.698086:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562711 00010000:00010000:1.0:1713481296.698087:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009919cfc0/0xdfc0fb148a39aed lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e16 expref: 26855 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.698097:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009919cfc0/0xdfc0fb148a39aed lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e16 expref: 26854 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.698104:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009919cfc0, rc 0) 00000100:00100000:1.0:1713481296.698146:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26854:1959:x1796714882443904:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 98us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.698152:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562712 00000100:00100000:0.0:1713481296.698157:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.698170:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444032 00000100:00100000:1.0:1713481296.698173:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444032 00000100:00100000:1.0:1713481296.698196:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562713 00000100:00100000:1.0:1713481296.698200:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26854:1959:x1796714882444032:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.698207:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.698216:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088288fc0/0xdfc0fb148a39af4 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e24 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.698221:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.698226:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf82:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.698235:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444160 00010000:00010000:1.0:1713481296.698235:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.698237:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.698238:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444160 00010000:00010000:1.0:1713481296.698241:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088288fc0/0xdfc0fb148a39af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e24 expref: 26856 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.698250:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088288fc0/0xdfc0fb148a39af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e24 expref: 26856 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.698252:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562714 00000100:00100000:0.0:1713481296.698256:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26856:1959:x1796714882444160:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.698259:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088288fc0, rc 0) 00010000:00010000:0.0:1713481296.698262:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.698271:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26856:1959:x1796714882444032:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.698272:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b38d80/0xdfc0fb148a39afb lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e32 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.698277:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562713 00002000:00010000:0.0:1713481296.698282:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf83:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.698289:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.698291:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.698295:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b38d80/0xdfc0fb148a39afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e32 expref: 26856 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.698303:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b38d80/0xdfc0fb148a39afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e32 expref: 26856 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.698310:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b38d80, rc 0) 00000100:00100000:1.0:1713481296.698312:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.698321:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26856:1959:x1796714882444160:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.698329:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444288 00000100:00100000:1.0:1713481296.698332:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444288 00000100:00100000:1.0:1713481296.698346:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562715 00000100:00100000:1.0:1713481296.698350:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007861b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26857:1959:x1796714882444288:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.698357:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.698366:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088289200/0xdfc0fb148a39b02 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e40 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.698375:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf84:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.698382:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.698384:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.698388:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088289200/0xdfc0fb148a39b02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e40 expref: 26858 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.698397:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088289200/0xdfc0fb148a39b02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e40 expref: 26858 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.698403:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562714 00010000:00010000:1.0:1713481296.698404:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088289200, rc 0) 00000100:00100000:1.0:1713481296.698416:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007861b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26857:1959:x1796714882444288:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.698425:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562715 00000100:00100000:1.0:1713481296.698459:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.698473:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444416 00000100:00100000:1.0:1713481296.698476:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444416 00000100:00100000:1.0:1713481296.698501:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562716 00000100:00100000:1.0:1713481296.698506:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26857:1959:x1796714882444416:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.698512:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.698523:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088288900/0xdfc0fb148a39b09 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e4e expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.698533:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf85:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.698534:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.698541:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.698543:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.698548:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088288900/0xdfc0fb148a39b09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e4e expref: 26858 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.698549:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444544 00000100:00100000:0.0:1713481296.698552:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444544 00010000:00010000:1.0:1713481296.698557:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088288900/0xdfc0fb148a39b09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e4e expref: 26859 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.698564:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088288900, rc 0) 00000100:00100000:0.0:1713481296.698567:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562717 00000100:00100000:0.0:1713481296.698571:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26859:1959:x1796714882444544:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.698577:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.698578:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26859:1959:x1796714882444416:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.698583:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562716 00010000:00010000:0.0:1713481296.698586:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800733cad00/0xdfc0fb148a39b10 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e5c expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.698597:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf86:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.698605:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.698606:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.698611:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800733cad00/0xdfc0fb148a39b10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e5c expref: 26859 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.698619:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.698620:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800733cad00/0xdfc0fb148a39b10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e5c expref: 26859 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.698627:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800733cad00, rc 0) 00000100:00100000:1.0:1713481296.698633:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444672 00000100:00100000:1.0:1713481296.698636:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444672 00000100:00100000:0.0:1713481296.698640:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26860:1959:x1796714882444544:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.698646:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562717 00000100:00100000:1.0:1713481296.698659:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562718 00000100:00100000:1.0:1713481296.698677:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007861bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26859:1959:x1796714882444672:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.698684:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.698693:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800882898c0/0xdfc0fb148a39b17 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e6a expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.698704:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf87:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.698712:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.698713:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.698716:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.698718:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800882898c0/0xdfc0fb148a39b17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e6a expref: 26860 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.698727:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800882898c0/0xdfc0fb148a39b17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e6a expref: 26860 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.698731:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444800 00010000:00010000:1.0:1713481296.698734:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800882898c0, rc 0) 00000100:00100000:2.0:1713481296.698734:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444800 00000100:00100000:1.0:1713481296.698747:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007861bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26861:1959:x1796714882444672:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 83us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.698753:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562718 00000100:00100000:2.0:1713481296.698757:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562719 00000100:00100000:2.0:1713481296.698760:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26861:1959:x1796714882444800:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.698766:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.698773:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085efaf40/0xdfc0fb148a39b1e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e78 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.698782:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf88:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.698787:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.698788:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.698791:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085efaf40/0xdfc0fb148a39b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e78 expref: 26861 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.698798:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085efaf40/0xdfc0fb148a39b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e78 expref: 26861 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.698802:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085efaf40, rc 0) 00000100:00100000:2.0:1713481296.698813:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26861:1959:x1796714882444800:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.698816:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562719 00000100:00100000:0.0:1713481296.698848:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.698863:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444928 00000100:00100000:0.0:1713481296.698867:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444928 00000100:00100000:1.0:1713481296.698880:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.698881:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562720 00000100:00100000:0.0:1713481296.698885:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26861:1959:x1796714882444928:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.698891:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445056 00010000:00010000:0.0:1713481296.698892:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.698894:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445056 00010000:00010000:0.0:1713481296.698900:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800733c8240/0xdfc0fb148a39b25 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e86 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.698911:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf89:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.698916:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562721 00010000:00010000:0.0:1713481296.698920:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.698920:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:1959:x1796714882445056:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.698921:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.698924:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.698925:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800733c8240/0xdfc0fb148a39b25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e86 expref: 26863 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.698931:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085efb840/0xdfc0fb148a39b2c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e94 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.698933:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800733c8240/0xdfc0fb148a39b25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e86 expref: 26863 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.698936:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.698940:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800733c8240, rc 0) 00002000:00010000:2.0:1713481296.698942:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf8a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.698948:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.698949:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.698950:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445184 00000100:00100000:0.0:1713481296.698952:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26864:1959:x1796714882444928:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.698952:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445184 00010000:00010000:2.0:1713481296.698952:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085efb840/0xdfc0fb148a39b2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e94 expref: 26864 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.698956:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562720 00010000:00010000:2.0:1713481296.698958:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085efb840/0xdfc0fb148a39b2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e94 expref: 26865 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.698962:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085efb840, rc 0) 00000100:00100000:1.0:1713481296.698968:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562722 00000100:00100000:1.0:1713481296.698972:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26864:1959:x1796714882445184:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.698972:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26864:1959:x1796714882445056:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.698976:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562721 00010000:00010000:1.0:1713481296.698978:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.698988:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.699001:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.699002:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445312 00000100:00100000:2.0:1713481296.699003:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445312 00010000:00010000:1.0:1713481296.699004:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008981c6c0/0xdfc0fb148a39b33 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ea2 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.699009:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445440 00000100:00100000:0.0:1713481296.699012:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445440 00002000:00010000:1.0:1713481296.699016:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf8b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.699016:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562723 00000100:00100000:2.0:1713481296.699019:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26865:1959:x1796714882445312:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.699023:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.699024:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562724 00010000:00010000:1.0:1713481296.699024:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699026:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.699028:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26866:1959:x1796714882445440:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.699029:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085ef8fc0/0xdfc0fb148a39b3a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48eb0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.699031:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008981c6c0/0xdfc0fb148a39b33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ea2 expref: 26866 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699033:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.699036:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf8c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.699040:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008981c6c0/0xdfc0fb148a39b33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ea2 expref: 26866 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699041:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800733cba80/0xdfc0fb148a39b41 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ebe expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.699045:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.699046:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699047:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008981c6c0, rc 0) 00010000:00010000:2.0:1713481296.699050:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085ef8fc0/0xdfc0fb148a39b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eb0 expref: 26867 pid: 16545 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.699051:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf8d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.699057:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699058:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.699060:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26868:1959:x1796714882445184:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 87us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.699062:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800733cba80/0xdfc0fb148a39b41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ebe expref: 26868 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.699064:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085ef8fc0/0xdfc0fb148a39b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eb0 expref: 26868 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.699066:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562722 00010000:00010000:0.0:1713481296.699069:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800733cba80/0xdfc0fb148a39b41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ebe expref: 26868 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.699071:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085ef8fc0, rc 0) 00010000:00010000:0.0:1713481296.699076:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800733cba80, rc 0) 00000100:00100000:2.0:1713481296.699084:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26867:1959:x1796714882445312:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.699086:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26867:1959:x1796714882445440:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.699090:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562723 00000100:00100000:0.0:1713481296.699093:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562724 00000100:00100000:0.0:1713481296.699137:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.699149:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445568 00000100:00100000:0.0:1713481296.699152:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.699152:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445568 00000100:00100000:2.0:1713481296.699164:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445696 00000100:00100000:2.0:1713481296.699165:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445696 00000100:00100000:0.0:1713481296.699169:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.699181:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445824 00000100:00100000:2.0:1713481296.699182:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445824 00000100:00100000:0.0:1713481296.699189:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562725 00000100:00100000:0.0:1713481296.699193:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26868:1959:x1796714882445696:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.699193:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562726 00000100:00100000:2.0:1713481296.699196:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26868:1959:x1796714882445824:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.699198:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.699201:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.699206:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801362bdd40/0xdfc0fb148a39b48 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48eda expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.699208:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f92bcc0/0xdfc0fb148a39b4f lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ee8 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.699213:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf8f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.699215:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf90:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.699218:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699220:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.699221:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699222:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801362bdd40/0xdfc0fb148a39b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eda expref: 26870 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.699222:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.699222:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.699224:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f92bcc0/0xdfc0fb148a39b4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ee8 expref: 26870 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699228:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801362bdd40/0xdfc0fb148a39b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eda expref: 26870 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.699230:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f92bcc0/0xdfc0fb148a39b4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ee8 expref: 26870 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699232:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801362bdd40, rc 0) 00010000:00010000:2.0:1713481296.699235:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f92bcc0, rc 0) 00000100:00100000:1.0:1713481296.699238:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445952 00000100:00100000:0.0:1713481296.699241:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26870:1959:x1796714882445696:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.699241:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445952 00000100:00100000:0.0:1713481296.699245:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562725 00000100:00100000:2.0:1713481296.699245:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26871:1959:x1796714882445824:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.699249:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562726 00000100:00100000:1.0:1713481296.699257:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562727 00000100:00100000:1.0:1713481296.699262:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26869:1959:x1796714882445952:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.699269:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.699270:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562728 00000100:00100000:2.0:1713481296.699273:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26869:1959:x1796714882445568:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.699276:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.699277:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.699278:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008981d680/0xdfc0fb148a39b56 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ef6 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.699282:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f92a400/0xdfc0fb148a39b5d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ecc expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.699287:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf91:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.699288:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf8e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.699289:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446080 00000100:00100000:0.0:1713481296.699291:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446080 00010000:00010000:2.0:1713481296.699292:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.699293:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699296:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.699296:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f92a400/0xdfc0fb148a39b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ecc expref: 26872 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.699298:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.699301:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f92a400/0xdfc0fb148a39b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ecc expref: 26872 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.699302:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008981d680/0xdfc0fb148a39b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ef6 expref: 26872 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.699306:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562729 00010000:00010000:2.0:1713481296.699306:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f92a400, rc 0) 00000100:00100000:0.0:1713481296.699311:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26872:1959:x1796714882446080:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.699311:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008981d680/0xdfc0fb148a39b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ef6 expref: 26872 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.699313:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26872:1959:x1796714882445568:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 39us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.699316:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562728 00010000:00010000:0.0:1713481296.699317:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.699319:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008981d680, rc 0) 00010000:00010000:0.0:1713481296.699326:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb09f80/0xdfc0fb148a39b64 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f04 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.699333:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26871:1959:x1796714882445952:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (112us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.699336:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf92:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.699338:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562727 00010000:00010000:0.0:1713481296.699343:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699345:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699350:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb09f80/0xdfc0fb148a39b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f04 expref: 26871 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699358:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb09f80/0xdfc0fb148a39b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f04 expref: 26871 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699371:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb09f80, rc 0) 00000100:00100000:0.0:1713481296.699384:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26871:1959:x1796714882446080:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.699389:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562729 00000100:00100000:1.0:1713481296.699392:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.699406:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446208 00000100:00100000:1.0:1713481296.699409:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446208 00000100:00100000:1.0:1713481296.699435:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562730 00000100:00100000:1.0:1713481296.699440:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26871:1959:x1796714882446208:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.699446:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.699446:0:16529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.699455:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446336 00010000:00010000:1.0:1713481296.699456:0:16529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008981fa80/0xdfc0fb148a39b6b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f12 expref: -99 pid: 16529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.699457:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446336 00000100:00100000:0.0:1713481296.699467:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562731 00002000:00010000:1.0:1713481296.699467:0:16529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf93:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.699471:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26873:1959:x1796714882446336:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.699475:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699476:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699477:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.699481:0:16529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008981fa80/0xdfc0fb148a39b6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f12 expref: 26873 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699484:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb08000/0xdfc0fb148a39b72 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f20 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.699490:0:16529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008981fa80/0xdfc0fb148a39b6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f12 expref: 26873 pid: 16529 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.699495:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf94:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.699502:0:16529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008981fa80, rc 0) 00010000:00010000:0.0:1713481296.699503:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699503:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699506:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb08000/0xdfc0fb148a39b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f20 expref: 26874 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699512:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb08000/0xdfc0fb148a39b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f20 expref: 26874 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.699516:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26874:1959:x1796714882446208:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.699517:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb08000, rc 0) 00000100:00100000:1.0:1713481296.699522:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562730 00000100:00100000:0.0:1713481296.699527:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26874:1959:x1796714882446336:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 55us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.699532:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562731 00000100:00100000:0.0:1713481296.699560:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.699568:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446464 00000100:00100000:0.0:1713481296.699570:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446464 00000100:00100000:0.0:1713481296.699577:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562732 00000100:00100000:0.0:1713481296.699580:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26873:1959:x1796714882446464:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.699584:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.699590:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb0b180/0xdfc0fb148a39b79 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f2e expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.699596:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf95:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.699599:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.699601:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699602:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699604:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb0b180/0xdfc0fb148a39b79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f2e expref: 26874 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699610:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb0b180/0xdfc0fb148a39b79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f2e expref: 26874 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699614:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0b180, rc 0) 00000100:00100000:0.0:1713481296.699621:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26874:1959:x1796714882446464:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.699624:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562732 00000100:00100000:1.0:1713481296.699625:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446592 00000100:00100000:1.0:1713481296.699628:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446592 00000100:00100000:1.0:1713481296.699649:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562733 00000100:00100000:1.0:1713481296.699653:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26874:1959:x1796714882446592:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.699659:0:16529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.699678:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.699682:0:16529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008981e880/0xdfc0fb148a39b80 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f3c expref: -99 pid: 16529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.699689:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446720 00000100:00100000:0.0:1713481296.699692:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446720 00002000:00010000:1.0:1713481296.699692:0:16529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf96:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.699700:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699702:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.699706:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562734 00010000:00010000:1.0:1713481296.699706:0:16529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008981e880/0xdfc0fb148a39b80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f3c expref: 26876 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.699710:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:1959:x1796714882446720:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.699716:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.699716:0:16529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008981e880/0xdfc0fb148a39b80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f3c expref: 26876 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.699723:0:16529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008981e880, rc 0) 00010000:00010000:0.0:1713481296.699724:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb0b600/0xdfc0fb148a39b87 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f4a expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.699734:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf97:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.699737:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:1959:x1796714882446592:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 82us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.699741:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.699742:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.699745:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562733 00000001:00080000:3.0:1713481296.699745:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040757 00010000:00010000:0.0:1713481296.699747:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb0b600/0xdfc0fb148a39b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f4a expref: 26877 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699757:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb0b600/0xdfc0fb148a39b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f4a expref: 26876 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.699764:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0b600, rc 0) 00000100:00100000:0.0:1713481296.699781:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:1959:x1796714882446720:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.699787:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562734 00000100:00100000:1.0:1713481296.699796:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.699810:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446848 00000100:00100000:1.0:1713481296.699812:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446848 00002000:00080000:3.0:1713481296.699818:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56274 00000100:00100000:1.0:1713481296.699822:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562735 00000100:00100000:1.0:1713481296.699825:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:1959:x1796714882446848:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.699829:0:16529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.699836:0:16529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008981f840/0xdfc0fb148a39b8e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f58 expref: -99 pid: 16529 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.699843:0:16529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf98:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.699848:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699849:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699852:0:16529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008981f840/0xdfc0fb148a39b8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f58 expref: 26877 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.699858:0:16529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008981f840/0xdfc0fb148a39b8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f58 expref: 26877 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.699862:0:16529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008981f840, rc 0) 00000100:00100000:1.0:1713481296.699871:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26877:1959:x1796714882446848:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.699874:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562735 00000100:00100000:1.0:1713481296.699907:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.699920:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446976 00000100:00100000:1.0:1713481296.699923:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446976 00000100:00100000:1.0:1713481296.699936:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562736 00000100:00100000:1.0:1713481296.699940:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26877:1959:x1796714882446976:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.699946:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.699955:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3e1c0/0xdfc0fb148a39b95 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f66 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.699964:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf99:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.699965:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.699972:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699974:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.699978:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3e1c0/0xdfc0fb148a39b95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f66 expref: 26878 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.699980:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447104 00000100:00100000:0.0:1713481296.699983:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447104 00010000:00010000:1.0:1713481296.699987:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3e1c0/0xdfc0fb148a39b95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f66 expref: 26879 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.699994:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3e1c0, rc 0) 00000100:00100000:0.0:1713481296.699999:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562737 00000100:00100000:0.0:1713481296.700003:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26879:1959:x1796714882447104:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.700005:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26879:1959:x1796714882446976:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (97us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.700009:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.700010:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562736 00010000:00010000:0.0:1713481296.700018:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb0a640/0xdfc0fb148a39b9c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f74 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.700032:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf9a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.700040:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.700042:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.700046:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb0a640/0xdfc0fb148a39b9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f74 expref: 26879 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.700055:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb0a640/0xdfc0fb148a39b9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f74 expref: 26879 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.700056:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.700063:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb0a640, rc 0) 00000100:00100000:1.0:1713481296.700066:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447232 00000100:00100000:1.0:1713481296.700068:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447232 00000100:00100000:0.0:1713481296.700076:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26880:1959:x1796714882447104:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.700078:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562738 00000100:00100000:1.0:1713481296.700080:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26880:1959:x1796714882447232:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.700082:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562737 00010000:00010000:1.0:1713481296.700085:0:16529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700091:0:16529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3ed00/0xdfc0fb148a39ba3 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f82 expref: -99 pid: 16529 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.700102:0:16529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf9b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.700107:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700108:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700111:0:16529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3ed00/0xdfc0fb148a39ba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f82 expref: 26880 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.700116:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.700116:0:16529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3ed00/0xdfc0fb148a39ba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f82 expref: 26880 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.700142:0:16529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3ed00, rc 0) 00000100:00100000:0.0:1713481296.700149:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447360 00000100:00100000:1.0:1713481296.700151:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26880:1959:x1796714882447232:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.700152:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447360 00000100:00100000:1.0:1713481296.700155:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562738 00000100:00100000:1.0:1713481296.700167:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562739 00000100:00100000:1.0:1713481296.700170:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26880:1959:x1796714882447360:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.700174:0:16529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700179:0:16529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c000/0xdfc0fb148a39baa lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f90 expref: -99 pid: 16529 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.700185:0:16529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf9c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.700190:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700191:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700193:0:16529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c000/0xdfc0fb148a39baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f90 expref: 26881 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.700202:0:16529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c000/0xdfc0fb148a39baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f90 expref: 26881 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.700206:0:16529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3c000, rc 0) 00000100:00100000:0.0:1713481296.700212:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.700213:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:1959:x1796714882447360:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.700216:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562739 00000100:00100000:0.0:1713481296.700223:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447488 00000100:00100000:0.0:1713481296.700226:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447488 00000100:00100000:2.0:1713481296.700234:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.700237:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562740 00000100:00100000:1.0:1713481296.700240:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447616 00000100:00100000:0.0:1713481296.700241:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:1959:x1796714882447488:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.700242:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447616 00010000:00010000:0.0:1713481296.700247:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.700256:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800961aaf40/0xdfc0fb148a39bb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f9e expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.700257:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562741 00000100:00100000:1.0:1713481296.700259:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26882:1959:x1796714882447616:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.700264:0:16529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1713481296.700265:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf9d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.700269:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.700271:0:16529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096ac33c0/0xdfc0fb148a39bb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fac expref: -99 pid: 16529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.700273:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.700274:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.700275:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437824 00000100:00100000:2.0:1713481296.700277:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437824 00010000:00010000:0.0:1713481296.700278:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800961aaf40/0xdfc0fb148a39bb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f9e expref: 26883 pid: 16462 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.700278:0:16529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf9e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.700284:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700285:0:16529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.700286:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800961aaf40/0xdfc0fb148a39bb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f9e expref: 26884 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.700288:0:16529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096ac33c0/0xdfc0fb148a39bb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fac expref: 26884 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.700289:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562742 00000100:00100000:2.0:1713481296.700292:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16708:1960:x1796714882437824:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.700293:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800961aaf40, rc 0) 00010000:00010000:1.0:1713481296.700293:0:16529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096ac33c0/0xdfc0fb148a39bb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fac expref: 26884 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700297:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700298:0:16529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096ac33c0, rc 0) 00010000:00010000:2.0:1713481296.700305:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa93840/0xdfc0fb148a39bbf lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b84 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.700306:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26884:1959:x1796714882447488:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.700306:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26884:1959:x1796714882447616:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.700310:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562741 00000100:00100000:0.0:1713481296.700313:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562740 00002000:00010000:2.0:1713481296.700313:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9737:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.700319:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700320:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700322:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa93840/0xdfc0fb148a39bbf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b84 expref: 16709 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700329:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa93840/0xdfc0fb148a39bbf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b84 expref: 16709 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700333:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa93840, rc 0) 00000100:00100000:2.0:1713481296.700343:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16709:1960:x1796714882437824:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.700347:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562742 00000100:00100000:0.0:1713481296.700417:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.700437:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882437952 00000100:00100000:0.0:1713481296.700440:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.700440:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882437952 00000100:00100000:2.0:1713481296.700459:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438080 00000100:00100000:2.0:1713481296.700460:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438080 00000100:00100000:0.0:1713481296.700466:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562743 00000100:00100000:2.0:1713481296.700470:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562744 00000100:00100000:0.0:1713481296.700471:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16710:1960:x1796714882437952:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.700473:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16710:1960:x1796714882438080:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.700479:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.700479:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.700487:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800961aa640/0xdfc0fb148a39bcd lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48b99 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.700487:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa92f40/0xdfc0fb148a39bc6 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ba7 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.700494:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9739:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:0.0:1713481296.700495:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9738:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.700500:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.700501:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700501:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.700502:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700503:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa92f40/0xdfc0fb148a39bc6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ba7 expref: 16712 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.700505:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800961aa640/0xdfc0fb148a39bcd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b99 expref: 16712 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700509:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa92f40/0xdfc0fb148a39bc6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ba7 expref: 16712 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.700511:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800961aa640/0xdfc0fb148a39bcd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b99 expref: 16712 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700514:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa92f40, rc 0) 00010000:00010000:0.0:1713481296.700516:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800961aa640, rc 0) 00000100:00100000:2.0:1713481296.700523:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16712:1960:x1796714882438080:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.700526:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16712:1960:x1796714882437952:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.700526:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562744 00000100:00100000:0.0:1713481296.700530:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562743 00000100:00100000:0.0:1713481296.700552:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.700595:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438208 00000100:00100000:2.0:1713481296.700598:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438208 00000100:00100000:0.0:1713481296.700599:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.700610:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438336 00000100:00100000:0.0:1713481296.700612:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.700612:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438336 00000100:00100000:2.0:1713481296.700619:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438464 00000100:00100000:2.0:1713481296.700621:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438464 00000100:00100000:1.0:1713481296.700624:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562745 00000100:00100000:0.0:1713481296.700626:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.700627:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16713:1960:x1796714882438208:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.700631:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438592 00010000:00010000:1.0:1713481296.700632:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.700633:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438592 00010000:00010000:1.0:1713481296.700640:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c398b40/0xdfc0fb148a39bd4 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x973a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bb5 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.700641:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.700643:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562746 00002000:00010000:1.0:1713481296.700648:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x973a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.700648:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16714:1960:x1796714882438336:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.700653:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.700654:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700654:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700655:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700658:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c398b40/0xdfc0fb148a39bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bb5 expref: 16715 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.700677:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.700677:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c398b40/0xdfc0fb148a39bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bb5 expref: 16715 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700677:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9bdd40/0xdfc0fb148a39bdb lrc: 2/0,0 mode: --/PR res: [0x280000408:0x973b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bc3 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.700683:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c398b40, rc 0) 00002000:00010000:2.0:1713481296.700686:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x973b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.700693:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.700694:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16716:1960:x1796714882438208:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (142us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.700694:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.700696:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.700697:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9bdd40/0xdfc0fb148a39bdb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bc3 expref: 16716 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.700698:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562745 00010000:00010000:2.0:1713481296.700703:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9bdd40/0xdfc0fb148a39bdb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bc3 expref: 16716 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700708:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9bdd40, rc 0) 00000100:00100000:0.0:1713481296.700709:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.700718:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16716:1960:x1796714882438336:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.700722:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562746 00000100:00100000:0.0:1713481296.700723:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.700727:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438720 00000100:00100000:1.0:1713481296.700729:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438720 00000100:00100000:0.0:1713481296.700734:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.700752:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438976 00000100:00100000:2.0:1713481296.700752:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882438848 00000100:00100000:2.0:1713481296.700753:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438848 00000100:00100000:1.0:1713481296.700754:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882438976 00000100:00100000:0.0:1713481296.700758:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.700767:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439104 00000100:00100000:1.0:1713481296.700769:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439104 00000100:00100000:2.0:1713481296.700769:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439232 00000100:00100000:2.0:1713481296.700770:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439232 00000100:00100000:3.0:1713481296.700770:0:16466:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439360 00000100:00100000:0.0:1713481296.700774:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.700775:0:16466:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439360 00000100:00100000:1.0:1713481296.700780:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439616 00000100:00100000:2.0:1713481296.700780:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439744 00000100:00100000:1.0:1713481296.700782:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439616 00000100:00100000:2.0:1713481296.700782:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439744 00000100:00100000:0.0:1713481296.700785:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.700795:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.700806:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882439872 00000100:00100000:1.0:1713481296.700807:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882439872 00000100:00100000:2.0:1713481296.700807:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440128 00000100:00100000:3.0:1713481296.700807:0:16466:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440000 00000100:00100000:2.0:1713481296.700809:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440128 00000100:00100000:3.0:1713481296.700810:0:16466:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440000 00000100:00100000:0.0:1713481296.700816:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.700817:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562747 00000100:00100000:1.0:1713481296.700820:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16725:1960:x1796714882438464:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.700822:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440256 00000100:00100000:2.0:1713481296.700823:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440256 00010000:00010000:1.0:1713481296.700825:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700832:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c39b180/0xdfc0fb148a39be2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x973c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bd1 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.700833:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.700838:0:16466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562748 00002000:00010000:1.0:1713481296.700839:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x973c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.700843:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562749 00000100:00100000:3.0:1713481296.700844:0:16466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16727:1960:x1796714882438592:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.700845:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700845:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.700846:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16727:1960:x1796714882438720:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.700848:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c39b180/0xdfc0fb148a39be2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bd1 expref: 16727 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.700849:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.700850:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700854:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c39b180/0xdfc0fb148a39be2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bd1 expref: 16727 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700857:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082320b40/0xdfc0fb148a39be9 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x973e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bed expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.700858:0:16466:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700859:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c39b180, rc 0) 00000100:00100000:0.0:1713481296.700864:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.700864:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x973e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.700868:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16728:1960:x1796714882438464:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (255us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.700869:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700870:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.700871:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562747 00010000:00010000:2.0:1713481296.700873:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082320b40/0xdfc0fb148a39be9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bed expref: 16728 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.700877:0:16466:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008941a400/0xdfc0fb148a39bf0 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x973d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bdf expref: -99 pid: 16466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.700878:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082320b40/0xdfc0fb148a39be9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bed expref: 16728 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700883:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082320b40, rc 0) 00000100:00100000:1.0:1713481296.700885:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440384 00000100:00100000:1.0:1713481296.700887:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440384 00000100:00100000:2.0:1713481296.700891:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16728:1960:x1796714882438720:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.700892:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440512 00002000:00010000:3.0:1713481296.700893:0:16466:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x973d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.700894:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440512 00000100:00100000:2.0:1713481296.700894:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562749 00000100:00100000:1.0:1713481296.700901:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562750 00000100:00100000:1.0:1713481296.700904:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16730:1960:x1796714882438976:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.700907:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.700907:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440640 00010000:00010000:3.0:1713481296.700907:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.700908:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440640 00010000:00010000:3.0:1713481296.700909:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700913:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081780480/0xdfc0fb148a39bf7 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c09 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.700916:0:16466:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008941a400/0xdfc0fb148a39bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bdf expref: 16730 pid: 16466 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.700918:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562751 00002000:00010000:1.0:1713481296.700920:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9740:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.700920:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16730:1960:x1796714882438848:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.700923:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700925:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700926:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700928:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081780480/0xdfc0fb148a39bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c09 expref: 16731 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.700929:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082321b00/0xdfc0fb148a39bfe lrc: 2/0,0 mode: --/PR res: [0x280000408:0x973f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48bfb expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.700929:0:16466:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008941a400/0xdfc0fb148a39bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bdf expref: 16731 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.700934:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081780480/0xdfc0fb148a39bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c09 expref: 16731 pid: 16495 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.700936:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x973f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.700939:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081780480, rc 0) 00010000:00010000:3.0:1713481296.700939:0:16466:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008941a400, rc 0) 00010000:00010000:2.0:1713481296.700941:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700942:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.700944:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082321b00/0xdfc0fb148a39bfe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bfb expref: 16732 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.700947:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882438976:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (271us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.700950:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082321b00/0xdfc0fb148a39bfe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x973f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48bfb expref: 16732 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.700951:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562750 00010000:00010000:2.0:1713481296.700954:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082321b00, rc 0) 00000100:00100000:3.0:1713481296.700959:0:16466:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882438592:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.700962:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562752 00000100:00100000:2.0:1713481296.700964:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882438848:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.700965:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882439104:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.700966:0:16466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562748 00010000:00010000:1.0:1713481296.700968:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.700970:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562751 00010000:00010000:1.0:1713481296.700974:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081781f80/0xdfc0fb148a39c05 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c17 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.700980:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9741:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.700981:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562753 00010000:00010000:1.0:1713481296.700985:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.700986:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882439232:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.700986:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.700988:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081781f80/0xdfc0fb148a39c05 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c17 expref: 16732 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.700993:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081781f80/0xdfc0fb148a39c05 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c17 expref: 16732 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.700994:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.700997:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081781f80, rc 0) 00000100:00100000:2.0:1713481296.700997:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562754 00000100:00100000:2.0:1713481296.701000:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16730:1960:x1796714882439360:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.701004:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16730:1960:x1796714882439104:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 39us (309us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.701004:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.701005:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800842cad00/0xdfc0fb148a39c0c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c25 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.701007:0:16466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562755 00000100:00100000:1.0:1713481296.701010:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562752 00010000:00010000:2.0:1713481296.701010:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124aa6d00/0xdfc0fb148a39c13 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c33 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.701012:0:16466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16730:1960:x1796714882439616:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.701016:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9742:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.701016:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9743:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.701019:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562756 00010000:00010000:3.0:1713481296.701020:0:16466:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.701021:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882439744:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701021:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701022:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701024:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa6d00/0xdfc0fb148a39c13 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c33 expref: 16731 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.701025:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701025:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.701027:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701030:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124aa6d00/0xdfc0fb148a39c13 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c33 expref: 16731 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.701031:0:16466:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a39c1a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c41 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.701032:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800842cad00/0xdfc0fb148a39c0c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c25 expref: 16731 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701034:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124aa6d00, rc 0) 00010000:00010000:1.0:1713481296.701040:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800802df180/0xdfc0fb148a39c21 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c4f expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.701041:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800842cad00/0xdfc0fb148a39c0c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c25 expref: 16731 pid: 16512 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701041:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882439360:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (318us total) trans 0 rc 0/0 00002000:00010000:3.0:1713481296.701042:0:16466:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9744:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.701045:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562754 00002000:00010000:1.0:1713481296.701047:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9745:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.701050:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800842cad00, rc 0) 00010000:00010000:3.0:1713481296.701051:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701052:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701053:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.701053:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701055:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800802df180/0xdfc0fb148a39c21 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c4f expref: 16732 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.701057:0:16466:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a39c1a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c41 expref: 16732 pid: 16466 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701058:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562757 00000100:00100000:2.0:1713481296.701060:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882439872:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.701061:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800802df180/0xdfc0fb148a39c21 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c4f expref: 16732 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701064:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.701065:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800802df180, rc 0) 00010000:00010000:3.0:1713481296.701067:0:16466:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120f161c0/0xdfc0fb148a39c1a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c41 expref: 16732 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701070:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095da1b00/0xdfc0fb148a39c28 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c5d expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.701074:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882439744:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (317us total) trans 0 rc 0/0 00002000:00010000:2.0:1713481296.701075:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9746:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.701075:0:16466:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120f161c0, rc 0) 00000100:00100000:1.0:1713481296.701078:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562756 00010000:00010000:2.0:1713481296.701080:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701081:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701083:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095da1b00/0xdfc0fb148a39c28 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c5d expref: 16733 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701089:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095da1b00/0xdfc0fb148a39c28 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c5d expref: 16733 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701091:0:16466:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882439616:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 78us (355us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.701093:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095da1b00, rc 0) 00000100:00100000:1.0:1713481296.701094:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562758 00000100:00100000:1.0:1713481296.701096:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882440128:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.701097:0:16466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562755 00010000:00010000:1.0:1713481296.701101:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.701101:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882439872:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.701105:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562757 00010000:00010000:1.0:1713481296.701106:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800802df840/0xdfc0fb148a39c2f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c79 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.701112:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9748:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.701134:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701135:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701137:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800802df840/0xdfc0fb148a39c2f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c79 expref: 16731 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.701140:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882439232:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.701140:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562759 00010000:00010000:1.0:1713481296.701143:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800802df840/0xdfc0fb148a39c2f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c79 expref: 16731 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701143:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440000:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.701146:0:16466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562760 00010000:00010000:2.0:1713481296.701147:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.701148:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800802df840, rc 0) 00000100:00100000:0.0:1713481296.701152:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562753 00000100:00100000:3.0:1713481296.701152:0:16466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440256:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701154:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942aeac0/0xdfc0fb148a39c36 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c6b expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.701157:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440128:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (362us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.701160:0:16466:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.701161:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562758 00002000:00010000:2.0:1713481296.701164:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9747:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.701169:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701170:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.701172:0:16466:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800822c0900/0xdfc0fb148a39c3d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c87 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.701173:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942aeac0/0xdfc0fb148a39c36 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c6b expref: 16732 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701177:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562761 00010000:00010000:2.0:1713481296.701179:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942aeac0/0xdfc0fb148a39c36 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c6b expref: 16731 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701180:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440384:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701183:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942aeac0, rc 0) 00002000:00010000:3.0:1713481296.701183:0:16466:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9749:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.701184:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.701190:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135333180/0xdfc0fb148a39c44 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x974a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48c95 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.701192:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882440000:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (406us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.701192:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.701193:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701195:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562759 00002000:00010000:1.0:1713481296.701197:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x974a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.701198:0:16466:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800822c0900/0xdfc0fb148a39c3d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c87 expref: 16732 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701203:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701204:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701205:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562762 00010000:00010000:1.0:1713481296.701206:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135333180/0xdfc0fb148a39c44 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c95 expref: 16732 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701208:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882440512:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.701208:0:16466:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800822c0900/0xdfc0fb148a39c3d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c87 expref: 16732 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701211:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.701212:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135333180/0xdfc0fb148a39c44 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48c95 expref: 16732 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701216:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135333180, rc 0) 00010000:00010000:3.0:1713481296.701216:0:16466:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800822c0900, rc 0) 00010000:00010000:2.0:1713481296.701217:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ffbef40/0xdfc0fb148a39c4b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x974b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ca3 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.701222:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x974b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.701224:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440384:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.701227:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562761 00010000:00010000:2.0:1713481296.701227:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701228:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701231:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbef40/0xdfc0fb148a39c4b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ca3 expref: 16732 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701232:0:16466:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16732:1960:x1796714882440256:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 80us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.701233:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562763 00000100:00100000:0.0:1713481296.701238:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440640:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701239:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ffbef40/0xdfc0fb148a39c4b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ca3 expref: 16731 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701239:0:16466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562760 00010000:00010000:2.0:1713481296.701243:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbef40, rc 0) 00010000:00010000:0.0:1713481296.701245:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.701252:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440512:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (403us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.701255:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cc4fc0/0xdfc0fb148a39c52 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x974c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cb1 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.701255:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562762 00002000:00010000:0.0:1713481296.701266:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x974c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.701274:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.701275:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.701280:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cc4fc0/0xdfc0fb148a39c52 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cb1 expref: 16730 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.701289:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cc4fc0/0xdfc0fb148a39c52 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cb1 expref: 16730 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.701296:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cc4fc0, rc 0) 00000100:00100000:0.0:1713481296.701308:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16730:1960:x1796714882440640:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.701312:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562763 00000100:00100000:0.0:1713481296.701352:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701366:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440768 00000100:00100000:1.0:1713481296.701368:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440768 00000100:00100000:0.0:1713481296.701370:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701378:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882440896 00000100:00100000:1.0:1713481296.701379:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882440896 00000100:00100000:0.0:1713481296.701387:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562764 00000100:00100000:1.0:1713481296.701390:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562765 00000100:00100000:0.0:1713481296.701391:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440768:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.701393:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16731:1960:x1796714882440896:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.701394:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.701397:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.701398:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.701403:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135332640/0xdfc0fb148a39c59 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x974e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ccd expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.701407:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cc6880/0xdfc0fb148a39c60 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x974d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cbf expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.701410:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x974e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:0.0:1713481296.701415:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x974d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.701415:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701415:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441024 00010000:00010000:1.0:1713481296.701417:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701419:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135332640/0xdfc0fb148a39c59 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ccd expref: 16733 pid: 16515 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701419:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441024 00010000:00010000:0.0:1713481296.701421:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.701422:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.701425:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cc6880/0xdfc0fb148a39c60 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cbf expref: 16734 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701425:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135332640/0xdfc0fb148a39c59 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ccd expref: 16734 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701429:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135332640, rc 0) 00010000:00010000:0.0:1713481296.701431:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cc6880/0xdfc0fb148a39c60 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cbf expref: 16734 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701434:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562766 00000100:00100000:1.0:1713481296.701438:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16734:1960:x1796714882440896:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.701438:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16734:1960:x1796714882441024:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.701439:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cc6880, rc 0) 00000100:00100000:1.0:1713481296.701441:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562765 00010000:00010000:2.0:1713481296.701445:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.701448:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16734:1960:x1796714882440768:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 57us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.701452:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562764 00010000:00010000:2.0:1713481296.701455:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079bd3600/0xdfc0fb148a39c67 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x974f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cdb expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.701466:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x974f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.701475:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.701476:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.701476:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701481:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079bd3600/0xdfc0fb148a39c67 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cdb expref: 16733 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.701486:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701489:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441152 00010000:00010000:2.0:1713481296.701490:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079bd3600/0xdfc0fb148a39c67 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x974f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cdb expref: 16733 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701491:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441152 00000100:00100000:0.0:1713481296.701494:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701499:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441280 00000100:00100000:1.0:1713481296.701500:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441280 00010000:00010000:2.0:1713481296.701502:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079bd3600, rc 0) 00000100:00100000:0.0:1713481296.701504:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701515:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441408 00000100:00100000:1.0:1713481296.701516:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441408 00000100:00100000:2.0:1713481296.701516:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16735:1960:x1796714882441024:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.701521:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562766 00000100:00100000:0.0:1713481296.701522:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701528:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441664 00000100:00100000:3.0:1713481296.701528:0:16489:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441536 00000100:00100000:1.0:1713481296.701529:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441664 00000100:00100000:0.0:1713481296.701531:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.701532:0:16489:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441536 00000100:00100000:1.0:1713481296.701537:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441792 00000100:00100000:1.0:1713481296.701539:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441792 00000100:00100000:0.0:1713481296.701540:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.701543:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562767 00000100:00100000:2.0:1713481296.701547:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16738:1960:x1796714882441152:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701553:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.701555:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701556:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882441920 00000100:00100000:1.0:1713481296.701557:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882441920 00000100:00100000:3.0:1713481296.701561:0:16489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562768 00010000:00010000:2.0:1713481296.701562:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079ad3840/0xdfc0fb148a39c6e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ce9 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.701567:0:16489:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16739:1960:x1796714882441280:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.701569:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442048 00000100:00100000:1.0:1713481296.701570:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442048 00000100:00100000:0.0:1713481296.701572:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.701573:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9750:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.701578:0:16489:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.701579:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442176 00000100:00100000:1.0:1713481296.701580:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442176 00010000:00010000:2.0:1713481296.701581:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701582:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701586:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079ad3840/0xdfc0fb148a39c6e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ce9 expref: 16742 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.701589:0:16489:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123670d80/0xdfc0fb148a39c75 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48cf7 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.701590:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562769 00000100:00100000:0.0:1713481296.701591:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701592:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16742:1960:x1796714882441408:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701595:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079ad3840/0xdfc0fb148a39c6e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ce9 expref: 16742 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701597:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.701601:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079ad3840, rc 0) 00002000:00010000:3.0:1713481296.701602:0:16489:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9751:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.701604:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135330fc0/0xdfc0fb148a39c7c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d05 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.701608:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.701610:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1713481296.701611:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9752:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.701612:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701614:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16744:1960:x1796714882441152:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (137us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.701616:0:16489:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123670d80/0xdfc0fb148a39c75 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cf7 expref: 16744 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701617:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701617:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701619:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562767 00010000:00010000:1.0:1713481296.701620:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135330fc0/0xdfc0fb148a39c7c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d05 expref: 16744 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701627:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135330fc0/0xdfc0fb148a39c7c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d05 expref: 16744 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.701627:0:16489:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123670d80/0xdfc0fb148a39c75 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48cf7 expref: 16744 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701631:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135330fc0, rc 0) 00010000:00010000:3.0:1713481296.701635:0:16489:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123670d80, rc 0) 00000100:00100000:2.0:1713481296.701636:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442304 00000100:00100000:2.0:1713481296.701639:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442304 00000100:00100000:1.0:1713481296.701640:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16743:1960:x1796714882441408:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.701643:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562769 00000100:00100000:3.0:1713481296.701651:0:16489:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16744:1960:x1796714882441280:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.701652:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442432 00000100:00100000:2.0:1713481296.701654:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442432 00000100:00100000:1.0:1713481296.701656:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562770 00000100:00100000:1.0:1713481296.701658:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16744:1960:x1796714882441664:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.701660:0:16489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562768 00010000:00010000:1.0:1713481296.701662:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.701682:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135332ac0/0xdfc0fb148a39c83 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d21 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.701689:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9754:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.701689:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562771 00000100:00100000:2.0:1713481296.701694:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16744:1960:x1796714882441536:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.701695:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701696:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.701697:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.701699:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135332ac0/0xdfc0fb148a39c83 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d21 expref: 16744 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701702:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.701705:0:16489:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442560 00010000:00010000:1.0:1713481296.701708:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135332ac0/0xdfc0fb148a39c83 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d21 expref: 16744 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701709:0:16489:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442560 00010000:00010000:1.0:1713481296.701712:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135332ac0, rc 0) 00010000:00010000:2.0:1713481296.701712:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079ad2880/0xdfc0fb148a39c8a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d13 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.701716:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701722:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16745:1960:x1796714882441664:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 63us (200us total) trans 0 rc 0/0 00002000:00010000:2.0:1713481296.701723:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9753:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.701726:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562770 00000100:00100000:3.0:1713481296.701727:0:16489:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442688 00000100:00100000:3.0:1713481296.701729:0:16489:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442688 00010000:00010000:2.0:1713481296.701732:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701733:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701737:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079ad2880/0xdfc0fb148a39c8a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d13 expref: 16746 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.701738:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701740:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562772 00000100:00100000:1.0:1713481296.701743:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16746:1960:x1796714882441792:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.701744:0:16489:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442816 00010000:00010000:2.0:1713481296.701745:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079ad2880/0xdfc0fb148a39c8a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d13 expref: 16746 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701746:0:16489:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442816 00010000:00010000:1.0:1713481296.701747:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.701752:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079ad2880, rc 0) 00010000:00010000:1.0:1713481296.701753:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135330480/0xdfc0fb148a39c91 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d2f expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.701759:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9755:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.701761:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.701763:0:16489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562773 00010000:00010000:1.0:1713481296.701764:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701765:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701767:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135330480/0xdfc0fb148a39c91 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d2f expref: 16748 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701767:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16748:1960:x1796714882441536:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.701769:0:16489:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16748:1960:x1796714882441920:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.701772:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135330480/0xdfc0fb148a39c91 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d2f expref: 16748 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.701773:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562771 00010000:00010000:1.0:1713481296.701776:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135330480, rc 0) 00010000:00010000:3.0:1713481296.701777:0:16489:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.701778:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701784:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16748:1960:x1796714882441792:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.701788:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562772 00010000:00010000:3.0:1713481296.701788:0:16489:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134562d00/0xdfc0fb148a39c98 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d3d expref: -99 pid: 16489 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.701792:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882442944 00000100:00100000:0.0:1713481296.701794:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.701795:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443072 00000100:00100000:2.0:1713481296.701795:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882442944 00000100:00100000:1.0:1713481296.701796:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443072 00002000:00010000:3.0:1713481296.701800:0:16489:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9756:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.701806:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443200 00000100:00100000:1.0:1713481296.701807:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443200 00000100:00100000:0.0:1713481296.701808:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.701809:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.701811:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701813:0:15499:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443328 00000100:00100000:2.0:1713481296.701816:0:15499:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443328 00010000:00010000:3.0:1713481296.701816:0:16489:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134562d00/0xdfc0fb148a39c98 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d3d expref: 16750 pid: 16489 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701826:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562774 00010000:00010000:3.0:1713481296.701826:0:16489:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134562d00/0xdfc0fb148a39c98 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d3d expref: 16751 pid: 16489 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701829:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16751:1960:x1796714882442048:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.701830:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562775 00010000:00010000:1.0:1713481296.701833:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.701834:0:16489:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134562d00, rc 0) 00000100:00100000:0.0:1713481296.701835:0:16470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562776 00000100:00100000:2.0:1713481296.701835:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16751:1960:x1796714882442176:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.701839:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135330d80/0xdfc0fb148a39c9f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d4b expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.701840:0:16470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007861a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_042:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16751:1960:x1796714882442304:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701842:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.701846:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9757:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.701847:0:16470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.701849:0:16489:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882441920:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 80us (307us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.701851:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701851:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079ad3180/0xdfc0fb148a39ca6 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d59 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.701852:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701855:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135330d80/0xdfc0fb148a39c9f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d4b expref: 16752 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701856:0:16489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562773 00010000:00010000:0.0:1713481296.701857:0:16470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cc7840/0xdfc0fb148a39cad lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d67 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.701861:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135330d80/0xdfc0fb148a39c9f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d4b expref: 16752 pid: 16454 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.701861:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9758:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.701865:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135330d80, rc 0) 00010000:00010000:2.0:1713481296.701868:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713481296.701869:0:16470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9759:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.701870:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701874:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079ad3180/0xdfc0fb148a39ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d59 expref: 16753 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701875:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882442048:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.701876:0:16489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562777 00010000:00010000:0.0:1713481296.701877:0:16470:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.701879:0:16470:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.701880:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562774 00010000:00010000:2.0:1713481296.701882:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079ad3180/0xdfc0fb148a39ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d59 expref: 16753 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701882:0:16489:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882442432:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.701884:0:16470:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cc7840/0xdfc0fb148a39cad lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d67 expref: 16753 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701887:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079ad3180, rc 0) 00010000:00010000:3.0:1713481296.701890:0:16489:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.701893:0:16470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cc7840/0xdfc0fb148a39cad lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d67 expref: 16752 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701894:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562778 00000100:00100000:1.0:1713481296.701897:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882442560:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.701898:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882442176:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (326us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.701900:0:16470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cc7840, rc 0) 00010000:00010000:3.0:1713481296.701900:0:16489:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134563840/0xdfc0fb148a39cb4 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x975a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d75 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.701901:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.701901:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562775 00010000:00010000:1.0:1713481296.701906:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135332d00/0xdfc0fb148a39cbb lrc: 2/0,0 mode: --/PR res: [0x280000408:0x975b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d83 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.701910:0:16489:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x975a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.701912:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x975b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.701914:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562779 00000100:00100000:0.0:1713481296.701915:0:16470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007861a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_042:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16751:1960:x1796714882442304:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 74us (324us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.701917:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701917:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007861b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882442688:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.701918:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.701919:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701920:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135332d00/0xdfc0fb148a39cbb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d83 expref: 16753 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.701921:0:16470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562776 00010000:00010000:2.0:1713481296.701921:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.701921:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.701925:0:16489:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134563840/0xdfc0fb148a39cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d75 expref: 16753 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701926:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135332d00/0xdfc0fb148a39cbb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d83 expref: 16753 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.701927:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079ad3600/0xdfc0fb148a39cc2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x975c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d91 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.701930:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135332d00, rc 0) 00002000:00010000:2.0:1713481296.701934:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x975c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.701937:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882442560:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.701938:0:16470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562780 00010000:00010000:2.0:1713481296.701938:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.701939:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.701940:0:16489:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134563840/0xdfc0fb148a39cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d75 expref: 16753 pid: 16489 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701941:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562778 00000100:00100000:0.0:1713481296.701943:0:16470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_042:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882442816:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701943:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079ad3600/0xdfc0fb148a39cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d91 expref: 16753 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.701948:0:16489:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134563840, rc 0) 00010000:00010000:0.0:1713481296.701949:0:16470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.701952:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079ad3600/0xdfc0fb148a39cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d91 expref: 16752 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701954:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562781 00000100:00100000:1.0:1713481296.701957:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007861bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882443072:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.701958:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079ad3600, rc 0) 00010000:00010000:0.0:1713481296.701959:0:16470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cc4d80/0xdfc0fb148a39cc9 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x975d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48d9f expref: -99 pid: 16470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.701960:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.701963:0:16489:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882442432:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 81us (355us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.701967:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800882e5200/0xdfc0fb148a39cd0 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x975f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dbb expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.701969:0:16470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x975d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.701969:0:16489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562777 00000100:00100000:2.0:1713481296.701972:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007861b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882442688:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (255us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.701973:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x975f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.701977:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.701978:0:16470:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701978:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.701978:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562779 00010000:00010000:0.0:1713481296.701979:0:16470:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.701981:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800882e5200/0xdfc0fb148a39cd0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dbb expref: 16753 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.701983:0:16470:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cc4d80/0xdfc0fb148a39cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d9f expref: 16753 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.701986:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800882e5200/0xdfc0fb148a39cd0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dbb expref: 16753 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.701989:0:16489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562782 00010000:00010000:1.0:1713481296.701990:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800882e5200, rc 0) 00000100:00100000:3.0:1713481296.701994:0:16489:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882442944:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.701997:0:16470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cc4d80/0xdfc0fb148a39cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48d9f expref: 16752 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.701998:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007861bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882443072:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.701999:0:15499:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562783 00010000:00010000:3.0:1713481296.702001:0:16489:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.702002:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562781 00000100:00100000:2.0:1713481296.702003:0:15499:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882443200:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.702004:0:16470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cc4d80, rc 0) 00010000:00010000:2.0:1713481296.702010:0:15499:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.702011:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562784 00010000:00010000:3.0:1713481296.702011:0:16489:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134560480/0xdfc0fb148a39cd7 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x975e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dad expref: -99 pid: 16489 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.702014:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16751:1960:x1796714882443328:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.702017:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.702018:0:16470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_042:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16751:1960:x1796714882442816:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (280us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.702021:0:15499:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079ad2400/0xdfc0fb148a39cde lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dc9 expref: -99 pid: 15499 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.702022:0:16489:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x975e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702023:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ced73c0/0xdfc0fb148a39ce5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48dd7 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.702024:0:16470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562780 00002000:00010000:1.0:1713481296.702028:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9761:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.702031:0:15499:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9760:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.702032:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702033:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.702033:0:16489:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702034:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702036:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ced73c0/0xdfc0fb148a39ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dd7 expref: 16754 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.702038:0:16489:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134560480/0xdfc0fb148a39cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dad expref: 16754 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702040:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702041:0:15499:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702042:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ced73c0/0xdfc0fb148a39ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dd7 expref: 16753 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702045:0:15499:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079ad2400/0xdfc0fb148a39cde lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dc9 expref: 16753 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702046:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ced73c0, rc 0) 00010000:00010000:3.0:1713481296.702048:0:16489:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134560480/0xdfc0fb148a39cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x975e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dad expref: 16753 pid: 16489 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.702052:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882443328:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 38us (244us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.702055:0:15499:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079ad2400/0xdfc0fb148a39cde lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48dc9 expref: 16753 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.702056:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562784 00010000:00010000:3.0:1713481296.702056:0:16489:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134560480, rc 0) 00000100:00100000:0.0:1713481296.702062:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.702062:0:15499:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079ad2400, rc 0) 00000100:00100000:1.0:1713481296.702067:0:16454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443456 00000100:00100000:1.0:1713481296.702069:0:16454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443456 00000100:00100000:3.0:1713481296.702070:0:16489:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882442944:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.702077:0:15499:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882443200:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.702078:0:16489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562782 00000100:00100000:2.0:1713481296.702084:0:15499:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562783 00000100:00100000:1.0:1713481296.702087:0:16454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562785 00000100:00100000:1.0:1713481296.702090:0:16454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882443456:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.702094:0:16454:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.702100:0:16454:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ced5200/0xdfc0fb148a39cec lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48de5 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.702106:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.702106:0:16454:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9762:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702111:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702112:0:16454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702115:0:16454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ced5200/0xdfc0fb148a39cec lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48de5 expref: 16752 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702135:0:16454:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ced5200/0xdfc0fb148a39cec lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48de5 expref: 16752 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702137:0:16539:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443584 00010000:00010000:1.0:1713481296.702140:0:16454:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ced5200, rc 0) 00000100:00100000:2.0:1713481296.702140:0:16539:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443584 00000100:00100000:1.0:1713481296.702148:0:16454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16753:1960:x1796714882443456:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.702152:0:16454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562785 00000100:00100000:2.0:1713481296.702156:0:16539:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562786 00000100:00100000:2.0:1713481296.702160:0:16539:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16752:1960:x1796714882443584:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.702166:0:16539:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.702174:0:16539:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079ad3cc0/0xdfc0fb148a39cf3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48df3 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.702180:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.702184:0:16539:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9763:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.702191:0:16539:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.702192:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443712 00010000:00010000:2.0:1713481296.702193:0:16539:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.702194:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443712 00010000:00010000:2.0:1713481296.702196:0:16539:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079ad3cc0/0xdfc0fb148a39cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48df3 expref: 16753 pid: 16539 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.702198:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.702203:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443840 00000100:00100000:1.0:1713481296.702204:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443840 00010000:00010000:2.0:1713481296.702204:0:16539:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079ad3cc0/0xdfc0fb148a39cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48df3 expref: 16754 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702210:0:16539:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079ad3cc0, rc 0) 00000100:00100000:0.0:1713481296.702211:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.702211:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562787 00000100:00100000:1.0:1713481296.702214:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16755:1960:x1796714882443712:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.702218:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.702221:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882443968 00000100:00100000:2.0:1713481296.702222:0:16539:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16755:1960:x1796714882443584:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 62us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.702224:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882443968 00010000:00010000:1.0:1713481296.702225:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ced5b00/0xdfc0fb148a39cfa lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e01 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.702227:0:16539:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562786 00002000:00010000:1.0:1713481296.702232:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9764:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702237:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702238:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.702239:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562788 00010000:00010000:1.0:1713481296.702240:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ced5b00/0xdfc0fb148a39cfa lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e01 expref: 16756 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.702243:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16756:1960:x1796714882443840:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.702246:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ced5b00/0xdfc0fb148a39cfa lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e01 expref: 16756 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702246:0:16539:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562789 00000100:00100000:2.0:1713481296.702249:0:16539:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16756:1960:x1796714882443968:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.702250:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.702251:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ced5b00, rc 0) 00010000:00010000:2.0:1713481296.702253:0:16539:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.702260:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16756:1960:x1796714882443712:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (81us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.702260:0:16539:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079ad1b00/0xdfc0fb148a39d01 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e1d expref: -99 pid: 16539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.702262:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cc6640/0xdfc0fb148a39d08 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e0f expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.702263:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562787 00002000:00010000:2.0:1713481296.702266:0:16539:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9766:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.702271:0:16539:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713481296.702272:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9765:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.702272:0:16539:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702274:0:16539:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079ad1b00/0xdfc0fb148a39d01 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e1d expref: 16756 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702280:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702280:0:16539:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079ad1b00/0xdfc0fb148a39d01 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e1d expref: 16757 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702282:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702284:0:16539:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079ad1b00, rc 0) 00010000:00010000:0.0:1713481296.702286:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cc6640/0xdfc0fb148a39d08 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e0f expref: 16757 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702293:0:16539:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16757:1960:x1796714882443968:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.702297:0:16539:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562789 00010000:00010000:0.0:1713481296.702300:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cc6640/0xdfc0fb148a39d08 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e0f expref: 16757 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702307:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cc6640, rc 0) 00000100:00100000:0.0:1713481296.702321:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16756:1960:x1796714882443840:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.702327:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562788 00000100:00100000:0.0:1713481296.702367:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.702380:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444096 00000100:00100000:1.0:1713481296.702381:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444096 00000100:00100000:0.0:1713481296.702386:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.702395:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444224 00000100:00100000:1.0:1713481296.702397:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444224 00000100:00100000:0.0:1713481296.702406:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562790 00000100:00100000:1.0:1713481296.702409:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562791 00000100:00100000:0.0:1713481296.702411:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16757:1960:x1796714882444096:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.702412:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16757:1960:x1796714882444224:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.702415:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.702416:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.702418:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.702422:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999fe400/0xdfc0fb148a39d0f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e39 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.702428:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cc61c0/0xdfc0fb148a39d16 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e2b expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.702431:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444352 00002000:00010000:1.0:1713481296.702432:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9768:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.702433:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444352 00002000:00010000:0.0:1713481296.702438:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9767:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702438:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702439:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702441:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999fe400/0xdfc0fb148a39d0f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e39 expref: 16760 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702445:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.702445:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562792 00010000:00010000:0.0:1713481296.702446:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702447:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999fe400/0xdfc0fb148a39d0f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e39 expref: 16760 pid: 16512 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702448:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16760:1960:x1796714882444352:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.702450:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cc61c0/0xdfc0fb148a39d16 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e2b expref: 16760 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702451:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999fe400, rc 0) 00010000:00010000:2.0:1713481296.702452:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.702458:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cc61c0/0xdfc0fb148a39d16 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e2b expref: 16760 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.702460:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16760:1960:x1796714882444224:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (75us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.702460:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800965f6400/0xdfc0fb148a39d1d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e47 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.702463:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562791 00010000:00010000:0.0:1713481296.702464:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cc61c0, rc 0) 00002000:00010000:2.0:1713481296.702467:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9769:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.702473:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702475:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.702476:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16760:1960:x1796714882444096:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.702477:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800965f6400/0xdfc0fb148a39d1d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e47 expref: 16760 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.702480:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562790 00010000:00010000:2.0:1713481296.702483:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800965f6400/0xdfc0fb148a39d1d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e47 expref: 16760 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702487:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800965f6400, rc 0) 00000100:00100000:2.0:1713481296.702496:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16759:1960:x1796714882444352:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.702501:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562792 00000100:00100000:0.0:1713481296.702508:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.702514:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444480 00000100:00100000:2.0:1713481296.702517:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444480 00000100:00100000:0.0:1713481296.702524:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.702527:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444608 00000100:00100000:2.0:1713481296.702530:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444608 00000100:00100000:1.0:1713481296.702533:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562793 00000100:00100000:1.0:1713481296.702536:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16760:1960:x1796714882444480:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.702537:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.702541:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.702542:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444736 00000100:00100000:2.0:1713481296.702544:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444736 00010000:00010000:1.0:1713481296.702546:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999fd680/0xdfc0fb148a39d24 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x976a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e55 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.702552:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x976a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.702553:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.702554:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562794 00010000:00010000:1.0:1713481296.702558:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702559:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.702559:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16762:1960:x1796714882444608:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.702561:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999fd680/0xdfc0fb148a39d24 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e55 expref: 16762 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702565:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.702567:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.702570:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999fd680/0xdfc0fb148a39d24 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e55 expref: 16762 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702572:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800965f73c0/0xdfc0fb148a39d2b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x976b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e63 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.702574:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999fd680, rc 0) 00000100:00100000:0.0:1713481296.702577:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.702580:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x976b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.702582:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16762:1960:x1796714882444480:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.702585:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562793 00010000:00010000:2.0:1713481296.702585:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702586:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.702589:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.702589:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800965f73c0/0xdfc0fb148a39d2b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e63 expref: 16763 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702598:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800965f73c0/0xdfc0fb148a39d2b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e63 expref: 16762 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702602:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800965f73c0, rc 0) 00000100:00100000:1.0:1713481296.702603:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444864 00000100:00100000:1.0:1713481296.702604:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444864 00000100:00100000:0.0:1713481296.702611:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.702612:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16763:1960:x1796714882444608:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.702615:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882444992 00000100:00100000:1.0:1713481296.702616:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882444992 00000100:00100000:2.0:1713481296.702616:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562794 00000100:00100000:1.0:1713481296.702622:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445120 00000100:00100000:0.0:1713481296.702623:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.702623:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445120 00000100:00100000:1.0:1713481296.702630:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445248 00000100:00100000:1.0:1713481296.702631:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445248 00000100:00100000:2.0:1713481296.702632:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445376 00000100:00100000:2.0:1713481296.702634:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445376 00000100:00100000:0.0:1713481296.702635:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.702640:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445504 00000100:00100000:1.0:1713481296.702641:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445504 00000100:00100000:2.0:1713481296.702648:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445632 00000100:00100000:0.0:1713481296.702649:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.702650:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445632 00000100:00100000:1.0:1713481296.702651:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562795 00000100:00100000:1.0:1713481296.702653:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16768:1960:x1796714882444736:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.702656:0:16466:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445760 00010000:00010000:1.0:1713481296.702657:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.702659:0:16466:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445760 00000100:00100000:0.0:1713481296.702662:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.702663:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562796 00010000:00010000:1.0:1713481296.702681:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999fd440/0xdfc0fb148a39d32 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x976c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e71 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.702682:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801209a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16769:1960:x1796714882444864:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.702686:0:16466:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882445888 00000100:00100000:0.0:1713481296.702688:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.702688:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.702688:0:16466:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882445888 00002000:00010000:1.0:1713481296.702689:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x976c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702697:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702697:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e1aa1c0/0xdfc0fb148a39d39 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x976d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e7f expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.702698:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.702698:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702701:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999fd440/0xdfc0fb148a39d32 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e71 expref: 16771 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.702705:0:16466:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446016 00002000:00010000:2.0:1713481296.702706:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x976d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702707:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999fd440/0xdfc0fb148a39d32 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e71 expref: 16771 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.702707:0:16466:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446016 00010000:00010000:1.0:1713481296.702712:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999fd440, rc 0) 00010000:00010000:2.0:1713481296.702714:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702715:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.702717:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446144 00000100:00100000:0.0:1713481296.702719:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446144 00010000:00010000:2.0:1713481296.702719:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e1aa1c0/0xdfc0fb148a39d39 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e7f expref: 16773 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.702722:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16774:1960:x1796714882444736:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.702722:0:16466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562797 00000100:00100000:1.0:1713481296.702726:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562795 00000100:00100000:3.0:1713481296.702726:0:16466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801209a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16774:1960:x1796714882444992:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.702728:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e1aa1c0/0xdfc0fb148a39d39 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e7f expref: 16774 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.702732:0:16466:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.702735:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562798 00000100:00100000:0.0:1713481296.702738:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801209a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882445120:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.702738:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e1aa1c0, rc 0) 00000100:00100000:1.0:1713481296.702739:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562799 00000100:00100000:1.0:1713481296.702741:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801209a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882445248:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.702741:0:16466:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132027600/0xdfc0fb148a39d40 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x976e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e8d expref: -99 pid: 16466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.702743:0:16547:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.702745:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.702750:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999fdd40/0xdfc0fb148a39d47 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ea9 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.702750:0:16466:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x976e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.702751:0:16547:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d3cc000/0xdfc0fb148a39d4e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x976f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48e9b expref: -99 pid: 16547 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.702751:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801209a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882444864:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.702756:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562796 00002000:00010000:1.0:1713481296.702757:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9770:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.702757:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.702759:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713481296.702760:0:16547:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x976f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702762:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.702762:0:16466:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132027600/0xdfc0fb148a39d40 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e8d expref: 16775 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702763:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702765:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999fdd40/0xdfc0fb148a39d47 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ea9 expref: 16775 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702766:0:16547:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.702767:0:16547:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.702768:0:16466:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132027600/0xdfc0fb148a39d40 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e8d expref: 16775 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702770:0:16547:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d3cc000/0xdfc0fb148a39d4e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e9b expref: 16775 pid: 16547 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702771:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999fdd40/0xdfc0fb148a39d47 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ea9 expref: 16775 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702772:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562800 00010000:00010000:3.0:1713481296.702773:0:16466:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132027600, rc 0) 00010000:00010000:1.0:1713481296.702775:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999fdd40, rc 0) 00010000:00010000:0.0:1713481296.702776:0:16547:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d3cc000/0xdfc0fb148a39d4e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x976f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48e9b expref: 16775 pid: 16547 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702776:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882445376:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.702780:0:16547:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d3cc000, rc 0) 00010000:00010000:2.0:1713481296.702781:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.702786:0:16466:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801209a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882444992:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.702789:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801209a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882445248:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (200us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.702789:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e1ab600/0xdfc0fb148a39d55 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48eb7 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.702791:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801209a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882445120:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.702791:0:16466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562797 00000100:00100000:1.0:1713481296.702794:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562799 00000100:00100000:0.0:1713481296.702797:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562798 00002000:00010000:2.0:1713481296.702798:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9771:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.702805:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702806:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.702810:0:16466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562801 00010000:00010000:2.0:1713481296.702811:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e1ab600/0xdfc0fb148a39d55 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eb7 expref: 16773 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.702817:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562802 00000100:00100000:3.0:1713481296.702817:0:16466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882445504:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.702819:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e1ab600/0xdfc0fb148a39d55 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eb7 expref: 16773 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.702820:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562803 00000100:00100000:1.0:1713481296.702820:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882445632:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.702821:0:16466:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.702823:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882445760:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.702823:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.702824:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e1ab600, rc 0) 00010000:00010000:0.0:1713481296.702826:0:16547:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.702829:0:16466:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132027840/0xdfc0fb148a39d5c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ec5 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.702830:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ad73c0/0xdfc0fb148a39d63 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ed3 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.702832:0:16547:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d3cf600/0xdfc0fb148a39d6a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ee1 expref: -99 pid: 16547 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.702834:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882445376:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 58us (223us total) trans 0 rc 0/0 00002000:00010000:3.0:1713481296.702837:0:16466:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9772:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.702838:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562800 00002000:00010000:0.0:1713481296.702839:0:16547:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9774:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.702843:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.702844:0:16547:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.702844:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.702845:0:16547:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1713481296.702845:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9773:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.702847:0:16547:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d3cf600/0xdfc0fb148a39d6a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ee1 expref: 16774 pid: 16547 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.702847:0:16466:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132027840/0xdfc0fb148a39d5c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ec5 expref: 16774 pid: 16466 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702850:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562804 00010000:00010000:0.0:1713481296.702853:0:16547:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d3cf600/0xdfc0fb148a39d6a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ee1 expref: 16775 pid: 16547 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702853:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702853:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.702853:0:16466:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132027840/0xdfc0fb148a39d5c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ec5 expref: 16775 pid: 16466 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702854:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882445888:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.702856:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ad73c0/0xdfc0fb148a39d63 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ed3 expref: 16775 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702858:0:16547:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d3cf600, rc 0) 00010000:00010000:2.0:1713481296.702858:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.702858:0:16466:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132027840, rc 0) 00010000:00010000:1.0:1713481296.702862:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ad73c0/0xdfc0fb148a39d63 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ed3 expref: 16775 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702866:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ad73c0, rc 0) 00010000:00010000:2.0:1713481296.702866:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136663a80/0xdfc0fb148a39d71 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48eef expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.702868:0:16466:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882445504:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.702871:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882445760:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (221us total) trans 0 rc 0/0 00002000:00010000:2.0:1713481296.702873:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9775:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.702873:0:16466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562801 00000100:00100000:1.0:1713481296.702875:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882445632:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 55us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.702876:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562803 00000100:00100000:1.0:1713481296.702878:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562802 00010000:00010000:2.0:1713481296.702878:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702879:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.702882:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136663a80/0xdfc0fb148a39d71 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eef expref: 16776 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.702887:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136663a80/0xdfc0fb148a39d71 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48eef expref: 16774 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.702887:0:16466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562805 00010000:00010000:2.0:1713481296.702891:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136663a80, rc 0) 00000100:00100000:3.0:1713481296.702892:0:16466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882446016:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.702893:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562806 00010000:00010000:3.0:1713481296.702896:0:16466:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.702898:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882446144:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.702899:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16773:1960:x1796714882445888:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.702902:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562804 00010000:00010000:3.0:1713481296.702903:0:16466:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132027cc0/0xdfc0fb148a39d78 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48efd expref: -99 pid: 16466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.702904:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1713481296.702910:0:16466:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9776:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.702913:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.702913:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800992d7cc0/0xdfc0fb148a39d7f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f0b expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.702916:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.702917:0:16466:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.702919:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446272 00010000:00010000:3.0:1713481296.702920:0:16466:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132027cc0/0xdfc0fb148a39d78 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48efd expref: 16773 pid: 16466 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.702921:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446272 00010000:00010000:3.0:1713481296.702926:0:16466:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132027cc0/0xdfc0fb148a39d78 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48efd expref: 16774 pid: 16466 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.702928:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562807 00002000:00010000:1.0:1713481296.702928:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9777:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.702930:0:16466:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132027cc0, rc 0) 00000100:00100000:0.0:1713481296.702931:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16774:1960:x1796714882446272:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.702935:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.702936:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.702938:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.702939:0:16466:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882446016:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (251us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.702942:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135057cc0/0xdfc0fb148a39d86 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f19 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.702943:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800992d7cc0/0xdfc0fb148a39d7f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f0b expref: 16775 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.702943:0:16466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562805 00002000:00010000:0.0:1713481296.702950:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9778:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.702952:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800992d7cc0/0xdfc0fb148a39d7f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f0b expref: 16775 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702955:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.702956:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.702958:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135057cc0/0xdfc0fb148a39d86 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f19 expref: 16775 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.702960:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800992d7cc0, rc 0) 00000100:00100000:2.0:1713481296.702964:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.702965:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135057cc0/0xdfc0fb148a39d86 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f19 expref: 16775 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.702969:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135057cc0, rc 0) 00000100:00100000:1.0:1713481296.702974:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882446144:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.702978:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882446272:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.702980:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562806 00000100:00100000:3.0:1713481296.702980:0:16477:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446400 00000100:00100000:0.0:1713481296.702982:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562807 00000100:00100000:3.0:1713481296.702982:0:16477:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446400 00000100:00100000:2.0:1713481296.702988:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.702996:0:16477:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446528 00000100:00100000:3.0:1713481296.702997:0:16477:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446528 00000100:00100000:0.0:1713481296.703000:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562808 00000100:00100000:0.0:1713481296.703003:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882446400:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.703006:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.703007:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.703008:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562809 00010000:00010000:0.0:1713481296.703012:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135056d00/0xdfc0fb148a39d8d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f27 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.703012:0:16477:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446656 00000100:00100000:1.0:1713481296.703013:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16775:1960:x1796714882446528:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.703014:0:16477:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446656 00002000:00010000:0.0:1713481296.703019:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9779:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.703019:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.703024:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.703025:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703026:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703026:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800992d4240/0xdfc0fb148a39d94 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x977a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f35 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.703030:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135056d00/0xdfc0fb148a39d8d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f27 expref: 16777 pid: 16532 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.703032:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x977a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.703032:0:16477:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446784 00000100:00100000:3.0:1713481296.703033:0:16477:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446784 00010000:00010000:0.0:1713481296.703038:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135056d00/0xdfc0fb148a39d8d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f27 expref: 16779 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703038:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703039:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703042:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800992d4240/0xdfc0fb148a39d94 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f35 expref: 16779 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.703043:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562810 00010000:00010000:0.0:1713481296.703045:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135056d00, rc 0) 00000100:00100000:2.0:1713481296.703047:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16779:1960:x1796714882446656:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.703048:0:16477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562811 00010000:00010000:1.0:1713481296.703050:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800992d4240/0xdfc0fb148a39d94 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f35 expref: 16779 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.703052:0:16477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16779:1960:x1796714882446784:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.703054:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800992d4240, rc 0) 00010000:00010000:2.0:1713481296.703054:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703056:0:16477:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.703058:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16779:1960:x1796714882446400:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.703061:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136660900/0xdfc0fb148a39d9b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x977b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f43 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.703063:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16779:1960:x1796714882446528:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.703064:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562808 00010000:00010000:3.0:1713481296.703066:0:16477:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801320273c0/0xdfc0fb148a39da2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x977c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f51 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.703067:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562809 00002000:00010000:2.0:1713481296.703068:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x977b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.703074:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1713481296.703074:0:16477:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x977c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.703075:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.703077:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136660900/0xdfc0fb148a39d9b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f43 expref: 16779 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703080:0:16477:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703081:0:16477:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.703083:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136660900/0xdfc0fb148a39d9b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f43 expref: 16779 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703084:0:16477:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801320273c0/0xdfc0fb148a39da2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f51 expref: 16779 pid: 16477 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.703088:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136660900, rc 0) 00010000:00010000:3.0:1713481296.703091:0:16477:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801320273c0/0xdfc0fb148a39da2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f51 expref: 16779 pid: 16477 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703096:0:16477:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801320273c0, rc 0) 00000100:00100000:2.0:1713481296.703097:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16779:1960:x1796714882446656:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.703100:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562810 00000100:00100000:0.0:1713481296.703102:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.703105:0:16477:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16779:1960:x1796714882446784:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.703109:0:16477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562811 00000100:00100000:1.0:1713481296.703115:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882446912 00000100:00100000:1.0:1713481296.703117:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882446912 00000100:00100000:3.0:1713481296.703145:0:16477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562812 00000100:00100000:3.0:1713481296.703148:0:16477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16778:1960:x1796714882446912:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.703149:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.703153:0:16477:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.703159:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447040 00000100:00100000:1.0:1713481296.703161:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447040 00010000:00010000:3.0:1713481296.703162:0:16477:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132027a80/0xdfc0fb148a39da9 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x977d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f5f expref: -99 pid: 16477 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.703169:0:16477:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x977d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.703170:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562813 00000100:00100000:1.0:1713481296.703172:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16780:1960:x1796714882447040:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.703175:0:16477:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703176:0:16477:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703177:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703179:0:16477:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132027a80/0xdfc0fb148a39da9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f5f expref: 16780 pid: 16477 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703184:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077238fc0/0xdfc0fb148a39db0 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x977e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f6d expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.703185:0:16477:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132027a80/0xdfc0fb148a39da9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f5f expref: 16780 pid: 16477 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703190:0:16477:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132027a80, rc 0) 00002000:00010000:1.0:1713481296.703191:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x977e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.703196:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703197:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703200:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077238fc0/0xdfc0fb148a39db0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f6d expref: 16781 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.703200:0:16477:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16781:1960:x1796714882446912:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.703204:0:16477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562812 00010000:00010000:1.0:1713481296.703206:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077238fc0/0xdfc0fb148a39db0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f6d expref: 16781 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703214:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077238fc0, rc 0) 00000100:00100000:0.0:1713481296.703220:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.703225:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16780:1960:x1796714882447040:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.703229:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562813 00000100:00100000:3.0:1713481296.703233:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447168 00000100:00100000:3.0:1713481296.703235:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447168 00000100:00100000:0.0:1713481296.703239:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.703245:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447296 00000100:00100000:1.0:1713481296.703246:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447296 00000100:00100000:0.0:1713481296.703252:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.703252:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562814 00000100:00100000:3.0:1713481296.703257:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16781:1960:x1796714882447168:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.703261:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.703267:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.703268:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132024d80/0xdfc0fb148a39db7 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x977f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f7b expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.703269:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447424 00000100:00100000:1.0:1713481296.703270:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447424 00000100:00100000:2.0:1713481296.703275:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447552 00002000:00010000:3.0:1713481296.703276:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x977f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.703278:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562815 00000100:00100000:0.0:1713481296.703279:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.703279:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447552 00000100:00100000:1.0:1713481296.703281:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16784:1960:x1796714882447296:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.703282:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703283:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703285:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703286:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132024d80/0xdfc0fb148a39db7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f7b expref: 16784 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.703288:0:16508:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447680 00000100:00100000:0.0:1713481296.703289:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.703290:0:16508:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447680 00010000:00010000:1.0:1713481296.703292:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007723aac0/0xdfc0fb148a39dbe lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f89 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.703293:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132024d80/0xdfc0fb148a39db7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x977f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f7b expref: 16785 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703297:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.703297:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132024d80, rc 0) 00002000:00010000:1.0:1713481296.703298:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9780:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.703304:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703304:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.703306:0:16508:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447808 00010000:00010000:1.0:1713481296.703307:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007723aac0/0xdfc0fb148a39dbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f89 expref: 16786 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.703307:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16786:1960:x1796714882447168:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.703308:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.703308:0:16508:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447808 00000100:00100000:3.0:1713481296.703312:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562814 00010000:00010000:1.0:1713481296.703313:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007723aac0/0xdfc0fb148a39dbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f89 expref: 16787 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703317:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007723aac0, rc 0) 00000100:00100000:0.0:1713481296.703318:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.703319:0:16508:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447936 00000100:00100000:2.0:1713481296.703321:0:16508:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447936 00000100:00100000:3.0:1713481296.703325:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448064 00000100:00100000:1.0:1713481296.703327:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16787:1960:x1796714882447296:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.703327:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448064 00000100:00100000:0.0:1713481296.703330:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.703331:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562815 00000100:00100000:2.0:1713481296.703341:0:16508:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448192 00000100:00100000:2.0:1713481296.703343:0:16508:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448192 00000100:00100000:1.0:1713481296.703346:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448320 00000100:00100000:1.0:1713481296.703347:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448320 00000100:00100000:3.0:1713481296.703349:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562816 00000100:00100000:3.0:1713481296.703353:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16789:1960:x1796714882447424:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.703357:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562817 00010000:00010000:3.0:1713481296.703357:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.703363:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16789:1960:x1796714882447680:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.703363:0:16508:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562818 00010000:00010000:3.0:1713481296.703365:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f832ac0/0xdfc0fb148a39dc5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48f97 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.703366:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562819 00000100:00100000:2.0:1713481296.703368:0:16508:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16789:1960:x1796714882447808:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.703369:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16789:1960:x1796714882447936:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.703370:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.703372:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1713481296.703372:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9781:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.703375:0:16508:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703377:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703378:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077239d40/0xdfc0fb148a39dcc lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9785:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fcf expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.703378:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703380:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135056ac0/0xdfc0fb148a39dd3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9783:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fb3 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.703380:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f832ac0/0xdfc0fb148a39dc5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f97 expref: 16790 pid: 16487 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.703384:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9785:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.703385:0:16508:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136662880/0xdfc0fb148a39dda lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9784:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fc1 expref: -99 pid: 16508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.703387:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f832ac0/0xdfc0fb148a39dc5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48f97 expref: 16791 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703389:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703389:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713481296.703391:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9783:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:3.0:1713481296.703391:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f832ac0, rc 0) 00010000:00010000:1.0:1713481296.703392:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077239d40/0xdfc0fb148a39dcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fcf expref: 16791 pid: 16481 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.703395:0:16508:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9784:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.703398:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077239d40/0xdfc0fb148a39dcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fcf expref: 16792 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.703400:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703401:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.703401:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16793:1960:x1796714882447424:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.703403:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077239d40, rc 0) 00010000:00010000:2.0:1713481296.703403:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.703404:0:16508:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703405:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135056ac0/0xdfc0fb148a39dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fb3 expref: 16793 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.703405:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562816 00010000:00010000:2.0:1713481296.703408:0:16508:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136662880/0xdfc0fb148a39dda lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fc1 expref: 16793 pid: 16508 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.703411:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16793:1960:x1796714882447936:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.703415:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562819 00010000:00010000:0.0:1713481296.703416:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135056ac0/0xdfc0fb148a39dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fb3 expref: 16792 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.703417:0:16508:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136662880/0xdfc0fb148a39dda lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fc1 expref: 16792 pid: 16508 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.703420:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562820 00010000:00010000:0.0:1713481296.703423:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135056ac0, rc 0) 00000100:00100000:3.0:1713481296.703423:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882448064:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.703425:0:16508:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136662880, rc 0) 00000100:00100000:1.0:1713481296.703426:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562821 00010000:00010000:3.0:1713481296.703427:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.703429:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882448192:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.703432:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703434:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8321c0/0xdfc0fb148a39de1 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9786:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fdd expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.703436:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882447680:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.703437:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918d6640/0xdfc0fb148a39de8 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9787:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48feb expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.703439:0:16508:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882447808:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (148us total) trans 0 rc 0/0 00002000:00010000:3.0:1713481296.703440:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9786:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.703441:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562817 00002000:00010000:1.0:1713481296.703444:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9787:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.703445:0:16508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562818 00010000:00010000:3.0:1713481296.703445:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703446:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703449:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703449:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8321c0/0xdfc0fb148a39de1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fdd expref: 16793 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703450:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703452:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918d6640/0xdfc0fb148a39de8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48feb expref: 16792 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703455:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8321c0/0xdfc0fb148a39de1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fdd expref: 16792 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703457:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562822 00010000:00010000:1.0:1713481296.703458:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918d6640/0xdfc0fb148a39de8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48feb expref: 16791 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703459:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8321c0, rc 0) 00000100:00100000:0.0:1713481296.703461:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882448320:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.703462:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918d6640, rc 0) 00010000:00010000:0.0:1713481296.703466:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.703468:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882448064:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.703471:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882448192:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.703472:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562820 00010000:00010000:0.0:1713481296.703473:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135055f80/0xdfc0fb148a39def lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9788:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ff9 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.703475:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562821 00002000:00010000:0.0:1713481296.703482:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9788:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.703483:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562823 00000100:00100000:3.0:1713481296.703487:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16790:1960:x1796714882447552:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.703488:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703490:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703491:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.703493:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135055f80/0xdfc0fb148a39def lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ff9 expref: 16790 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703498:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baf0000/0xdfc0fb148a39df6 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9782:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fa5 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.703501:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135055f80/0xdfc0fb148a39def lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ff9 expref: 16790 pid: 16544 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1713481296.703504:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9782:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.703507:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135055f80, rc 0) 00010000:00010000:3.0:1713481296.703509:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703510:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703512:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf0000/0xdfc0fb148a39df6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fa5 expref: 16791 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703518:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882448320:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (187us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.703519:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012baf0000/0xdfc0fb148a39df6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fa5 expref: 16791 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703523:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf0000, rc 0) 00000100:00100000:0.0:1713481296.703524:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562822 00000100:00100000:2.0:1713481296.703526:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.703531:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16791:1960:x1796714882447552:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.703536:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562823 00000100:00100000:0.0:1713481296.703539:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448448 00000100:00100000:0.0:1713481296.703541:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448448 00000100:00100000:0.0:1713481296.703555:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562824 00000100:00100000:0.0:1713481296.703558:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16790:1960:x1796714882448448:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.703560:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.703562:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.703565:0:15547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448576 00000100:00100000:3.0:1713481296.703567:0:15547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448576 00010000:00010000:0.0:1713481296.703571:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092bc8d80/0xdfc0fb148a39dfd lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49007 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.703577:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9789:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.703581:0:15547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562825 00010000:00010000:0.0:1713481296.703583:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703584:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.703585:0:15547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16792:1960:x1796714882448576:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.703587:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092bc8d80/0xdfc0fb148a39dfd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49007 expref: 16792 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703589:0:15547:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.703593:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092bc8d80/0xdfc0fb148a39dfd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49007 expref: 16792 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.703594:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.703596:0:15547:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baf1d40/0xdfc0fb148a39e04 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x978a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49015 expref: -99 pid: 15547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.703598:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092bc8d80, rc 0) 00000100:00100000:1.0:1713481296.703604:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448704 00002000:00010000:3.0:1713481296.703604:0:15547:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x978a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.703605:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448704 00000100:00100000:0.0:1713481296.703607:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16793:1960:x1796714882448448:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (83us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.703609:0:15547:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703610:0:15547:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.703611:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562824 00010000:00010000:3.0:1713481296.703614:0:15547:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf1d40/0xdfc0fb148a39e04 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49015 expref: 16794 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.703617:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562826 00000100:00100000:1.0:1713481296.703620:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16793:1960:x1796714882448704:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.703620:0:15547:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012baf1d40/0xdfc0fb148a39e04 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49015 expref: 16793 pid: 15547 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703623:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703625:0:15547:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf1d40, rc 0) 00000100:00100000:2.0:1713481296.703629:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.703631:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918d4b40/0xdfc0fb148a39e0b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x978b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49023 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.703634:0:15547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16793:1960:x1796714882448576:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (75us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.703638:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x978b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:3.0:1713481296.703638:0:15547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562825 00010000:00010000:1.0:1713481296.703644:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703644:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703648:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918d4b40/0xdfc0fb148a39e0b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49023 expref: 16793 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703649:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448832 00000100:00100000:0.0:1713481296.703651:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448832 00010000:00010000:1.0:1713481296.703654:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918d4b40/0xdfc0fb148a39e0b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49023 expref: 16794 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703658:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918d4b40, rc 0) 00000100:00100000:0.0:1713481296.703677:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562827 00000100:00100000:2.0:1713481296.703681:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.703682:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16794:1960:x1796714882448832:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.703686:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.703686:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16794:1960:x1796714882448704:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.703690:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562826 00000100:00100000:3.0:1713481296.703690:0:16464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448960 00010000:00010000:0.0:1713481296.703692:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092bcad00/0xdfc0fb148a39e12 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x978c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49031 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.703693:0:16464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448960 00002000:00010000:0.0:1713481296.703700:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x978c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.703704:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562828 00000100:00100000:2.0:1713481296.703704:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.703705:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703706:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.703708:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16795:1960:x1796714882448960:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.703709:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092bcad00/0xdfc0fb148a39e12 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49031 expref: 16795 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.703710:0:16464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449088 00000100:00100000:3.0:1713481296.703711:0:16464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449088 00010000:00010000:1.0:1713481296.703712:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.703715:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092bcad00/0xdfc0fb148a39e12 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49031 expref: 16796 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.703719:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092bcad00, rc 0) 00010000:00010000:1.0:1713481296.703720:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a800240/0xdfc0fb148a39e19 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x978d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4903f expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.703722:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.703722:0:16464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562829 00000100:00100000:3.0:1713481296.703725:0:16464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16796:1960:x1796714882449088:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.703726:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x978d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.703729:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16797:1960:x1796714882448832:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (101us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.703730:0:16464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.703731:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703732:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.703733:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562827 00010000:00010000:1.0:1713481296.703735:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a800240/0xdfc0fb148a39e19 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4903f expref: 16797 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703737:0:16464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baf0fc0/0xdfc0fb148a39e20 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x978e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4904d expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.703740:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.703741:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007a800240/0xdfc0fb148a39e19 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4903f expref: 16796 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703745:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449216 00010000:00010000:1.0:1713481296.703745:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a800240, rc 0) 00002000:00010000:3.0:1713481296.703745:0:16464:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x978e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.703746:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449216 00010000:00010000:3.0:1713481296.703751:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703752:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.703753:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16798:1960:x1796714882448960:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.703755:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449344 00010000:00010000:3.0:1713481296.703755:0:16464:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf0fc0/0xdfc0fb148a39e20 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4904d expref: 16798 pid: 16464 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703757:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449344 00000100:00100000:1.0:1713481296.703758:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562828 00010000:00010000:3.0:1713481296.703762:0:16464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012baf0fc0/0xdfc0fb148a39e20 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4904d expref: 16799 pid: 16464 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703765:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562830 00010000:00010000:3.0:1713481296.703766:0:16464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf0fc0, rc 0) 00000100:00100000:0.0:1713481296.703767:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16799:1960:x1796714882449216:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.703771:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.703777:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092bc8240/0xdfc0fb148a39e27 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x978f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4905b expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.703777:0:16464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16799:1960:x1796714882449088:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (73us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.703781:0:16464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562829 00002000:00010000:0.0:1713481296.703784:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x978f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.703789:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703790:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703793:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092bc8240/0xdfc0fb148a39e27 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4905b expref: 16799 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.703799:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092bc8240/0xdfc0fb148a39e27 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x978f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4905b expref: 16799 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.703803:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092bc8240, rc 0) 00000100:00100000:3.0:1713481296.703808:0:16464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562831 00000100:00100000:3.0:1713481296.703810:0:16464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16798:1960:x1796714882449344:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.703812:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16798:1960:x1796714882449216:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (91us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.703815:0:16464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.703816:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562830 00000100:00100000:2.0:1713481296.703820:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.703821:0:16464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baf1f80/0xdfc0fb148a39e2e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49069 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.703828:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449472 00002000:00010000:3.0:1713481296.703828:0:16464:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9790:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.703831:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449472 00000100:00100000:2.0:1713481296.703833:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.703833:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703835:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703837:0:16464:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf1f80/0xdfc0fb148a39e2e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49069 expref: 16799 pid: 16464 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.703842:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.703843:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449600 00010000:00010000:3.0:1713481296.703843:0:16464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012baf1f80/0xdfc0fb148a39e2e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49069 expref: 16799 pid: 16464 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703845:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449600 00010000:00010000:3.0:1713481296.703847:0:16464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf1f80, rc 0) 00000100:00100000:2.0:1713481296.703850:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.703854:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449728 00000100:00100000:3.0:1713481296.703856:0:16464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16800:1960:x1796714882449344:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.703857:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449728 00000100:00100000:3.0:1713481296.703861:0:16464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562831 00000100:00100000:2.0:1713481296.703863:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449856 00000100:00100000:2.0:1713481296.703865:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449856 00000100:00100000:0.0:1713481296.703871:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562832 00000100:00100000:0.0:1713481296.703875:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16801:1960:x1796714882449472:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:3.0:1713481296.703878:0:16464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562833 00010000:00010000:0.0:1713481296.703882:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.703884:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562834 00000100:00100000:3.0:1713481296.703885:0:16464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16801:1960:x1796714882449600:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.703888:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16801:1960:x1796714882449728:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.703889:0:16464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.703891:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092bcaac0/0xdfc0fb148a39e35 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49077 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.703893:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703895:0:16464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baf18c0/0xdfc0fb148a39e3c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49085 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.703899:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136661b00/0xdfc0fb148a39e43 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49093 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.703900:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9791:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:3.0:1713481296.703902:0:16464:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9792:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.703905:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562835 00002000:00010000:2.0:1713481296.703907:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9793:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.703908:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.703908:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16803:1960:x1796714882449856:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1713481296.703908:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.703909:0:16464:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703910:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703912:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.703912:0:16464:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baf18c0/0xdfc0fb148a39e3c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49085 expref: 16804 pid: 16464 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.703913:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.703914:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092bcaac0/0xdfc0fb148a39e35 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49077 expref: 16804 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.703914:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.703917:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136661b00/0xdfc0fb148a39e43 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49093 expref: 16804 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.703918:0:16464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012baf18c0/0xdfc0fb148a39e3c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49085 expref: 16804 pid: 16464 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.703919:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a800fc0/0xdfc0fb148a39e4a lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490a1 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.703921:0:16464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baf18c0, rc 0) 00010000:00010000:0.0:1713481296.703923:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092bcaac0/0xdfc0fb148a39e35 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49077 expref: 16804 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.703923:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136661b00/0xdfc0fb148a39e43 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49093 expref: 16804 pid: 16525 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.703926:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9794:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.703928:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136661b00, rc 0) 00010000:00010000:0.0:1713481296.703929:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092bcaac0, rc 0) 00000100:00100000:3.0:1713481296.703930:0:16464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_036:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16805:1960:x1796714882449600:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 48us (96us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.703932:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.703933:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.703934:0:16464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562833 00010000:00010000:1.0:1713481296.703935:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a800fc0/0xdfc0fb148a39e4a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490a1 expref: 16805 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.703938:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16805:1960:x1796714882449728:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 50us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.703941:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007a800fc0/0xdfc0fb148a39e4a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490a1 expref: 16805 pid: 16487 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.703942:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16805:1960:x1796714882449472:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.703942:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562834 00010000:00010000:1.0:1713481296.703945:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a800fc0, rc 0) 00000100:00100000:0.0:1713481296.703947:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562832 00000100:00100000:1.0:1713481296.703954:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16804:1960:x1796714882449856:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.703957:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562835 00000100:00100000:2.0:1713481296.703971:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.703976:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449984 00000100:00100000:1.0:1713481296.703978:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449984 00000100:00100000:1.0:1713481296.703987:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562836 00000100:00100000:1.0:1713481296.703990:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16802:1960:x1796714882449984:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.703993:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704000:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920158c0/0xdfc0fb148a39e51 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490af expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.704007:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9795:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.704012:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704013:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704016:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920158c0/0xdfc0fb148a39e51 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490af expref: 16803 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704021:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800920158c0/0xdfc0fb148a39e51 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490af expref: 16803 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704024:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920158c0, rc 0) 00000100:00100000:1.0:1713481296.704031:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16803:1960:x1796714882449984:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.704035:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562836 00000100:00100000:2.0:1713481296.704036:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.704043:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450112 00000100:00100000:1.0:1713481296.704044:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450112 00000100:00100000:2.0:1713481296.704056:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.704058:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562837 00000100:00100000:1.0:1713481296.704061:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16803:1960:x1796714882450112:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.704065:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450240 00010000:00010000:1.0:1713481296.704065:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.704066:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.704068:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450240 00010000:00010000:1.0:1713481296.704071:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920161c0/0xdfc0fb148a39e58 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9796:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490bd expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.704075:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.704077:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9796:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.704082:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.704082:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.704083:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450368 00010000:00010000:1.0:1713481296.704083:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.704085:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450368 00010000:00010000:1.0:1713481296.704086:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920161c0/0xdfc0fb148a39e58 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490bd expref: 16805 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704091:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800920161c0/0xdfc0fb148a39e58 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490bd expref: 16806 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.704091:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.704094:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450496 00000100:00100000:0.0:1713481296.704096:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450496 00010000:00010000:1.0:1713481296.704096:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920161c0, rc 0) 00000100:00100000:2.0:1713481296.704099:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450624 00000100:00100000:2.0:1713481296.704101:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450624 00000100:00100000:1.0:1713481296.704104:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16808:1960:x1796714882450112:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.704106:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448128 00000100:00100000:1.0:1713481296.704107:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562837 00000100:00100000:0.0:1713481296.704108:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448128 00000100:00100000:2.0:1713481296.704113:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562838 00000100:00100000:2.0:1713481296.704115:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16807:1960:x1796714882450240:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.704116:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562839 00000100:00100000:1.0:1713481296.704133:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16807:1960:x1796714882450368:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.704134:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704137:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.704141:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800785706c0/0xdfc0fb148a39e5f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9797:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490cb expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.704143:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092017600/0xdfc0fb148a39e66 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9798:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490d9 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.704144:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562840 00002000:00010000:2.0:1713481296.704148:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9797:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.704149:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16807:1960:x1796714882450496:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.704149:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9798:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.704154:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704154:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704155:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704155:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704156:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704157:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800785706c0/0xdfc0fb148a39e5f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490cb expref: 16809 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704158:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092017600/0xdfc0fb148a39e66 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490d9 expref: 16809 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704163:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800785706c0/0xdfc0fb148a39e5f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490cb expref: 16809 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704164:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092017600/0xdfc0fb148a39e66 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490d9 expref: 16809 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.704165:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092bcbcc0/0xdfc0fb148a39e6d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x9799:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490e7 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.704167:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800785706c0, rc 0) 00010000:00010000:1.0:1713481296.704168:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092017600, rc 0) 00002000:00010000:0.0:1713481296.704176:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9799:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.704177:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16809:1960:x1796714882450240:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.704179:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16809:1960:x1796714882450368:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.704181:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562838 00000100:00100000:1.0:1713481296.704183:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562839 00010000:00010000:0.0:1713481296.704184:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704185:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704190:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092bcbcc0/0xdfc0fb148a39e6d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490e7 expref: 16809 pid: 16481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.704191:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562841 00000100:00100000:2.0:1713481296.704194:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16808:1960:x1796714882450624:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.704196:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562842 00000100:00100000:1.0:1713481296.704198:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26883:1960:x1796714882448128:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.704199:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092bcbcc0/0xdfc0fb148a39e6d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490e7 expref: 16808 pid: 16481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704199:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704201:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.704204:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b810240/0xdfc0fb148a39e74 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x979a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490f5 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.704206:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092bcbcc0, rc 0) 00010000:00010000:1.0:1713481296.704207:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092017cc0/0xdfc0fb148a39e7b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fe4 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.704210:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x979a:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.704214:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.704214:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704215:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704217:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b810240/0xdfc0fb148a39e74 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490f5 expref: 16809 pid: 16515 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.704218:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16809:1960:x1796714882450496:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (142us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.704218:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704219:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704221:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092017cc0/0xdfc0fb148a39e7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fe4 expref: 26884 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.704223:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562840 00010000:00010000:2.0:1713481296.704223:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b810240/0xdfc0fb148a39e74 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490f5 expref: 16809 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704226:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092017cc0/0xdfc0fb148a39e7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fe4 expref: 26884 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704229:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b810240, rc 0) 00010000:00010000:1.0:1713481296.704230:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092017cc0, rc 0) 00000100:00100000:1.0:1713481296.704240:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26884:1960:x1796714882448128:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.704240:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16808:1960:x1796714882450624:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.704243:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562842 00000100:00100000:2.0:1713481296.704246:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562841 00000100:00100000:0.0:1713481296.704264:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.704283:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448256 00000100:00100000:2.0:1713481296.704286:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448256 00000100:00100000:0.0:1713481296.704288:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.704306:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.704306:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448384 00000100:00100000:2.0:1713481296.704308:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448384 00000100:00100000:0.0:1713481296.704318:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.704318:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448512 00000100:00100000:2.0:1713481296.704319:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448512 00000100:00100000:1.0:1713481296.704320:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562843 00000100:00100000:1.0:1713481296.704323:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26886:1960:x1796714882448256:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.704325:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448640 00000100:00100000:0.0:1713481296.704327:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.704327:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.704327:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448640 00010000:00010000:1.0:1713481296.704333:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d6e640/0xdfc0fb148a39e82 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48ff2 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.704333:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448768 00000100:00100000:2.0:1713481296.704334:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448768 00000100:00100000:0.0:1713481296.704338:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.704341:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562844 00002000:00010000:1.0:1713481296.704343:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.704344:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26888:1960:x1796714882448384:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.704348:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704349:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704349:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704351:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d6e640/0xdfc0fb148a39e82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ff2 expref: 26889 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.704352:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.704357:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d6e640/0xdfc0fb148a39e82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48ff2 expref: 26889 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704357:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a39e89 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49000 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.704361:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d6e640, rc 0) 00000100:00100000:0.0:1713481296.704364:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448896 00000100:00100000:0.0:1713481296.704367:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448896 00002000:00010000:2.0:1713481296.704367:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.704369:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26889:1960:x1796714882448256:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.704372:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562843 00010000:00010000:2.0:1713481296.704376:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704377:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.704380:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449024 00010000:00010000:2.0:1713481296.704381:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a39e89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49000 expref: 26890 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.704382:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449024 00000100:00100000:1.0:1713481296.704383:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562845 00000100:00100000:1.0:1713481296.704385:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882448512:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.704389:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.704391:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8118c0/0xdfc0fb148a39e89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49000 expref: 26891 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704394:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d6d440/0xdfc0fb148a39e90 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4900e expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.704395:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562846 00010000:00010000:2.0:1713481296.704398:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8118c0, rc 0) 00002000:00010000:1.0:1713481296.704399:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.704400:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882448640:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.704404:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704405:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704406:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704407:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d6d440/0xdfc0fb148a39e90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4900e expref: 26892 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.704410:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26892:1960:x1796714882448384:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.704415:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d6d440/0xdfc0fb148a39e90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4900e expref: 26892 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.704415:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562844 00010000:00010000:0.0:1713481296.704417:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092969680/0xdfc0fb148a39e97 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4901c expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.704419:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d6d440, rc 0) 00000100:00100000:1.0:1713481296.704426:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882448512:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (121us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.704428:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.704428:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562847 00000100:00100000:1.0:1713481296.704431:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562845 00000100:00100000:2.0:1713481296.704432:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26892:1960:x1796714882448768:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.704435:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704437:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704437:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.704439:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562848 00010000:00010000:0.0:1713481296.704441:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092969680/0xdfc0fb148a39e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4901c expref: 26891 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.704441:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882448896:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.704444:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.704444:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c59b00/0xdfc0fb148a39e9e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4902a expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.704450:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092969680/0xdfc0fb148a39e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4901c expref: 26891 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704450:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801225598c0/0xdfc0fb148a39ea5 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49038 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.704455:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.704456:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.704458:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092969680, rc 0) 00010000:00010000:1.0:1713481296.704460:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704461:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704461:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704462:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704463:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801225598c0/0xdfc0fb148a39ea5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49038 expref: 26893 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704465:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c59b00/0xdfc0fb148a39e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4902a expref: 26893 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704469:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801225598c0/0xdfc0fb148a39ea5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49038 expref: 26893 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704470:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c59b00/0xdfc0fb148a39e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4902a expref: 26893 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.704472:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26893:1960:x1796714882448640:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.704472:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801225598c0, rc 0) 00010000:00010000:2.0:1713481296.704475:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c59b00, rc 0) 00000100:00100000:0.0:1713481296.704477:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562846 00000100:00100000:1.0:1713481296.704479:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26893:1960:x1796714882448896:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 37us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.704483:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562848 00000100:00100000:2.0:1713481296.704484:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26893:1960:x1796714882448768:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.704487:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562847 00000100:00100000:1.0:1713481296.704492:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562849 00000100:00100000:1.0:1713481296.704495:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882449024:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.704498:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704503:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff0fa80/0xdfc0fb148a39eac lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49046 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.704509:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.704513:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704514:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704516:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff0fa80/0xdfc0fb148a39eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49046 expref: 26891 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704521:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff0fa80/0xdfc0fb148a39eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49046 expref: 26891 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704524:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff0fa80, rc 0) 00000100:00100000:1.0:1713481296.704531:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882449024:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 36us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.704534:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562849 00000100:00100000:0.0:1713481296.704552:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.704564:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449152 00000100:00100000:1.0:1713481296.704566:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449152 00000100:00100000:0.0:1713481296.704572:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.704576:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449280 00000100:00100000:1.0:1713481296.704577:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449280 00000100:00100000:1.0:1713481296.704584:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562850 00000100:00100000:1.0:1713481296.704586:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26892:1960:x1796714882449152:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.704589:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.704590:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704597:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff0e880/0xdfc0fb148a39eb3 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49054 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.704604:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafaa:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.704609:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704609:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704612:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff0e880/0xdfc0fb148a39eb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49054 expref: 26893 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704617:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff0e880/0xdfc0fb148a39eb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49054 expref: 26893 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.704622:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff0e880, rc 0) 00000100:00100000:0.0:1713481296.704630:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.704630:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26893:1960:x1796714882449152:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.704633:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562850 00000100:00100000:1.0:1713481296.704644:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449408 00000100:00100000:1.0:1713481296.704646:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449408 00000100:00100000:1.0:1713481296.704652:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449536 00000100:00100000:1.0:1713481296.704654:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449536 00000100:00100000:1.0:1713481296.704678:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562851 00000100:00100000:1.0:1713481296.704681:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26894:1960:x1796714882449280:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.704685:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.704687:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562852 00010000:00010000:1.0:1713481296.704691:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff0e640/0xdfc0fb148a39eba lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49062 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.704692:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26894:1960:x1796714882449408:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.704694:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562853 00000100:00100000:2.0:1713481296.704697:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26894:1960:x1796714882449536:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.704700:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.704700:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafab:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.704702:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704706:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704707:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704709:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092968000/0xdfc0fb148a39ec1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49070 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.704709:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff0e640/0xdfc0fb148a39eba lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49062 expref: 26895 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704709:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a39ec8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4907e expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.704715:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff0e640/0xdfc0fb148a39eba lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49062 expref: 26895 pid: 16495 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.704716:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafad:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:0.0:1713481296.704719:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafac:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.704719:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff0e640, rc 0) 00010000:00010000:2.0:1713481296.704722:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704723:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704726:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704726:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a39ec8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4907e expref: 26897 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.704727:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26897:1960:x1796714882449280:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.704728:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.704730:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562851 00010000:00010000:0.0:1713481296.704732:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092968000/0xdfc0fb148a39ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49070 expref: 26897 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704732:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008693a880/0xdfc0fb148a39ec8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4907e expref: 26897 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704736:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008693a880, rc 0) 00010000:00010000:0.0:1713481296.704741:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092968000/0xdfc0fb148a39ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49070 expref: 26896 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.704745:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26896:1960:x1796714882449536:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (117us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.704749:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092968000, rc 0) 00000100:00100000:2.0:1713481296.704749:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562853 00000100:00100000:0.0:1713481296.704763:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26895:1960:x1796714882449408:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.704769:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562852 00000100:00100000:0.0:1713481296.704800:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.704812:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449664 00000100:00100000:1.0:1713481296.704814:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449664 00000100:00100000:1.0:1713481296.704828:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562854 00000100:00100000:1.0:1713481296.704830:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26895:1960:x1796714882449664:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.704834:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.704837:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.704841:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff0d440/0xdfc0fb148a39ecf lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4908c expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.704847:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafae:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.704848:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449792 00000100:00100000:2.0:1713481296.704850:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449792 00010000:00010000:1.0:1713481296.704853:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704854:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.704856:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.704856:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff0d440/0xdfc0fb148a39ecf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4908c expref: 26897 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.704860:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882449920 00000100:00100000:2.0:1713481296.704861:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882449920 00010000:00010000:1.0:1713481296.704865:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff0d440/0xdfc0fb148a39ecf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4908c expref: 26898 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.704868:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.704869:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff0d440, rc 0) 00000100:00100000:2.0:1713481296.704871:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450048 00000100:00100000:2.0:1713481296.704872:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450048 00000100:00100000:1.0:1713481296.704878:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26899:1960:x1796714882449664:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.704879:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.704880:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562855 00000100:00100000:1.0:1713481296.704883:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562854 00000100:00100000:2.0:1713481296.704883:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26899:1960:x1796714882449792:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.704888:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.704891:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.704893:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b02880/0xdfc0fb148a39ed6 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4909a expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.704895:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450176 00000100:00100000:1.0:1713481296.704897:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450176 00002000:00010000:2.0:1713481296.704900:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafaf:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.704902:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.704905:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.704906:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450304 00010000:00010000:2.0:1713481296.704906:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.704907:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450304 00010000:00010000:2.0:1713481296.704908:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b02880/0xdfc0fb148a39ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4909a expref: 26900 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.704912:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450432 00000100:00100000:0.0:1713481296.704914:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450432 00010000:00010000:2.0:1713481296.704914:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b02880/0xdfc0fb148a39ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4909a expref: 26901 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.704915:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562856 00000100:00100000:1.0:1713481296.704917:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1960:x1796714882449920:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.704919:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b02880, rc 0) 00010000:00010000:1.0:1713481296.704921:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704926:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f385d40/0xdfc0fb148a39edd lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490a8 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.704927:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1960:x1796714882449792:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.704928:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562857 00000100:00100000:2.0:1713481296.704931:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562855 00000100:00100000:0.0:1713481296.704932:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1960:x1796714882450048:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.704932:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.704938:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704938:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704938:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.704941:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f385d40/0xdfc0fb148a39edd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490a8 expref: 26902 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.704942:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562858 00000100:00100000:2.0:1713481296.704944:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1960:x1796714882450176:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.704946:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009296af40/0xdfc0fb148a39ee4 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490b6 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.704946:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f385d40/0xdfc0fb148a39edd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490a8 expref: 26902 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704948:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.704953:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b018c0/0xdfc0fb148a39eeb lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490c4 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.704954:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f385d40, rc 0) 00002000:00010000:0.0:1713481296.704955:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.704958:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.704961:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26904:1960:x1796714882449920:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (106us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.704962:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.704963:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704963:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.704964:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.704965:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562856 00010000:00010000:0.0:1713481296.704966:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009296af40/0xdfc0fb148a39ee4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490b6 expref: 26904 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704966:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b018c0/0xdfc0fb148a39eeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490c4 expref: 26904 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.704973:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b018c0/0xdfc0fb148a39eeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490c4 expref: 26904 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.704975:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009296af40/0xdfc0fb148a39ee4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490b6 expref: 26903 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.704976:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562859 00000100:00100000:1.0:1713481296.704978:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26903:1960:x1796714882450304:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.704980:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b018c0, rc 0) 00010000:00010000:0.0:1713481296.704981:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009296af40, rc 0) 00010000:00010000:1.0:1713481296.704982:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.704987:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f384240/0xdfc0fb148a39ef2 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490d2 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.704990:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26903:1960:x1796714882450176:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.704992:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26903:1960:x1796714882450048:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 60us (125us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.704993:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.704996:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562858 00010000:00010000:1.0:1713481296.704998:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.704999:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562857 00010000:00010000:1.0:1713481296.704999:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705001:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f384240/0xdfc0fb148a39ef2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490d2 expref: 26904 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705006:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f384240/0xdfc0fb148a39ef2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490d2 expref: 26903 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705010:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f384240, rc 0) 00000100:00100000:2.0:1713481296.705012:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562860 00000100:00100000:1.0:1713481296.705016:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1960:x1796714882450304:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.705016:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1960:x1796714882450432:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.705020:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562859 00010000:00010000:2.0:1713481296.705022:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.705031:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a39ef9 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490e0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.705036:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.705043:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.705046:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.705050:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.705052:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450560 00010000:00010000:2.0:1713481296.705052:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.705054:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450560 00000100:00100000:0.0:1713481296.705055:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.705056:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a39ef9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490e0 expref: 26902 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.705062:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447744 00000100:00100000:1.0:1713481296.705063:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447744 00010000:00010000:2.0:1713481296.705065:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941b4d80/0xdfc0fb148a39ef9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490e0 expref: 26903 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.705068:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882447872 00000100:00100000:1.0:1713481296.705069:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882447872 00010000:00010000:2.0:1713481296.705072:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941b4d80, rc 0) 00000100:00100000:1.0:1713481296.705075:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562861 00000100:00100000:1.0:1713481296.705078:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26905:1960:x1796714882450560:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.705082:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.705085:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26905:1960:x1796714882450432:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (182us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.705087:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f386400/0xdfc0fb148a39f00 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490ee expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.705090:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562860 00002000:00010000:1.0:1713481296.705094:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705100:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705101:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705103:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f386400/0xdfc0fb148a39f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490ee expref: 26905 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.705107:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562862 00010000:00010000:1.0:1713481296.705109:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f386400/0xdfc0fb148a39f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490ee expref: 26905 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.705111:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26905:1959:x1796714882447744:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.705113:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f386400, rc 0) 00000100:00100000:1.0:1713481296.705135:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26905:1960:x1796714882450560:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 56us (99us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.705136:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.705139:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562861 00010000:00010000:2.0:1713481296.705146:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941a9680/0xdfc0fb148a39f07 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xaf9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fba expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.705154:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.705154:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562863 00000100:00100000:1.0:1713481296.705156:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26904:1959:x1796714882447872:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.705156:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xaf9f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705160:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.705165:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.705166:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882448000 00010000:00010000:2.0:1713481296.705166:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705167:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f385f80/0xdfc0fb148a39f0e lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fc8 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.705168:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882448000 00010000:00010000:2.0:1713481296.705170:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941a9680/0xdfc0fb148a39f07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fba expref: 26905 pid: 16545 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.705173:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.705178:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562864 00010000:00010000:1.0:1713481296.705178:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705179:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705179:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941a9680/0xdfc0fb148a39f07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xaf9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fba expref: 26907 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705181:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f385f80/0xdfc0fb148a39f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fc8 expref: 26907 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.705182:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26907:1959:x1796714882448000:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.705186:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941a9680, rc 0) 00010000:00010000:1.0:1713481296.705187:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f385f80/0xdfc0fb148a39f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fc8 expref: 26907 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.705188:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.705191:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f385f80, rc 0) 00010000:00010000:0.0:1713481296.705194:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7ef840/0xdfc0fb148a39f15 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa48fd6 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.705200:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26907:1959:x1796714882447872:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.705200:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26907:1959:x1796714882447744:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 87us (152us total) trans 0 rc 0/0 00002000:00010000:0.0:1713481296.705202:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafa1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.705203:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562863 00010000:00010000:0.0:1713481296.705207:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.705207:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562862 00010000:00010000:0.0:1713481296.705208:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.705211:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7ef840/0xdfc0fb148a39f15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fd6 expref: 26908 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.705217:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7ef840/0xdfc0fb148a39f15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48fd6 expref: 26907 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.705221:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7ef840, rc 0) 00000100:00100000:0.0:1713481296.705234:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26906:1959:x1796714882448000:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.705238:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562864 00000100:00100000:2.0:1713481296.705253:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.705263:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450752 00000100:00100000:0.0:1713481296.705266:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450752 00000100:00100000:0.0:1713481296.705280:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562865 00000100:00100000:0.0:1713481296.705284:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16808:1960:x1796714882450752:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.705290:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.705293:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.705301:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7eed00/0xdfc0fb148a39f1c lrc: 2/0,0 mode: --/PR res: [0x280000408:0x979b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49103 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.705302:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450688 00000100:00100000:1.0:1713481296.705304:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450688 00002000:00010000:0.0:1713481296.705311:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x979b:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.705319:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562866 00010000:00010000:0.0:1713481296.705321:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.705321:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26906:1960:x1796714882450688:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.705323:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705325:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.705327:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7eed00/0xdfc0fb148a39f1c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49103 expref: 16809 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705334:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079b90b40/0xdfc0fb148a39f23 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa490fc expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.705334:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.705336:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7eed00/0xdfc0fb148a39f1c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49103 expref: 16809 pid: 16544 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.705340:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.705343:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7eed00, rc 0) 00010000:00010000:1.0:1713481296.705346:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705347:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705350:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079b90b40/0xdfc0fb148a39f23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490fc expref: 26907 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.705351:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450816 00000100:00100000:2.0:1713481296.705354:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450816 00010000:00010000:1.0:1713481296.705355:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880079b90b40/0xdfc0fb148a39f23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa490fc expref: 26907 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.705356:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16809:1960:x1796714882450752:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (103us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.705360:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079b90b40, rc 0) 00000100:00100000:0.0:1713481296.705362:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562865 00000100:00100000:1.0:1713481296.705369:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1960:x1796714882450688:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.705372:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562866 00000100:00100000:2.0:1713481296.705376:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562867 00000100:00100000:2.0:1713481296.705381:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26907:1960:x1796714882450816:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.705387:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.705396:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941aa880/0xdfc0fb148a39f2a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4910a expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.705401:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.705407:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.705411:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450880 00000100:00100000:1.0:1713481296.705413:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450880 00010000:00010000:2.0:1713481296.705416:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.705417:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.705417:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705422:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941aa880/0xdfc0fb148a39f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4910a expref: 26908 pid: 16512 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.705428:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451008 00000100:00100000:1.0:1713481296.705429:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451008 00010000:00010000:2.0:1713481296.705431:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941aa880/0xdfc0fb148a39f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4910a expref: 26908 pid: 16512 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.705436:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562868 00000100:00100000:1.0:1713481296.705439:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16810:1960:x1796714882450880:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.705439:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941aa880, rc 0) 00000100:00100000:0.0:1713481296.705440:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562869 00010000:00010000:1.0:1713481296.705443:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.705445:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16810:1960:x1796714882451008:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.705449:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079b91440/0xdfc0fb148a39f31 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x979c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49111 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.705452:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.705453:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1960:x1796714882450816:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 72us (119us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.705456:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x979c:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.705459:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562867 00010000:00010000:1.0:1713481296.705461:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.705462:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800784a2400/0xdfc0fb148a39f38 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x979d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4911f expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.705462:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705464:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079b91440/0xdfc0fb148a39f31 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49111 expref: 16811 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705470:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079b91440/0xdfc0fb148a39f31 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49111 expref: 16811 pid: 16525 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.705472:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x979d:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705477:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079b91440, rc 0) 00010000:00010000:0.0:1713481296.705479:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.705480:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.705484:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800784a2400/0xdfc0fb148a39f38 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4911f expref: 16812 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.705485:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16812:1960:x1796714882450880:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.705489:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562868 00010000:00010000:0.0:1713481296.705493:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800784a2400/0xdfc0fb148a39f38 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4911f expref: 16812 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.705500:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800784a2400, rc 0) 00000100:00100000:0.0:1713481296.705511:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16811:1960:x1796714882451008:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.705515:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562869 00000100:00100000:2.0:1713481296.705585:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.705596:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451136 00000100:00100000:1.0:1713481296.705598:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451136 00000100:00100000:1.0:1713481296.705607:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562870 00000100:00100000:1.0:1713481296.705609:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16811:1960:x1796714882451136:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.705613:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.705619:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079b92880/0xdfc0fb148a39f3f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x979e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4912d expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.705626:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x979e:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705631:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705632:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705634:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079b92880/0xdfc0fb148a39f3f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4912d expref: 16812 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705639:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079b92880/0xdfc0fb148a39f3f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4912d expref: 16812 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705643:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079b92880, rc 0) 00000100:00100000:2.0:1713481296.705647:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.705652:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16812:1960:x1796714882451136:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.705655:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562870 00000100:00100000:2.0:1713481296.705661:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.705676:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882450944 00000100:00100000:1.0:1713481296.705677:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882450944 00000100:00100000:2.0:1713481296.705682:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451072 00000100:00100000:2.0:1713481296.705685:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451072 00000100:00100000:1.0:1713481296.705691:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562871 00000100:00100000:1.0:1713481296.705694:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26909:1960:x1796714882450944:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.705698:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.705703:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086d96f40/0xdfc0fb148a39f46 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49118 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.705703:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562872 00000100:00100000:2.0:1713481296.705706:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26909:1960:x1796714882451072:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.705710:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.705711:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.705714:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.705715:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705716:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705717:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c6d4480/0xdfc0fb148a39f4d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49126 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.705718:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086d96f40/0xdfc0fb148a39f46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49118 expref: 26910 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705724:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086d96f40/0xdfc0fb148a39f46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49118 expref: 26910 pid: 16544 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.705725:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafb9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705728:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086d96f40, rc 0) 00010000:00010000:2.0:1713481296.705730:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705731:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705734:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c6d4480/0xdfc0fb148a39f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49126 expref: 26911 pid: 16515 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.705736:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26911:1960:x1796714882450944:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.705741:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562871 00010000:00010000:2.0:1713481296.705741:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c6d4480/0xdfc0fb148a39f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49126 expref: 26911 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.705745:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c6d4480, rc 0) 00000100:00100000:1.0:1713481296.705749:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451264 00000100:00100000:0.0:1713481296.705750:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.705751:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451264 00000100:00100000:2.0:1713481296.705755:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26910:1960:x1796714882451072:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 49us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.705758:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451392 00000100:00100000:1.0:1713481296.705759:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451392 00000100:00100000:2.0:1713481296.705759:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562872 00000100:00100000:1.0:1713481296.705765:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562873 00000100:00100000:1.0:1713481296.705768:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16813:1960:x1796714882451264:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.705771:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562874 00010000:00010000:1.0:1713481296.705773:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.705773:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16813:1960:x1796714882451392:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.705778:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086d97a80/0xdfc0fb148a39f54 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x979f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4913b expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.705778:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.705784:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x979f:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.705784:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c6d6880/0xdfc0fb148a39f5b lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49149 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.705789:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.705790:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.705790:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713481296.705791:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705792:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086d97a80/0xdfc0fb148a39f54 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4913b expref: 16814 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.705796:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705797:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086d97a80/0xdfc0fb148a39f54 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x979f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4913b expref: 16815 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.705797:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705799:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c6d6880/0xdfc0fb148a39f5b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49149 expref: 16815 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705802:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086d97a80, rc 0) 00010000:00010000:2.0:1713481296.705805:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c6d6880/0xdfc0fb148a39f5b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49149 expref: 16815 pid: 16515 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.705809:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16815:1960:x1796714882451264:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (98us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.705809:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c6d6880, rc 0) 00000100:00100000:1.0:1713481296.705812:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562873 00000100:00100000:2.0:1713481296.705816:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16815:1960:x1796714882451392:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 42us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.705819:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562874 00000100:00100000:1.0:1713481296.705820:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451520 00000100:00100000:1.0:1713481296.705821:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451520 00000100:00100000:0.0:1713481296.705824:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.705830:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451648 00000100:00100000:1.0:1713481296.705831:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451648 00000100:00100000:2.0:1713481296.705833:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562875 00000100:00100000:2.0:1713481296.705835:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16815:1960:x1796714882451520:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.705839:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.705844:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013507f840/0xdfc0fb148a39f62 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49157 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.705845:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562876 00000100:00100000:1.0:1713481296.705848:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16815:1960:x1796714882451648:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.705849:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705851:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.705853:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705854:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.705857:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013507f840/0xdfc0fb148a39f62 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49157 expref: 16816 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705858:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b809f80/0xdfc0fb148a39f69 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49165 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.705862:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013507f840/0xdfc0fb148a39f62 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49157 expref: 16816 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.705865:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013507f840, rc 0) 00002000:00010000:1.0:1713481296.705867:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.705872:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705873:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.705875:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b809f80/0xdfc0fb148a39f69 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49165 expref: 16817 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705881:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b809f80/0xdfc0fb148a39f69 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49165 expref: 16817 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.705885:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b809f80, rc 0) 00000100:00100000:2.0:1713481296.705942:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16817:1960:x1796714882451520:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 104us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.705945:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16817:1960:x1796714882451648:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 95us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.705947:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562875 00000100:00100000:1.0:1713481296.705951:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562876 00000100:00100000:0.0:1713481296.705965:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.705978:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451776 00000100:00100000:1.0:1713481296.705981:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451776 00000100:00100000:1.0:1713481296.706002:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562877 00000100:00100000:1.0:1713481296.706005:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16816:1960:x1796714882451776:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706009:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.706015:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.706017:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b80b180/0xdfc0fb148a39f70 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49173 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.706023:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451904 00002000:00010000:1.0:1713481296.706024:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.706026:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451904 00010000:00010000:1.0:1713481296.706030:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706031:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706034:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b80b180/0xdfc0fb148a39f70 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49173 expref: 16818 pid: 16498 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.706038:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562878 00000100:00100000:0.0:1713481296.706042:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16818:1960:x1796714882451904:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706043:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b80b180/0xdfc0fb148a39f70 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49173 expref: 16818 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706047:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b80b180, rc 0) 00010000:00010000:0.0:1713481296.706048:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.706056:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16818:1960:x1796714882451776:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (94us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.706057:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd4d200/0xdfc0fb148a39f77 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49181 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.706060:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562877 00002000:00010000:0.0:1713481296.706066:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.706066:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706070:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452032 00000100:00100000:1.0:1713481296.706071:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452032 00010000:00010000:0.0:1713481296.706074:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.706075:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.706079:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd4d200/0xdfc0fb148a39f77 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49181 expref: 16819 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.706079:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706085:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452160 00000100:00100000:1.0:1713481296.706086:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452160 00010000:00010000:0.0:1713481296.706089:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd4d200/0xdfc0fb148a39f77 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49181 expref: 16820 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.706091:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562879 00000100:00100000:2.0:1713481296.706094:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16820:1960:x1796714882452032:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.706096:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd4d200, rc 0) 00000100:00100000:1.0:1713481296.706097:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562880 00000100:00100000:1.0:1713481296.706099:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16820:1960:x1796714882452160:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.706099:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.706103:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.706105:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013507c900/0xdfc0fb148a39f7e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4918f expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.706109:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16820:1960:x1796714882451904:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (93us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.706110:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b80a1c0/0xdfc0fb148a39f85 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4919d expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.706112:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562878 00002000:00010000:2.0:1713481296.706114:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.706116:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.706135:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706136:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706139:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b80a1c0/0xdfc0fb148a39f85 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4919d expref: 16822 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706141:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706143:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706145:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b80a1c0/0xdfc0fb148a39f85 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4919d expref: 16821 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706148:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013507c900/0xdfc0fb148a39f7e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4918f expref: 16821 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706152:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b80a1c0, rc 0) 00010000:00010000:2.0:1713481296.706157:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013507c900/0xdfc0fb148a39f7e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4918f expref: 16821 pid: 16512 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.706161:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16821:1960:x1796714882452160:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.706165:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562880 00010000:00010000:2.0:1713481296.706169:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013507c900, rc 0) 00000100:00100000:0.0:1713481296.706173:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706178:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451200 00000100:00100000:1.0:1713481296.706180:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451200 00000100:00100000:2.0:1713481296.706182:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d09a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16820:1960:x1796714882452032:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 87us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.706186:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562879 00000100:00100000:1.0:1713481296.706194:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562881 00000100:00100000:1.0:1713481296.706197:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26910:1960:x1796714882451200:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706201:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.706206:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.706208:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce55b00/0xdfc0fb148a39f8c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49134 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.706215:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafba:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.706219:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.706219:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451328 00010000:00010000:1.0:1713481296.706220:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.706221:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451328 00010000:00010000:1.0:1713481296.706223:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce55b00/0xdfc0fb148a39f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49134 expref: 26911 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706228:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ce55b00/0xdfc0fb148a39f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49134 expref: 26912 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706232:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce55b00, rc 0) 00000100:00100000:2.0:1713481296.706232:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562882 00000100:00100000:2.0:1713481296.706235:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:1960:x1796714882451328:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.706239:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.706241:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:1960:x1796714882451200:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.706244:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562881 00010000:00010000:2.0:1713481296.706246:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013507cfc0/0xdfc0fb148a39f93 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49142 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.706253:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafbb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.706259:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706260:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706262:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013507cfc0/0xdfc0fb148a39f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49142 expref: 26912 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706268:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013507cfc0/0xdfc0fb148a39f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49142 expref: 26912 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706272:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013507cfc0, rc 0) 00000100:00100000:2.0:1713481296.706280:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:1960:x1796714882451328:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.706284:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562882 00000100:00100000:0.0:1713481296.706310:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.706322:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451456 00000100:00100000:2.0:1713481296.706324:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451456 00000100:00100000:0.0:1713481296.706326:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.706337:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.706337:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451584 00000100:00100000:2.0:1713481296.706338:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451584 00000100:00100000:1.0:1713481296.706344:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451712 00000100:00100000:0.0:1713481296.706346:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706346:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451712 00000100:00100000:2.0:1713481296.706346:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562883 00000100:00100000:2.0:1713481296.706349:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26914:1960:x1796714882451456:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.706353:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.706354:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706354:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451840 00000100:00100000:1.0:1713481296.706355:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451840 00010000:00010000:2.0:1713481296.706359:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013507e640/0xdfc0fb148a39f9a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49150 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.706361:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882451968 00000100:00100000:0.0:1713481296.706362:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706362:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882451968 00002000:00010000:2.0:1713481296.706366:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafbc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.706367:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452096 00000100:00100000:1.0:1713481296.706369:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452096 00000100:00100000:0.0:1713481296.706370:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.706371:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706372:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706374:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013507e640/0xdfc0fb148a39f9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49150 expref: 26918 pid: 16515 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.706379:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452288 00010000:00010000:2.0:1713481296.706380:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013507e640/0xdfc0fb148a39f9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49150 expref: 26918 pid: 16515 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.706381:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452288 00010000:00010000:2.0:1713481296.706384:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013507e640, rc 0) 00000100:00100000:0.0:1713481296.706388:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562884 00000100:00100000:2.0:1713481296.706393:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1960:x1796714882451456:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.706394:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562885 00000100:00100000:0.0:1713481296.706395:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1960:x1796714882451584:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.706397:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1960:x1796714882451712:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.706397:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562883 00010000:00010000:0.0:1713481296.706401:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.706402:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.706406:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562886 00010000:00010000:1.0:1713481296.706409:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e75b00/0xdfc0fb148a39fa1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4916c expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.706409:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26917:1960:x1796714882451840:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.706411:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082224240/0xdfc0fb148a39fa8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4915e expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.706412:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.706416:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafbe:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.706418:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083b40900/0xdfc0fb148a39faf lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4917a expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.706421:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafbd:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.706421:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706422:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706424:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e75b00/0xdfc0fb148a39fa1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4916c expref: 26918 pid: 16462 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.706424:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafbf:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.706429:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706429:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706430:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e75b00/0xdfc0fb148a39fa1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4916c expref: 26920 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706430:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.706431:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706432:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083b40900/0xdfc0fb148a39faf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4917a expref: 26920 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706434:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e75b00, rc 0) 00010000:00010000:0.0:1713481296.706435:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082224240/0xdfc0fb148a39fa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4915e expref: 26920 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706437:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083b40900/0xdfc0fb148a39faf lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4917a expref: 26920 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706441:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083b40900, rc 0) 00000100:00100000:1.0:1713481296.706443:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1960:x1796714882451712:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.706447:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562885 00000100:00100000:2.0:1713481296.706448:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1960:x1796714882451840:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.706451:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562886 00000100:00100000:1.0:1713481296.706457:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562887 00000100:00100000:2.0:1713481296.706460:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562888 00000100:00100000:1.0:1713481296.706461:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1960:x1796714882451968:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.706463:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1960:x1796714882452096:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706464:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.706466:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.706469:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e76d00/0xdfc0fb148a39fb6 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49188 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.706472:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083b42640/0xdfc0fb148a39fbd lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49196 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.706475:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.706478:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.706480:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706480:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706483:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e76d00/0xdfc0fb148a39fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49188 expref: 26920 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706483:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706484:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706486:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083b42640/0xdfc0fb148a39fbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49196 expref: 26920 pid: 16515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706488:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e76d00/0xdfc0fb148a39fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49188 expref: 26920 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706492:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e76d00, rc 0) 00010000:00010000:2.0:1713481296.706494:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083b42640/0xdfc0fb148a39fbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49196 expref: 26920 pid: 16515 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.706498:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1960:x1796714882451968:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 38us (144us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.706498:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083b42640, rc 0) 00000100:00100000:1.0:1713481296.706502:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562887 00000100:00100000:2.0:1713481296.706505:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1960:x1796714882452096:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.706508:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562888 00000100:00100000:1.0:1713481296.706509:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562889 00000100:00100000:1.0:1713481296.706512:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16820:1960:x1796714882452288:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706515:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.706520:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e77600/0xdfc0fb148a39fc4 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491ab expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.706526:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.706531:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706532:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706534:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e77600/0xdfc0fb148a39fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ab expref: 16821 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.706536:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082224240/0xdfc0fb148a39fa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4915e expref: 26918 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706539:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e77600/0xdfc0fb148a39fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ab expref: 16821 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.706543:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082224240, rc 0) 00010000:00010000:1.0:1713481296.706543:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e77600, rc 0) 00000100:00100000:1.0:1713481296.706549:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16821:1960:x1796714882452288:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 37us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.706553:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562889 00000100:00100000:0.0:1713481296.706556:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1960:x1796714882451584:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 163us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.706561:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562884 00000100:00100000:0.0:1713481296.706642:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706655:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452416 00000100:00100000:1.0:1713481296.706656:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452416 00000100:00100000:0.0:1713481296.706658:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706675:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452544 00000100:00100000:1.0:1713481296.706677:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452544 00000100:00100000:0.0:1713481296.706680:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562890 00000100:00100000:0.0:1713481296.706684:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16822:1960:x1796714882452416:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.706687:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562891 00010000:00010000:0.0:1713481296.706689:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.706690:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16822:1960:x1796714882452544:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706694:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.706695:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082225200/0xdfc0fb148a39fcb lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491b9 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.706698:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.706701:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e74d80/0xdfc0fb148a39fd2 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491c7 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.706702:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.706708:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1713481296.706708:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97a9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.706709:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.706712:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082225200/0xdfc0fb148a39fcb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491b9 expref: 16824 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706713:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706714:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706717:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e74d80/0xdfc0fb148a39fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491c7 expref: 16824 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.706718:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.706719:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082225200/0xdfc0fb148a39fcb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491b9 expref: 16824 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.706726:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082225200, rc 0) 00010000:00010000:1.0:1713481296.706726:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e74d80/0xdfc0fb148a39fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491c7 expref: 16824 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706730:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e74d80, rc 0) 00000100:00100000:2.0:1713481296.706734:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.706740:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16824:1960:x1796714882452416:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.706741:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16824:1960:x1796714882452544:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.706744:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562891 00000100:00100000:0.0:1713481296.706747:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562890 00000100:00100000:1.0:1713481296.706756:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452224 00000100:00100000:1.0:1713481296.706758:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452224 00000100:00100000:0.0:1713481296.706763:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452352 00000100:00100000:1.0:1713481296.706765:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452480 00000100:00100000:0.0:1713481296.706766:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452352 00000100:00100000:1.0:1713481296.706767:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452480 00000100:00100000:1.0:1713481296.706773:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562892 00000100:00100000:1.0:1713481296.706776:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1960:x1796714882452224:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706779:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.706783:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562893 00010000:00010000:1.0:1713481296.706784:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e74480/0xdfc0fb148a39fd9 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491a4 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.706784:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.706788:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1960:x1796714882452480:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.706791:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.706794:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.706796:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706797:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706799:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e74480/0xdfc0fb148a39fd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491a4 expref: 26921 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.706804:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082225680/0xdfc0fb148a39fe0 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491c0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.706804:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e74480/0xdfc0fb148a39fd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491a4 expref: 26921 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706812:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e74480, rc 0) 00002000:00010000:0.0:1713481296.706814:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.706819:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26922:1960:x1796714882452224:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.706820:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.706822:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.706823:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.706823:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562892 00010000:00010000:0.0:1713481296.706827:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082225680/0xdfc0fb148a39fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491c0 expref: 26922 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.706830:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452672 00000100:00100000:1.0:1713481296.706831:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452672 00000100:00100000:2.0:1713481296.706835:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452800 00010000:00010000:0.0:1713481296.706836:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082225680/0xdfc0fb148a39fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491c0 expref: 26921 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.706838:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452800 00010000:00010000:0.0:1713481296.706843:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082225680, rc 0) 00000100:00100000:1.0:1713481296.706846:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562894 00000100:00100000:1.0:1713481296.706849:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1960:x1796714882452352:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706853:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.706853:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562895 00000100:00100000:0.0:1713481296.706857:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1960:x1796714882452480:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.706858:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e77cc0/0xdfc0fb148a39fe7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491b2 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.706858:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16824:1960:x1796714882452672:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.706864:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562893 00002000:00010000:1.0:1713481296.706864:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.706865:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.706869:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706870:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706873:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e77cc0/0xdfc0fb148a39fe7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491b2 expref: 26922 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706873:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083b41200/0xdfc0fb148a39fee lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491d5 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.706878:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e77cc0/0xdfc0fb148a39fe7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491b2 expref: 26921 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706882:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e77cc0, rc 0) 00002000:00010000:2.0:1713481296.706883:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97aa:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.706890:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1960:x1796714882452352:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (171us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.706891:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.706892:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.706893:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562894 00010000:00010000:2.0:1713481296.706897:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083b41200/0xdfc0fb148a39fee lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491d5 expref: 16825 pid: 16512 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.706900:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706905:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452928 00000100:00100000:1.0:1713481296.706907:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452928 00010000:00010000:2.0:1713481296.706911:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880083b41200/0xdfc0fb148a39fee lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491d5 expref: 16826 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.706918:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083b41200, rc 0) 00000100:00100000:1.0:1713481296.706921:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562896 00000100:00100000:1.0:1713481296.706924:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007736e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16826:1960:x1796714882452928:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.706927:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.706931:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16826:1960:x1796714882452672:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 73us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.706934:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c89680/0xdfc0fb148a39ff5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491f1 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.706936:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562895 00002000:00010000:1.0:1713481296.706942:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97ac:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.706946:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706947:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.706949:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c89680/0xdfc0fb148a39ff5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491f1 expref: 16826 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706955:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c89680/0xdfc0fb148a39ff5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491f1 expref: 16826 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.706959:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c89680, rc 0) 00000100:00100000:1.0:1713481296.706967:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007736e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16826:1960:x1796714882452928:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 43us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.706968:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562897 00000100:00100000:1.0:1713481296.706971:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562896 00000100:00100000:2.0:1713481296.706973:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16826:1960:x1796714882452800:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.706979:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.706980:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706988:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452608 00010000:00010000:2.0:1713481296.706988:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083b41b00/0xdfc0fb148a39ffc lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491e3 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.706990:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452608 00000100:00100000:0.0:1713481296.706995:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.706998:0:16544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452736 00002000:00010000:2.0:1713481296.706998:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97ab:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.706999:0:16544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452736 00000100:00100000:0.0:1713481296.707005:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562898 00010000:00010000:2.0:1713481296.707006:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.707008:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.707011:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562899 00010000:00010000:2.0:1713481296.707012:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083b41b00/0xdfc0fb148a39ffc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491e3 expref: 16826 pid: 16512 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.707013:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26922:1960:x1796714882452736:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.707019:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.707021:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880083b41b00/0xdfc0fb148a39ffc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491e3 expref: 16826 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707026:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086c8ad00/0xdfc0fb148a3a003 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491dc expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.707028:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083b41b00, rc 0) 00002000:00010000:1.0:1713481296.707032:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.707037:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707038:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707040:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086c8ad00/0xdfc0fb148a3a003 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491dc expref: 26923 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.707042:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16826:1960:x1796714882452800:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 69us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.707046:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086c8ad00/0xdfc0fb148a3a003 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491dc expref: 26923 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.707048:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562897 00010000:00010000:1.0:1713481296.707050:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c8ad00, rc 0) 00000100:00100000:1.0:1713481296.707058:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26923:1960:x1796714882452736:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.707062:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562899 00000100:00100000:0.0:1713481296.707094:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26922:1960:x1796714882452608:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.707101:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.707110:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fcfcc0/0xdfc0fb148a3a00a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491ce expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.707137:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.707146:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.707146:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.707147:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.707151:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fcfcc0/0xdfc0fb148a3a00a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ce expref: 26923 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.707159:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fcfcc0/0xdfc0fb148a3a00a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ce expref: 26923 pid: 16498 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.707159:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452864 00000100:00100000:1.0:1713481296.707161:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452864 00010000:00010000:0.0:1713481296.707164:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fcfcc0, rc 0) 00000100:00100000:1.0:1713481296.707170:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562900 00000100:00100000:1.0:1713481296.707173:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26924:1960:x1796714882452864:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.707175:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26924:1960:x1796714882452608:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 166us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.707177:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.707179:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562898 00010000:00010000:1.0:1713481296.707183:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086c8af40/0xdfc0fb148a3a011 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491ea expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.707183:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.707191:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.707193:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882452992 00000100:00100000:0.0:1713481296.707195:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882452992 00010000:00010000:1.0:1713481296.707198:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707198:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707201:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086c8af40/0xdfc0fb148a3a011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ea expref: 26925 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.707205:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562901 00010000:00010000:1.0:1713481296.707206:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086c8af40/0xdfc0fb148a3a011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ea expref: 26925 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.707208:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26925:1960:x1796714882452992:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.707211:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c8af40, rc 0) 00010000:00010000:0.0:1713481296.707212:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.707216:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.707218:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fcd8c0/0xdfc0fb148a3a018 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491f8 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.707220:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26925:1960:x1796714882452864:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.707224:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562900 00002000:00010000:0.0:1713481296.707229:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.707234:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.707234:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453056 00010000:00010000:0.0:1713481296.707235:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.707235:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453056 00010000:00010000:0.0:1713481296.707237:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fcd8c0/0xdfc0fb148a3a018 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491f8 expref: 26925 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.707243:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fcd8c0/0xdfc0fb148a3a018 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491f8 expref: 26925 pid: 16498 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.707243:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562902 00000100:00100000:1.0:1713481296.707245:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16826:1960:x1796714882453056:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.707247:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fcd8c0, rc 0) 00010000:00010000:1.0:1713481296.707249:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.707250:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.707254:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c88480/0xdfc0fb148a3a01f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa491ff expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.707255:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26925:1960:x1796714882452992:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.707259:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562901 00002000:00010000:1.0:1713481296.707260:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97ad:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.707264:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707265:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707268:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c88480/0xdfc0fb148a3a01f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ff expref: 16827 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.707270:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453184 00000100:00100000:0.0:1713481296.707271:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453184 00010000:00010000:1.0:1713481296.707273:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c88480/0xdfc0fb148a3a01f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa491ff expref: 16828 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707277:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c88480, rc 0) 00000100:00100000:0.0:1713481296.707279:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562903 00000100:00100000:0.0:1713481296.707282:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16828:1960:x1796714882453184:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.707285:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.707285:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16828:1960:x1796714882453056:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.707287:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.707289:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562902 00010000:00010000:0.0:1713481296.707291:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fcd440/0xdfc0fb148a3a026 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4920d expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.707296:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453312 00002000:00010000:0.0:1713481296.707297:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97ae:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:1.0:1713481296.707297:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453312 00010000:00010000:0.0:1713481296.707302:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.707303:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.707305:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fcd440/0xdfc0fb148a3a026 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4920d expref: 16829 pid: 16498 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.707311:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562904 00000100:00100000:1.0:1713481296.707313:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16829:1960:x1796714882453312:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.707315:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fcd440/0xdfc0fb148a3a026 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4920d expref: 16829 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707317:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.707319:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fcd440, rc 0) 00010000:00010000:1.0:1713481296.707322:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c89d40/0xdfc0fb148a3a02d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4921b expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.707328:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16829:1960:x1796714882453184:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (79us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.707329:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97af:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.707331:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562903 00010000:00010000:1.0:1713481296.707334:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707335:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707337:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c89d40/0xdfc0fb148a3a02d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4921b expref: 16829 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.707339:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.707343:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c89d40/0xdfc0fb148a3a02d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4921b expref: 16829 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707347:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c89d40, rc 0) 00000100:00100000:0.0:1713481296.707348:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453120 00000100:00100000:0.0:1713481296.707351:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453120 00000100:00100000:1.0:1713481296.707358:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16829:1960:x1796714882453312:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.707362:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562904 00000100:00100000:0.0:1713481296.707365:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562905 00000100:00100000:2.0:1713481296.707369:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.707370:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26925:1960:x1796714882453120:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.707376:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.707377:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453248 00000100:00100000:1.0:1713481296.707378:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453248 00010000:00010000:0.0:1713481296.707386:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fcf3c0/0xdfc0fb148a3a034 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49206 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.707392:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562906 00000100:00100000:1.0:1713481296.707395:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26926:1960:x1796714882453248:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:0.0:1713481296.707396:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafc9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.707399:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.707401:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.707404:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086c88240/0xdfc0fb148a3a03b lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49214 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.707405:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.707406:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.707406:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453440 00000100:00100000:2.0:1713481296.707408:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453440 00010000:00010000:0.0:1713481296.707410:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fcf3c0/0xdfc0fb148a3a034 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49206 expref: 26927 pid: 16525 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.707411:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafca:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.707417:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707418:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.707419:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fcf3c0/0xdfc0fb148a3a034 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49206 expref: 26928 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707420:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086c88240/0xdfc0fb148a3a03b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49214 expref: 26928 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.707421:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562907 00000100:00100000:2.0:1713481296.707424:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16829:1960:x1796714882453440:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.707426:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fcf3c0, rc 0) 00010000:00010000:1.0:1713481296.707426:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086c88240/0xdfc0fb148a3a03b lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49214 expref: 26928 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.707429:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.707430:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c88240, rc 0) 00010000:00010000:2.0:1713481296.707435:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff78d80/0xdfc0fb148a3a042 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49229 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.707439:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1960:x1796714882453120:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.707440:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1960:x1796714882453248:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.707443:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562906 00002000:00010000:2.0:1713481296.707443:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.707446:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562905 00010000:00010000:2.0:1713481296.707449:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.707449:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.707452:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff78d80/0xdfc0fb148a3a042 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49229 expref: 16830 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.707458:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff78d80/0xdfc0fb148a3a042 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49229 expref: 16830 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.707466:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff78d80, rc 0) 00000100:00100000:2.0:1713481296.707475:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16830:1960:x1796714882453440:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.707478:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.707479:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562907 00000100:00100000:1.0:1713481296.707490:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453568 00000100:00100000:1.0:1713481296.707492:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453568 00000100:00100000:0.0:1713481296.707493:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.707508:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453696 00000100:00100000:1.0:1713481296.707509:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453696 00000100:00100000:2.0:1713481296.707510:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562908 00000100:00100000:2.0:1713481296.707512:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16831:1960:x1796714882453568:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.707516:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.707520:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562909 00010000:00010000:2.0:1713481296.707522:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff79440/0xdfc0fb148a3a049 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49237 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.707523:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16831:1960:x1796714882453696:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.707528:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.707529:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.707533:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.707534:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707536:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c8aac0/0xdfc0fb148a3a050 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49245 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.707536:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff79440/0xdfc0fb148a3a049 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49237 expref: 16832 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.707541:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff79440/0xdfc0fb148a3a049 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49237 expref: 16832 pid: 16533 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.707543:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.707545:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff79440, rc 0) 00010000:00010000:1.0:1713481296.707548:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707549:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707552:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c8aac0/0xdfc0fb148a3a050 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49245 expref: 16833 pid: 16498 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.707553:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16833:1960:x1796714882453568:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.707556:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562908 00010000:00010000:1.0:1713481296.707557:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c8aac0/0xdfc0fb148a3a050 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49245 expref: 16833 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707562:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c8aac0, rc 0) 00000100:00100000:1.0:1713481296.707571:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16832:1960:x1796714882453696:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 47us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.707574:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562909 00000100:00100000:0.0:1713481296.707680:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.707732:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453824 00000100:00100000:1.0:1713481296.707735:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453824 00000100:00100000:1.0:1713481296.707743:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562910 00000100:00100000:1.0:1713481296.707746:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16832:1960:x1796714882453824:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.707750:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.707757:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086c89f80/0xdfc0fb148a3a057 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49253 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.707765:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.707771:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707772:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707774:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086c89f80/0xdfc0fb148a3a057 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49253 expref: 16833 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707779:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086c89f80/0xdfc0fb148a3a057 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49253 expref: 16833 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707784:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086c89f80, rc 0) 00000100:00100000:1.0:1713481296.707793:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16833:1960:x1796714882453824:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.707794:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.707796:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562910 00000100:00100000:1.0:1713481296.707804:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453952 00000100:00100000:1.0:1713481296.707806:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453952 00000100:00100000:1.0:1713481296.707819:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562911 00000100:00100000:1.0:1713481296.707822:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16833:1960:x1796714882453952:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.707826:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.707827:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.707832:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800848ad680/0xdfc0fb148a3a05e lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49261 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.707838:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.707843:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.707843:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.707843:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453376 00010000:00010000:1.0:1713481296.707846:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800848ad680/0xdfc0fb148a3a05e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49261 expref: 16834 pid: 15509 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.707847:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453376 00010000:00010000:1.0:1713481296.707851:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800848ad680/0xdfc0fb148a3a05e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49261 expref: 16834 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.707856:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848ad680, rc 0) 00000100:00100000:2.0:1713481296.707870:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562912 00000100:00100000:2.0:1713481296.707874:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26927:1960:x1796714882453376:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.707879:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.707886:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991dcd80/0xdfc0fb148a3a065 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49222 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.707893:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafcb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.707899:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.707900:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.707902:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991dcd80/0xdfc0fb148a3a065 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49222 expref: 26928 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.707908:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991dcd80/0xdfc0fb148a3a065 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49222 expref: 26928 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.707914:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991dcd80, rc 0) 00000100:00100000:1.0:1713481296.708147:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16834:1960:x1796714882453952:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 323us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.708150:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562911 00000100:00100000:2.0:1713481296.708152:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1960:x1796714882453376:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 276us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.708156:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562912 00000100:00100000:0.0:1713481296.708225:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.708238:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453504 00000100:00100000:1.0:1713481296.708240:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453504 00000100:00100000:0.0:1713481296.708244:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.708252:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453632 00000100:00100000:1.0:1713481296.708254:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453632 00000100:00100000:2.0:1713481296.708258:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562913 00000100:00100000:2.0:1713481296.708261:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26929:1960:x1796714882453504:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.708264:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562914 00000100:00100000:1.0:1713481296.708266:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26929:1960:x1796714882453632:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.708266:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.708270:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.708272:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991de880/0xdfc0fb148a3a06c lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49230 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.708276:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.708276:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800848add40/0xdfc0fb148a3a073 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4923e expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.708279:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafcc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.708284:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafcd:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.708285:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708285:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708288:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991de880/0xdfc0fb148a3a06c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49230 expref: 26931 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.708289:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708290:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708293:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848add40/0xdfc0fb148a3a073 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4923e expref: 26931 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708294:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991de880/0xdfc0fb148a3a06c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49230 expref: 26931 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.708295:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.708298:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800848add40/0xdfc0fb148a3a073 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4923e expref: 26931 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708298:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991de880, rc 0) 00010000:00010000:1.0:1713481296.708302:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848add40, rc 0) 00000100:00100000:2.0:1713481296.708308:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26931:1960:x1796714882453504:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 46us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.708312:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562913 00000100:00100000:1.0:1713481296.708313:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26931:1960:x1796714882453632:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.708315:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.708317:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562914 00000100:00100000:2.0:1713481296.708322:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453760 00000100:00100000:2.0:1713481296.708323:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453760 00000100:00100000:1.0:1713481296.708325:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882453888 00000100:00100000:1.0:1713481296.708327:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882453888 00000100:00100000:0.0:1713481296.708332:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.708336:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454016 00000100:00100000:1.0:1713481296.708338:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454016 00000100:00100000:2.0:1713481296.708339:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454080 00000100:00100000:2.0:1713481296.708340:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454080 00000100:00100000:1.0:1713481296.708345:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562915 00000100:00100000:1.0:1713481296.708347:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26932:1960:x1796714882453760:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:0.0:1713481296.708350:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.708350:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562916 00010000:00010000:1.0:1713481296.708351:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.708353:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26932:1960:x1796714882453888:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.708356:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800848afa80/0xdfc0fb148a3a07a lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4924c expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.708357:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.708361:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafce:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.708362:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991ddd40/0xdfc0fb148a3a081 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4925a expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.708366:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708367:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708369:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848afa80/0xdfc0fb148a3a07a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4924c expref: 26933 pid: 16525 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.708369:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafcf:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.708374:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708374:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708375:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800848afa80/0xdfc0fb148a3a07a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4924c expref: 26934 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708377:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991ddd40/0xdfc0fb148a3a081 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4925a expref: 26934 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.708379:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848afa80, rc 0) 00000100:00100000:1.0:1713481296.708386:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26934:1960:x1796714882453760:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 38us (110us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.708386:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991ddd40/0xdfc0fb148a3a081 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4925a expref: 26934 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.708390:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562915 00010000:00010000:2.0:1713481296.708390:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991ddd40, rc 0) 00000100:00100000:2.0:1713481296.708398:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26933:1960:x1796714882453888:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.708400:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454208 00000100:00100000:1.0:1713481296.708401:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454208 00000100:00100000:2.0:1713481296.708401:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562916 00000100:00100000:2.0:1713481296.708409:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562917 00000100:00100000:2.0:1713481296.708411:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26932:1960:x1796714882454016:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.708412:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562918 00000100:00100000:1.0:1713481296.708415:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16835:1960:x1796714882454080:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.708415:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.708418:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.708419:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.708420:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991df180/0xdfc0fb148a3a088 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49268 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.708423:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800848aeac0/0xdfc0fb148a3a08f lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4926f expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.708426:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd0:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:1.0:1713481296.708430:0:16525:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.708431:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708432:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708434:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708434:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991df180/0xdfc0fb148a3a088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49268 expref: 26933 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.708435:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708438:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800848aeac0/0xdfc0fb148a3a08f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4926f expref: 16836 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.708439:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454336 00010000:00010000:2.0:1713481296.708440:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991df180/0xdfc0fb148a3a088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49268 expref: 26933 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.708442:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454336 00010000:00010000:1.0:1713481296.708443:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800848aeac0/0xdfc0fb148a3a08f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4926f expref: 16836 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708443:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991df180, rc 0) 00010000:00010000:1.0:1713481296.708447:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848aeac0, rc 0) 00000100:00100000:2.0:1713481296.708450:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26933:1960:x1796714882454016:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.708454:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562917 00000100:00100000:1.0:1713481296.708455:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16837:1960:x1796714882454080:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.708459:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562918 00000100:00100000:0.0:1713481296.708464:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562919 00000100:00100000:0.0:1713481296.708468:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16837:1960:x1796714882454208:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.708468:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562920 00000100:00100000:2.0:1713481296.708472:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16836:1960:x1796714882454336:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:0.0:1713481296.708475:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.708477:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.708484:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fceac0/0xdfc0fb148a3a096 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4927d expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.708485:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991dcb40/0xdfc0fb148a3a09d lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4928b expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.708493:0:16509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00002000:00010000:2.0:1713481296.708495:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.708500:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.708501:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708503:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708504:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.708506:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fceac0/0xdfc0fb148a3a096 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4927d expref: 16838 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708508:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dcb40/0xdfc0fb148a3a09d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4928b expref: 16838 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.708515:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fceac0/0xdfc0fb148a3a096 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4927d expref: 16838 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708516:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991dcb40/0xdfc0fb148a3a09d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4928b expref: 16838 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.708522:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fceac0, rc 0) 00010000:00010000:2.0:1713481296.708524:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991dcb40, rc 0) 00000100:00100000:0.0:1713481296.708534:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16838:1960:x1796714882454208:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.708537:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16838:1960:x1796714882454336:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 64us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.708539:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562919 00000100:00100000:2.0:1713481296.708543:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562920 00000100:00100000:2.0:1713481296.708580:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.708594:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454464 00000100:00100000:2.0:1713481296.708597:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454464 00000100:00100000:0.0:1713481296.708611:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.708613:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562921 00000100:00100000:2.0:1713481296.708617:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16837:1960:x1796714882454464:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.708626:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.708633:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.708635:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf82f40/0xdfc0fb148a3a0a4 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49299 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.708646:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.708649:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.708653:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708654:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708658:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf82f40/0xdfc0fb148a3a0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49299 expref: 16838 pid: 16544 timeout: 0 lvb_type: 1 00000001:00080000:3.0:1713481296.708659:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040763 00010000:00010000:2.0:1713481296.708680:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf82f40/0xdfc0fb148a3a0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49299 expref: 16838 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708688:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf82f40, rc 0) 00000100:00100000:0.0:1713481296.708689:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.708693:0:16537:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454592 00000100:00100000:1.0:1713481296.708696:0:16537:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454592 00000100:00100000:0.0:1713481296.708699:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454144 00000100:00100000:2.0:1713481296.708700:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16839:1960:x1796714882454464:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 83us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.708701:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454144 00000100:00100000:2.0:1713481296.708704:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562921 00000100:00100000:1.0:1713481296.708707:0:16537:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454272 00000100:00100000:1.0:1713481296.708708:0:16537:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454272 00000100:00100000:0.0:1713481296.708715:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454400 00000100:00100000:0.0:1713481296.708717:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454400 00000100:00100000:1.0:1713481296.708717:0:16537:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562922 00000100:00100000:1.0:1713481296.708720:0:16537:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16838:1960:x1796714882454592:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:2.0:1713481296.708720:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562923 00000100:00100000:2.0:1713481296.708723:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26935:1960:x1796714882454144:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.708725:0:16537:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.708727:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.708730:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562924 00010000:00010000:1.0:1713481296.708732:0:16537:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124c91f80/0xdfc0fb148a3a0ab lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492a7 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.708733:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf83cc0/0xdfc0fb148a3a0b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49276 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.708734:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26935:1960:x1796714882454272:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00080000:3.0:1713481296.708738:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56402 00002000:00010000:2.0:1713481296.708739:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd1:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.708741:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1713481296.708743:0:16537:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97b9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.708744:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708745:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708748:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf83cc0/0xdfc0fb148a3a0b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49276 expref: 26936 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.708749:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708750:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708753:0:16537:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124c91f80/0xdfc0fb148a3a0ab lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492a7 expref: 16839 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.708754:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fcdf80/0xdfc0fb148a3a0b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49284 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.708754:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf83cc0/0xdfc0fb148a3a0b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49276 expref: 26936 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708758:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf83cc0, rc 0) 00010000:00010000:1.0:1713481296.708759:0:16537:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124c91f80/0xdfc0fb148a3a0ab lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492a7 expref: 16839 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.708763:0:16537:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124c91f80, rc 0) 00002000:00010000:0.0:1713481296.708764:0:16509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd2:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.708765:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26936:1960:x1796714882454144:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 41us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.708768:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562923 00010000:00010000:0.0:1713481296.708773:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.708773:0:16537:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16839:1960:x1796714882454592:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.708774:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.708776:0:16537:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562922 00000100:00100000:2.0:1713481296.708778:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562925 00010000:00010000:0.0:1713481296.708779:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fcdf80/0xdfc0fb148a3a0b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49284 expref: 26936 pid: 16509 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.708781:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26936:1960:x1796714882454400:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.708784:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.708789:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fcdf80/0xdfc0fb148a3a0b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49284 expref: 26936 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708789:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf80900/0xdfc0fb148a3a0c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49292 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.708795:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd3:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:0.0:1713481296.708797:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fcdf80, rc 0) 00010000:00010000:2.0:1713481296.708800:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708801:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.708803:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf80900/0xdfc0fb148a3a0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49292 expref: 26937 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.708808:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf80900/0xdfc0fb148a3a0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49292 expref: 26937 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.708811:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:1960:x1796714882454272:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 77us (160us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.708812:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf80900, rc 0) 00000100:00100000:0.0:1713481296.708817:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562924 00000100:00100000:2.0:1713481296.708819:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:1960:x1796714882454400:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.708823:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562925 00000100:00100000:2.0:1713481296.708876:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.708888:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454528 00000100:00100000:1.0:1713481296.708890:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454528 00000100:00100000:2.0:1713481296.708890:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.708902:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454720 00000100:00100000:1.0:1713481296.708904:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454720 00000100:00100000:1.0:1713481296.708914:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562926 00000100:00100000:1.0:1713481296.708918:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26936:1960:x1796714882454528:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.708924:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.708934:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124c93180/0xdfc0fb148a3a0c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492a0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.708945:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd4:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.708953:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708956:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.708960:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124c93180/0xdfc0fb148a3a0c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492a0 expref: 26937 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.708969:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124c93180/0xdfc0fb148a3a0c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492a0 expref: 26937 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.708976:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124c93180, rc 0) 00000100:00100000:1.0:1713481296.708990:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:1960:x1796714882454528:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 71us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.708995:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562926 00000100:00100000:1.0:1713481296.709007:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562927 00000100:00100000:1.0:1713481296.709009:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16839:1960:x1796714882454720:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.709013:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.709020:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124c91d40/0xdfc0fb148a3a0ce lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492b5 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.709027:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97ba:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.709033:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709034:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709036:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124c91d40/0xdfc0fb148a3a0ce lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492b5 expref: 16840 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709043:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124c91d40/0xdfc0fb148a3a0ce lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492b5 expref: 16840 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709050:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124c91d40, rc 0) 00000100:00100000:2.0:1713481296.709053:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.709060:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454848 00000100:00100000:2.0:1713481296.709062:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454848 00000100:00100000:1.0:1713481296.709063:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16840:1960:x1796714882454720:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.709068:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562927 00000100:00100000:2.0:1713481296.709075:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562928 00000100:00100000:2.0:1713481296.709078:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16840:1960:x1796714882454848:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.709082:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.709087:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.709089:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b08b840/0xdfc0fb148a3a0d5 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492c3 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.709096:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97bb:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.709102:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709102:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709105:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b08b840/0xdfc0fb148a3a0d5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492c3 expref: 16841 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.709107:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454976 00000100:00100000:1.0:1713481296.709110:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454976 00010000:00010000:2.0:1713481296.709110:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b08b840/0xdfc0fb148a3a0d5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492c3 expref: 16841 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.709114:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b08b840, rc 0) 00000100:00100000:2.0:1713481296.709140:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16842:1960:x1796714882454848:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.709142:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562929 00000100:00100000:0.0:1713481296.709144:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.709145:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562928 00000100:00100000:1.0:1713481296.709146:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16842:1960:x1796714882454976:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.709153:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.709156:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455104 00000100:00100000:2.0:1713481296.709158:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455104 00010000:00010000:1.0:1713481296.709162:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124c933c0/0xdfc0fb148a3a0dc lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492d1 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.709165:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562930 00000100:00100000:2.0:1713481296.709168:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16842:1960:x1796714882455104:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:1.0:1713481296.709172:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97bc:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.709172:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.709178:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b088fc0/0xdfc0fb148a3a0e3 lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492df expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.709179:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709181:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709184:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124c933c0/0xdfc0fb148a3a0dc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492d1 expref: 16843 pid: 16495 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.709185:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97bd:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.709190:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709190:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709192:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124c933c0/0xdfc0fb148a3a0dc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492d1 expref: 16844 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.709193:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b088fc0/0xdfc0fb148a3a0e3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492df expref: 16844 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709199:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124c933c0, rc 0) 00010000:00010000:2.0:1713481296.709199:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b088fc0/0xdfc0fb148a3a0e3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492df expref: 16844 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.709203:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b088fc0, rc 0) 00000100:00100000:1.0:1713481296.709213:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16844:1960:x1796714882454976:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.709213:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16844:1960:x1796714882455104:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 45us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.709216:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562930 00000100:00100000:1.0:1713481296.709219:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562929 00000100:00100000:2.0:1713481296.709251:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.709264:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455232 00000100:00100000:1.0:1713481296.709267:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455232 00000100:00100000:2.0:1713481296.709278:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.709281:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454656 00000100:00100000:1.0:1713481296.709283:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454656 00000100:00100000:1.0:1713481296.709294:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562931 00000100:00100000:1.0:1713481296.709298:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16843:1960:x1796714882455232:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.709304:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.709313:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124c91680/0xdfc0fb148a3a0ea lrc: 2/0,0 mode: --/PR res: [0x280000408:0x97be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492ed expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.709323:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x97be:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.709331:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709332:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709336:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124c91680/0xdfc0fb148a3a0ea lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492ed expref: 16844 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.709343:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.709345:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124c91680/0xdfc0fb148a3a0ea lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x97be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492ed expref: 16844 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709352:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124c91680, rc 0) 00000100:00100000:2.0:1713481296.709358:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454784 00000100:00100000:2.0:1713481296.709361:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454784 00000100:00100000:1.0:1713481296.709374:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16844:1960:x1796714882455232:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.709379:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562932 00000100:00100000:0.0:1713481296.709382:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.709383:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562931 00000100:00100000:2.0:1713481296.709384:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26938:1960:x1796714882454656:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.709392:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.709398:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882454912 00010000:00010000:2.0:1713481296.709399:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b088900/0xdfc0fb148a3a0f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492ae expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.709401:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882454912 00000100:00100000:1.0:1713481296.709401:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562933 00000100:00100000:1.0:1713481296.709406:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26939:1960:x1796714882454784:12345-192.168.202.24@tcp:101:ll_agl.0 00002000:00010000:2.0:1713481296.709406:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd5:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.709412:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.709412:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709413:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709415:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b088900/0xdfc0fb148a3a0f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492ae expref: 26940 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709420:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124c92640/0xdfc0fb148a3a0f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492bc expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.709421:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b088900/0xdfc0fb148a3a0f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492ae expref: 26940 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.709426:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b088900, rc 0) 00002000:00010000:1.0:1713481296.709430:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd6:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:2.0:1713481296.709437:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1960:x1796714882454656:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 53us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.709439:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709440:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.709442:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562932 00010000:00010000:1.0:1713481296.709445:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124c92640/0xdfc0fb148a3a0f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492bc expref: 26941 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709453:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124c92640/0xdfc0fb148a3a0f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492bc expref: 26941 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709460:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124c92640, rc 0) 00000100:00100000:2.0:1713481296.709460:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562934 00000100:00100000:2.0:1713481296.709464:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26940:1960:x1796714882454912:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:2.0:1713481296.709470:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.709473:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26940:1960:x1796714882454784:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.709479:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562933 00010000:00010000:2.0:1713481296.709479:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b088b40/0xdfc0fb148a3a0ff lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492ca expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.709490:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd7:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:2.0:1713481296.709497:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709499:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709504:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b088b40/0xdfc0fb148a3a0ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492ca expref: 26940 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.709512:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b088b40/0xdfc0fb148a3a0ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492ca expref: 26940 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.709519:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b088b40, rc 0) 00000100:00100000:0.0:1713481296.709522:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.709533:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26940:1960:x1796714882454912:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.709538:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562934 00000100:00100000:1.0:1713481296.709539:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455040 00000100:00100000:1.0:1713481296.709542:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455040 00000100:00100000:0.0:1713481296.709545:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.709554:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455168 00000100:00100000:1.0:1713481296.709556:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455168 00000100:00100000:2.0:1713481296.709557:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562935 00000100:00100000:2.0:1713481296.709562:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1960:x1796714882455040:12345-192.168.202.24@tcp:101:ll_agl.0 00000100:00100000:1.0:1713481296.709565:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562936 00000100:00100000:0.0:1713481296.709566:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.709568:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.709569:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1960:x1796714882455168:12345-192.168.202.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1713481296.709575:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.709576:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455296 00010000:00010000:2.0:1713481296.709576:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b08a880/0xdfc0fb148a3a106 lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492d8 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.709578:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455296 00002000:00010000:2.0:1713481296.709583:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd8:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00010000:00010000:1.0:1713481296.709585:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124c921c0/0xdfc0fb148a3a10d lrc: 2/0,0 mode: --/PR res: [0x2c0000407:0xafd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492e6 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.709589:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709590:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709593:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b08a880/0xdfc0fb148a3a106 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492d8 expref: 26942 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.709594:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562937 00002000:00010000:1.0:1713481296.709595:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xafd9:0x0] initial LVB size: 0, mtime: 0x6621a64c, atime: 0x6621a64c, ctime: 0x6621a64c, blocks: 0x0 00000100:00100000:0.0:1713481296.709598:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16844:18844:x1796714882455296:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.709599:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b08a880/0xdfc0fb148a3a106 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492d8 expref: 26943 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.709602:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.709603:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.709603:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b08a880, rc 0) 00010000:00010000:0.0:1713481296.709605:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.709606:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124c921c0/0xdfc0fb148a3a10d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492e6 expref: 26943 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.709612:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26943:1960:x1796714882455040:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 51us (91us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.709615:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084350900/0xdfc0fb148a3a114 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492f4 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.709615:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124c921c0/0xdfc0fb148a3a10d lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xafd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492e6 expref: 26943 pid: 16495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.709616:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562935 00010000:00010000:1.0:1713481296.709620:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124c921c0, rc 0) 00002000:00010000:0.0:1713481296.709627:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.709630:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26942:1960:x1796714882455168:12345-192.168.202.24@tcp:101:ll_agl.0 Request processed in 61us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.709634:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562936 00010000:00010000:0.0:1713481296.709637:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.709639:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.709643:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084350900/0xdfc0fb148a3a114 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492f4 expref: 16845 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.709651:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.709652:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084350900/0xdfc0fb148a3a114 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492f4 expref: 16845 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.709659:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084350900, rc 0) 00000100:00100000:0.0:1713481296.709685:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16845:18844:x1796714882455296:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 85us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.709686:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455424 00000100:00100000:1.0:1713481296.709688:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455424 00000100:00100000:0.0:1713481296.709690:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562937 00000100:00100000:2.0:1713481296.709707:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.709709:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125668 00000100:00100000:1.0:1713481296.709712:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2187:18922:x1796714882455424:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:2.0:1713481296.709792:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.709797:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784483648:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.709801:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.709810:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.709819:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.709823:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.709834:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1957:x1796714882424896:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 32940us (33227us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.709838:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18922:x1796714882455424:12345-192.168.202.24@tcp:35:touch.0 Request processed in 125us (186us total) trans 4295105901 rc 0/0 00000100:00100000:0.0:1713481296.709839:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820153 00000100:00100000:1.0:1713481296.709842:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125668 00000100:00100000:2.0:1713481296.709849:0:16460:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784484032:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.709877:0:16460:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.709904:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455680 00000100:00100000:0.0:1713481296.709906:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455680 00010000:00010000:0.0:1713481296.709915:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008334b180/0xdfc0fb1488021cb lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627e0 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.709920:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a292a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784483776:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.709925:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455744 00000100:00100000:0.0:1713481296.709927:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455744 00010000:00010000:0.0:1713481296.709932:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f81d40/0xdfc0fb148688a8b lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28d9 expref: 26942 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.709940:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820176 00010000:00010000:1.0:1713481296.709940:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.709942:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.709943:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1958:x1796714882455680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.709948:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.709950:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008334b180/0xdfc0fb1488021cb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627e0 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.709956:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008334b180/0xdfc0fb1488021cb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627e0 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.709957:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a290a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0001_UUID:16452:1796714784483904:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.709958:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455808 00000100:00100000:2.0:1713481296.709960:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455808 00010000:00010000:0.0:1713481296.709971:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008334b180/0xdfc0fb1488021cb lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627e0 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.709971:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013463cfc0/0xdfc0fb148688a92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28e7 expref: 26943 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.709977:0:16452:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.709979:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.709980:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.709982:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.709987:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.709989:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820177 00000100:00100000:2.0:1713481296.709994:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26943:1958:x1796714882455744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.709999:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820178 00010000:00010000:2.0:1713481296.710001:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.710002:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26943:1958:x1796714882455808:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.710004:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.710005:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f81d40/0xdfc0fb148688a8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28d9 expref: 26943 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.710007:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.710010:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013463cfc0/0xdfc0fb148688a92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28e7 expref: 26943 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710011:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1958:x1796714882455680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (200us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.710014:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f81d40/0xdfc0fb148688a8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28d9 expref: 26943 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710015:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820176 00010000:00010000:1.0:1713481296.710016:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013463cfc0/0xdfc0fb148688a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28e7 expref: 26943 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710031:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455488 00010000:00010000:1.0:1713481296.710031:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013463cfc0/0xdfc0fb148688a92 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28e7 expref: 26943 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710033:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455488 00010000:00010000:2.0:1713481296.710037:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f81d40/0xdfc0fb148688a8b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28d9 expref: 26942 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710039:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455552 00000100:00100000:0.0:1713481296.710041:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455552 00010000:00010000:1.0:1713481296.710042:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.710043:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.710045:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455616 00010000:00010000:1.0:1713481296.710045:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.710046:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455616 00010000:00010000:1.0:1713481296.710050:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.710051:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.710053:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.710054:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562938 00010000:00010000:2.0:1713481296.710055:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.710057:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16845:1957:x1796714882455488:12345-192.168.202.24@tcp:2:touch.0 00010000:00010000:2.0:1713481296.710063:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710065:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.710074:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26942:1958:x1796714882455808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.710077:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820178 00010000:00010000:2.0:1713481296.710084:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.710095:0:16452:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710098:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1958:x1796714882455744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 103us (276us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.710099:0:16452:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710104:0:16452:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710105:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820177 00010000:00010000:1.0:1713481296.710109:0:16452:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710113:0:16452:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710117:0:16452:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007db56880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.710133:0:16452:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710138:0:16452:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.710150:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710151:0:16452:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710155:0:16452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007db56880/0xdfc0fb148a393f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.710157:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.710164:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562939 00010000:00010000:2.0:1713481296.710165:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.710169:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:15045:x1796714882455552:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.710172:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710177:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.710184:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710188:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800898b2880/0xdfc0fb148a3a11b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa492fb expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.710190:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099b8cb40 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.710191:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16846:1957:x1796714882455488:12345-192.168.202.24@tcp:2:touch.0 Request processed in 132us (482us total) trans 4296040765 rc 0/0 00010000:00010000:2.0:1713481296.710193:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.710198:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562938 00002000:00010000:3.0:1713481296.710198:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.710199:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710207:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.710208:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.710211:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800898b2880/0xdfc0fb148a3a11b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492fb expref: 20853 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.710215:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562940 00010000:00010000:2.0:1713481296.710217:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710219:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800898b2880/0xdfc0fb148a3a11b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa492fb expref: 20853 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.710220:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26940:11388:x1796714882455616:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.710224:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099b8cb40/0xdfc0fb148a3941e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710225:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800898b2880, rc 0) 00010000:00010000:0.0:1713481296.710227:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.710235:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800843533c0/0xdfc0fb148a3a122 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49302 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.710240:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:15045:x1796714882455552:12345-192.168.202.24@tcp:101:dd.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.710244:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562939 00010000:00010000:0.0:1713481296.710251:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008afddf80/0xdfc0fb148941a3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00d2 expref: 24480 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.710257:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.710259:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.710262:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800843533c0/0xdfc0fb148a3a122 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49302 expref: 26941 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.710281:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008afddf80/0xdfc0fb148941a3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00d2 expref: 24480 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.710291:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008afddf80/0xdfc0fb148941a3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00d2 expref: 24480 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710303:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784486528:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.710322:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+2714:3492:x1796714784483840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 31860us (31898us total) trans 4295960652 rc 0/0 00000100:00100000:1.0:1713481296.710327:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562488 00000100:00100000:0.0:1713481296.710328:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008344b3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.710340:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f998700/2, rc 0, transno 993356 00010000:00010000:1.0:1713481296.710349:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.710349:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784483840:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.710354:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710358:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710361:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710365:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710368:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880130394b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.710370:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710373:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710380:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710382:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2713:3490:x1796714784483968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 31428us (31472us total) trans 4295960653 rc 0/0 00010000:00010000:1.0:1713481296.710384:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130394b40/0xdfc0fb148a393b5 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710389:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562494 00000100:00100000:0.0:1713481296.710418:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.710443:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455872 00000100:00100000:3.0:1713481296.710446:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455872 00010000:00010000:3.0:1713481296.710459:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f83840/0xdfc0fb148688a99 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28f5 expref: 26942 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710473:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.710473:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009faa4000/2, rc 0, transno 993357 00000100:00100000:3.0:1713481296.710474:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820179 00000100:00100000:3.0:1713481296.710477:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26942:1958:x1796714882455872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.710482:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784483968:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.710484:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.710487:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f83840/0xdfc0fb148688a99 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28f5 expref: 26942 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.710494:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f83840/0xdfc0fb148688a99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28f5 expref: 26942 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.710498:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+105:3492:x1796714784483712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 33158us (33180us total) trans 4296040766 rc 0/0 00000100:00100000:1.0:1713481296.710503:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562479 00000100:00100000:2.0:1713481296.710505:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784484160:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.710511:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f83840/0xdfc0fb148688a99 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d28f5 expref: 26942 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.710526:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710526:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.710528:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.710530:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.710531:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007829c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784484288:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.710536:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710549:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710555:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.710567:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784484480:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.710570:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.710570:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1958:x1796714882455872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.710573:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820179 00000100:00100000:2.0:1713481296.710578:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784486656:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.710586:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710599:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.710606:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784486592:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.710610:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e406a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784484544:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.710612:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784486656 00000100:00100000:1.0:1713481296.710614:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784486656 00000100:00100000:1.0:1713481296.710625:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562941 00000100:00100000:1.0:1713481296.710628:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2713:3491:x1796714784486656:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.710630:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.710630:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.710635:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.710636:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43270 count 1 00010000:00010000:2.0:1713481296.710638:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.710645:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.710648:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784486592 00000100:00100000:1.0:1713481296.710650:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784486592 00010000:00010000:2.0:1713481296.710652:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.710659:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562942 00010000:00010000:2.0:1713481296.710659:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.710661:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2714:3493:x1796714784486592:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.710680:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43269 count 1 00010000:00010000:2.0:1713481296.710681:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c23f840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.710684:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710686:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.710691:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.710691:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007687aa00/2, rc 0, transno 1073470 00010000:00010000:1.0:1713481296.710694:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096af2f40/0xdfc0fb148688af4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2949 expref: 26940 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.710698:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.710698:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784483712:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.710699:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.710700:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.710709:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710712:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096af2f40/0xdfc0fb148688af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2949 expref: 26940 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.710716:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c23f840/0xdfc0fb148a3946b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa8ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710717:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096af2f40/0xdfc0fb148688af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2949 expref: 26940 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.710724:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784486720:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.710726:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.710736:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f8b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.710749:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.710750:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456000 00000100:00100000:3.0:1713481296.710752:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456000 00010000:00010000:1.0:1713481296.710755:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800970461c0/0xdfc0fb148688b10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2957 expref: 26940 pid: 16486 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.710758:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.710759:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.710760:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.710761:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f81680/0xdfc0fb148688aa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa900:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2903 expref: 26941 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.710769:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800970461c0/0xdfc0fb148688b10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2957 expref: 26941 pid: 16486 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.710777:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800970461c0/0xdfc0fb148688b10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2957 expref: 26941 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.710780:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.710780:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820180 00000100:00100000:3.0:1713481296.710784:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1958:x1796714882456000:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.710786:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784486848:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.710789:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.710792:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f81680/0xdfc0fb148688aa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa900:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2903 expref: 26941 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.710796:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456064 00000100:00100000:1.0:1713481296.710798:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456064 00010000:00010000:3.0:1713481296.710798:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f81680/0xdfc0fb148688aa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa900:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2903 expref: 26941 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.710805:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013463f840/0xdfc0fb148688aa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa901:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2911 expref: 26942 pid: 16478 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.710809:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f81680/0xdfc0fb148688aa0 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa900:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2903 expref: 26942 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.710819:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.710820:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.710822:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.710823:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820181 00000100:00100000:1.0:1713481296.710826:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1957:x1796714882456064:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.710827:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2715:3490:x1796714784484096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 30866us (30901us total) trans 4295960654 rc 0/0 00010000:00010000:3.0:1713481296.710828:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710831:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.710832:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562501 00010000:00010000:1.0:1713481296.710833:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013463f840/0xdfc0fb148688aa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa901:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2911 expref: 26941 pid: 16478 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.710839:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013463f840/0xdfc0fb148688aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa901:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2911 expref: 26941 pid: 16478 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.710839:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.710845:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.710850:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013463f840/0xdfc0fb148688aa7 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa901:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2911 expref: 26941 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.710851:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1958:x1796714882456000:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.710855:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820180 00000100:00100000:0.0:1713481296.710857:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456128 00010000:00010000:1.0:1713481296.710859:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.710860:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456128 00010000:00010000:1.0:1713481296.710860:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.710862:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710862:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784484672:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.710866:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.710873:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f83cc0/0xdfc0fb148688aae lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d291f expref: 26940 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.710882:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.710885:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.710886:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f9ffb80/2, rc 0, transno 993358 00000100:00100000:1.0:1713481296.710892:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26940:1957:x1796714882456064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.710892:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784484096:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.710894:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820182 00000100:00100000:3.0:1713481296.710896:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713481296.710897:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820181 00000100:00100000:0.0:1713481296.710899:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26940:1958:x1796714882456128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.710901:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784486784:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.710905:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.710909:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f83cc0/0xdfc0fb148688aae lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa902:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d291f expref: 26939 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.710912:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710916:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.710917:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.710918:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f83cc0/0xdfc0fb148688aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa902:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d291f expref: 26939 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.710918:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713481296.710920:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710924:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710924:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784486912:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.710927:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710931:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880089415f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.710932:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.710934:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f83cc0/0xdfc0fb148688aae lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa902:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d291f expref: 26939 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.710936:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710940:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.710946:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.710950:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880089415f80/0xdfc0fb148a394db lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.710952:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.710953:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.710956:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.710962:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.710963:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784486784 00000100:00100000:2.0:1713481296.710965:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784486784 00000100:00100000:2.0:1713481296.710974:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784486912 00000100:00100000:2.0:1713481296.710975:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784486912 00010000:00010000:0.0:1713481296.710977:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.710983:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562943 00000100:00100000:2.0:1713481296.710985:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+105:3490:x1796714784486784:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.710990:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26938:1958:x1796714882456128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (145us total) trans 0 rc 0/0 00002000:00080000:2.0:1713481296.710993:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9923 count 1 00000100:00100000:0.0:1713481296.710996:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820182 00010000:00010000:2.0:1713481296.711001:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711009:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009635d680/0xdfc0fb148802203 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962850 expref: 20852 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.711016:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.711017:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.711019:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711028:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009635d680/0xdfc0fb148802203 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962850 expref: 20852 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.711033:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009635d680/0xdfc0fb148802203 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962850 expref: 20852 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.711036:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.711039:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008399ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15560:1796714784486976:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.711043:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711049:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.711049:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801356046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.711055:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2716:3493:x1796714784484352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 29160us (29211us total) trans 4295960655 rc 0/0 00010000:00010000:0.0:1713481296.711056:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.711059:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562517 00010000:00010000:0.0:1713481296.711063:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.711066:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f9fc000/2, rc 0, transno 993359 00000100:00100000:2.0:1713481296.711071:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784484352:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.711072:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800999e2d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.711075:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.711077:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562944 00000100:00100000:1.0:1713481296.711080:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2715:3493:x1796714784486912:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.711081:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.711087:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43271 count 1 00010000:00010000:1.0:1713481296.711093:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711095:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711099:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096af18c0/0xdfc0fb148688b17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2965 expref: 26937 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.711099:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784487040:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.711101:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999e2d00/0xdfc0fb148a394e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711103:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.711104:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.711106:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.711112:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.711116:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096af18c0/0xdfc0fb148688b17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2965 expref: 26937 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.711140:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096af18c0/0xdfc0fb148688b17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2965 expref: 26937 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.711145:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784487104:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.711149:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784487040 00000100:00100000:2.0:1713481296.711151:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784487040 00000100:00100000:1.0:1713481296.711156:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.711162:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562945 00000100:00100000:2.0:1713481296.711164:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2716:3493:x1796714784487040:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.711167:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711172:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.711172:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43272 count 1 00010000:00010000:1.0:1713481296.711176:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711179:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711180:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711184:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711187:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009659f840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.711188:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711189:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8073c0/0xdfc0fb148688b1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2973 expref: 26937 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.711192:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711193:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.711194:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.711195:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711204:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8073c0/0xdfc0fb148688b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2973 expref: 26937 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.711205:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711209:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009659f840/0xdfc0fb148a39487 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711209:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8073c0/0xdfc0fb148688b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2973 expref: 26937 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.711215:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007684f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784487168:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.711224:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800816266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.711241:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882455936 00000100:00100000:2.0:1713481296.711243:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882455936 00000100:00100000:2.0:1713481296.711263:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485780 00000100:00100000:2.0:1713481296.711266:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18680:x1796714882455936:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:0.0:1713481296.711270:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2718:3490:x1796714784484416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 29334us (29369us total) trans 4295960656 rc 0/0 00010000:00010000:2.0:1713481296.711273:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1713481296.711273:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f9fea00/2, rc 0, transno 993360 00000100:00100000:0.0:1713481296.711276:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562518 00000100:00100000:3.0:1713481296.711279:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784484416:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.711280:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078145200/0xdfc0fb148a3a14c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49309 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.711297:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2717:3493:x1796714784484224:12345-0@lo:6:osp-syn-1-1.0 Request processed in 30757us (30787us total) trans 4295960657 rc 0/0 00000100:00100000:1.0:1713481296.711301:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562505 00000100:00100000:3.0:1713481296.711301:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.711305:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784487232:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.711321:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.711328:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711337:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711342:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.711344:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784487232 00000100:00100000:0.0:1713481296.711347:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784487232 00010000:00010000:2.0:1713481296.711349:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711352:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711356:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.711366:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562946 00000100:00100000:0.0:1713481296.711370:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2717:3491:x1796714784487232:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.711374:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711377:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00002000:00080000:0.0:1713481296.711380:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43273 count 1 00010000:00010000:2.0:1713481296.711380:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711383:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711386:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078147600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.711388:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.711390:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711391:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711397:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d7:0x0].0x0 (ffff880135385e00) 00010000:00010000:2.0:1713481296.711399:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.711400:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c3533c0/0xdfc0fb148688b25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2981 expref: 26937 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.711401:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711404:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078147600/0xdfc0fb148a3a153 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.711411:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.711411:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.711412:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.711414:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711414:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711417:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711419:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007de24fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.711421:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711424:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.711427:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d7:0x0].0x3431 (ffff880088059300) 00010000:00010000:2.0:1713481296.711428:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.711429:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.711431:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c3533c0/0xdfc0fb148688b25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2981 expref: 26937 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.711432:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007de24fc0/0xdfc0fb148a3a15a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d7:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.711439:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c3533c0/0xdfc0fb148688b25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2981 expref: 26937 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.711449:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a292a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784487296:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.711455:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880078145200/0xdfc0fb148a3a14c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49309 expref: 2189 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711460:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078145200/0xdfc0fb148a3a14c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49309 expref: 2189 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.711466:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089015cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.711467:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880078145200, rc 0) 00000100:00100000:2.0:1713481296.711478:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18680:x1796714882455936:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 212us (1006us total) trans 0 rc 301/301 00000100:00100000:2.0:1713481296.711482:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485780 00000100:00100000:0.0:1713481296.711496:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.711513:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456192 00000004:00080000:2.0:1713481296.711516:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f9fc700/2, rc 0, transno 993361 00000100:00100000:0.0:1713481296.711517:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456192 00010000:00010000:0.0:1713481296.711530:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013463c000/0xdfc0fb148688ab5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d292d expref: 26938 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.711532:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784484224:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.711547:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820183 00000100:00100000:0.0:1713481296.711551:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26938:1957:x1796714882456192:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.711551:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784487360:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.711558:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.711562:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013463c000/0xdfc0fb148688ab5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa903:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d292d expref: 26938 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.711563:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.711569:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.711576:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013463c000/0xdfc0fb148688ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa903:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d292d expref: 26938 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.711589:0:16460:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784487360 00010000:00010000:0.0:1713481296.711591:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013463c000/0xdfc0fb148688ab5 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa903:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d292d expref: 26938 pid: 16478 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.711592:0:16460:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784487360 00010000:00010000:0.0:1713481296.711603:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.711603:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562947 00010000:00010000:0.0:1713481296.711604:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.711606:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2718:3491:x1796714784487360:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.711607:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711613:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.711613:0:16460:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43274 count 1 00010000:00010000:1.0:1713481296.711620:0:16460:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711627:0:16460:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148688b41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d298f expref: 26937 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.711631:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.711632:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.711633:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711634:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.711643:0:16460:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148688b41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d298f expref: 26937 pid: 16461 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.711646:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:1957:x1796714882456192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 94us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.711649:0:16460:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148688b41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d298f expref: 26937 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.711651:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820183 00000100:00100000:1.0:1713481296.711654:0:16460:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784487424:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.711676:0:16460:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800985c73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.711681:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.711696:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800783fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784484800:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.711699:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711706:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711713:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711719:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711719:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711726:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711732:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085d70000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.711735:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.711739:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456256 00000100:00100000:0.0:1713481296.711742:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456256 00010000:00010000:2.0:1713481296.711742:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711752:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800904333c0/0xdfc0fb1488021d2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627ee expref: 20853 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.711755:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.711761:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085d70000/0xdfc0fb148a3956e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.711771:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820184 00000100:00100000:0.0:1713481296.711774:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1957:x1796714882456256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.711780:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.711783:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800904333c0/0xdfc0fb1488021d2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627ee expref: 20853 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.711790:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800904333c0/0xdfc0fb1488021d2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627ee expref: 20853 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.711804:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800904333c0/0xdfc0fb1488021d2 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627ee expref: 20853 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.711817:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.711818:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.711820:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711827:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.711838:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.711844:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.711849:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1957:x1796714882456256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.711849:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711853:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.711854:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820184 00010000:00010000:1.0:1713481296.711856:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711860:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711863:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fd98000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.711865:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711868:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711879:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.711883:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fd98000/0xdfc0fb148a39632 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.711907:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f9fd880/2, rc 0, transno 993362 00000100:00100000:0.0:1713481296.711910:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.711912:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2719:3490:x1796714784484608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 28922us (28953us total) trans 4295960658 rc 0/0 00000100:00100000:3.0:1713481296.711912:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784484608:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.711919:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562538 00000100:00100000:3.0:1713481296.711934:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784487488:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.711950:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.711956:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.711970:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456448 00000100:00100000:0.0:1713481296.711972:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456448 00010000:00010000:0.0:1713481296.711979:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0db00/0xdfc0fb1488021d9 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627fc expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.711988:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820185 00000100:00100000:0.0:1713481296.711991:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1958:x1796714882456448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.711995:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.711997:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0db00/0xdfc0fb1488021d9 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627fc expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.712002:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0db00/0xdfc0fb1488021d9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627fc expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.712014:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.712015:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.712017:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.712021:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.712024:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+106:3492:x1796714784484736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 27455us (27505us total) trans 4296040767 rc 0/0 00000004:00080000:3.0:1713481296.712027:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f999180/2, rc 0, transno 1073471 00010000:00010000:0.0:1713481296.712028:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.712028:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562563 00000100:00100000:3.0:1713481296.712032:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784484736:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.712037:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1958:x1796714882456448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 45us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.712041:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820185 00000100:00100000:1.0:1713481296.712045:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784487488 00000100:00100000:3.0:1713481296.712047:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.712048:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784487488 00000100:00100000:3.0:1713481296.712051:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784487552:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.712059:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562948 00000100:00100000:1.0:1713481296.712061:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2719:3492:x1796714784487488:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.712067:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1713481296.712069:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43275 count 1 00010000:00010000:1.0:1713481296.712076:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712083:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880078281200/0xdfc0fb148688b48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d299d expref: 26936 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.712086:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784487552 00010000:00010000:1.0:1713481296.712087:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.712088:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.712089:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784487552 00010000:00010000:1.0:1713481296.712089:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712099:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880078281200/0xdfc0fb148688b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d299d expref: 26936 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.712103:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562949 00000100:00100000:0.0:1713481296.712107:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+106:3492:x1796714784487552:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.712107:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880078281200/0xdfc0fb148688b48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d299d expref: 26936 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.712113:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784487616:192.168.202.24@tcp:104: 00002000:00080000:0.0:1713481296.712117:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9924 count 1 00000100:00100000:1.0:1713481296.712141:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800985c7840 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.712146:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.712155:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c000/0xdfc0fb14880220a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96285e expref: 20851 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.712161:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.712161:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0db00/0xdfc0fb1488021d9 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9627fc expref: 20851 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.712163:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.712165:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.712173:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:16535:1796714784484928:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.712181:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c000/0xdfc0fb14880220a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96285e expref: 20850 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.712190:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c000/0xdfc0fb14880220a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96285e expref: 20850 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.712196:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.712199:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784487680:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.712201:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712205:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712209:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712212:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.712216:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800890153c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.712216:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.712217:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456384 00010000:00010000:1.0:1713481296.712220:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801302686c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.712220:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456384 00010000:00010000:1.0:1713481296.712221:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712225:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712236:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.712239:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.712239:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801302686c0/0xdfc0fb148a396da lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.712242:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485781 00000100:00100000:2.0:1713481296.712245:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2010:18604:x1796714882456384:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.712255:0:15507:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456512 00000100:00100000:0.0:1713481296.712258:0:15507:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456512 00010000:00010000:2.0:1713481296.712263:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713481296.712274:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801241b0b40/0xdfc0fb148a34994 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45c0c expref: 2010 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.712275:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562950 00000100:00100000:0.0:1713481296.712279:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:17935:x1796714882456512:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.712286:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.712295:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083accd80/0xdfc0fb148a3a17d lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49310 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.712296:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a9bc240/0xdfc0fb148a123e3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37376 expref: 2009 pid: 10467 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.712305:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb78e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.712312:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c55:0x0].0x0 (ffff880091581800) 00010000:00010000:0.0:1713481296.712313:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.712314:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.712315:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.712318:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083accd80/0xdfc0fb148a3a17d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49310 expref: 26938 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.712326:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083accd80/0xdfc0fb148a3a17d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49310 expref: 26938 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.712327:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.712333:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083accd80, rc 0) 00010000:00010000:2.0:1713481296.712336:0:15479:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2368 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.712341:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+107:3493:x1796714784484864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 26124us (26147us total) trans 4296040768 rc 0/0 00010000:00010000:2.0:1713481296.712342:0:15479:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.712346:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26938:17935:x1796714882456512:12345-192.168.202.24@tcp:101:dd.0 Request processed in 65us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.712346:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562586 00000100:00100000:0.0:1713481296.712351:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562950 00010000:00010000:2.0:1713481296.712357:0:15479:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2368 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.712365:0:15479:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2368 pid: 15479 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.712374:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007684ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796714784487744:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.712393:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d00a000 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.712424:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009faa4a80/2, rc 0, transno 1073472 00000100:00100000:2.0:1713481296.712439:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009faa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784484864:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.712440:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007287df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784485056:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.712459:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784487808:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.712464:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096f3f600/0xdfc0fb148a39815 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a9d expref: 26937 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.712468:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.712474:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f3f600, rc 0) 00000100:00100000:3.0:1713481296.712476:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.712492:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:11552:x1796714882434624:12345-192.168.202.24@tcp:101:dd.0 Request processed in 23395us (23442us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.712498:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562627 00000100:00100000:2.0:1713481296.712498:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.712513:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456768 00000100:00100000:2.0:1713481296.712515:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456768 00000100:00100000:0.0:1713481296.712523:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456576 00000100:00100000:0.0:1713481296.712527:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456576 00000100:00100000:2.0:1713481296.712538:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485782 00000100:00100000:0.0:1713481296.712539:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784487808 00000100:00100000:0.0:1713481296.712541:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784487808 00000100:00100000:2.0:1713481296.712543:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18578:x1796714882456768:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:2.0:1713481296.712560:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:1.0:1713481296.712562:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562951 00000100:00100000:1.0:1713481296.712565:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20851:18792:x1796714882456576:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.712566:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562952 00000100:00100000:0.0:1713481296.712570:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+107:3490:x1796714784487808:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.712571:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.712572:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880086c546c0/0xdfc0fb148a397f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x51e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a65 expref: 2188 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712577:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096ce6d00/0xdfc0fb148a3a18b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc50b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49317 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.712580:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9925 count 1 00002000:00010000:1.0:1713481296.712585:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc50b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.712590:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712591:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.712592:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.712595:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce6d00/0xdfc0fb148a3a18b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49317 expref: 20852 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.712600:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091652f40/0xdfc0fb148802211 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96286c expref: 20852 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.712601:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096ce6d00/0xdfc0fb148a3a18b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49317 expref: 20852 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.712604:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f387600/0xdfc0fb148a10987 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x51e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa36a5b expref: 2187 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.712605:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.712605:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096ce6d00, rc 0) 00010000:00010000:0.0:1713481296.712606:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.712607:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.712614:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:18792:x1796714882456576:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 49us (147us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.712617:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e6:0x0].0x0 (ffff880095c72f00) 00010000:00010000:0.0:1713481296.712618:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091652f40/0xdfc0fb148802211 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96286c expref: 20852 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.712618:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562951 00010000:00010000:0.0:1713481296.712623:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091652f40/0xdfc0fb148802211 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96286c expref: 20852 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.712626:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d7f180/0xdfc0fb148a3848f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c8f expref: 2186 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.712629:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a291500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784487872:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.712643:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x0 (ffff8800897e3f00) 00000100:00100000:0.0:1713481296.712644:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fc000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.712644:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784484992:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.712646:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.712656:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.712659:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2eb840/0xdfc0fb148a3980e lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a96 expref: 16845 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.712680:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2eb840, rc 0) 00010000:00010000:2.0:1713481296.712681:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712689:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.712690:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16845:18836:x1796714882434560:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 23607us (23658us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.712694:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562626 00010000:00010000:2.0:1713481296.712700:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x385e:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.712706:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.712706:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712712:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.712722:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456704 00000100:00100000:0.0:1713481296.712725:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456704 00010000:00010000:0.0:1713481296.712735:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0dad00/0xdfc0fb14891e31e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb237 expref: 20852 pid: 16509 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.712751:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820186 00000100:00100000:0.0:1713481296.712755:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1958:x1796714882456704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.712759:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.712762:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.712766:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f0dad00/0xdfc0fb14891e31e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb237 expref: 20852 pid: 16509 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.712767:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712774:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.712775:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f0dad00/0xdfc0fb14891e31e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb237 expref: 20852 pid: 16509 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.712789:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f0dad00/0xdfc0fb14891e31e lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb237 expref: 20852 pid: 16509 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.712801:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.712803:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.712806:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2eb840/0xdfc0fb148a3980e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a96 expref: 16844 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.712814:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2eb840/0xdfc0fb148a3980e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a96 expref: 16844 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.712830:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2eb840/0xdfc0fb148a3980e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8059:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a96 expref: 16844 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.712839:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a293b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784487936:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.712854:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c7d3900 going to sleep for 11 seconds 00000040:00080000:2.0:1713481296.712900:0:15483:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14789, 64 off954688 00000100:00100000:0.0:1713481296.712932:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.712934:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712941:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.712946:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456832 00000100:00100000:1.0:1713481296.712948:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456832 00010000:00010000:2.0:1713481296.712948:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712952:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.712956:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135a09440/0xdfc0fb148959c1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeba6 expref: 26937 pid: 16501 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.712957:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712961:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712966:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.712967:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820187 00010000:00010000:2.0:1713481296.712969:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007de27180 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.712970:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:1957:x1796714882456832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.712972:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.712974:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.712976:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.712981:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a09440/0xdfc0fb148959c1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeba6 expref: 26937 pid: 16501 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.712982:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e6:0x0].0x0 (ffff880095c72f00) 00010000:00010000:2.0:1713481296.712984:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1713481296.712986:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a09440/0xdfc0fb148959c1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeba6 expref: 26937 pid: 16501 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.712987:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 3/0,0 mode: --/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.712991:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27180/0xdfc0fb148a3a1ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x51e6:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.712996:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a09440/0xdfc0fb148959c1a lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeba6 expref: 26937 pid: 16501 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.713005:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713006:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713008:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096f3f600/0xdfc0fb148a39815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a9d expref: 26936 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713011:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.713013:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096f3f600/0xdfc0fb148a39815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a9d expref: 26936 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713016:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.713022:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.713023:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096f3f600/0xdfc0fb148a39815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48a9d expref: 26936 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713027:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007de25b00 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.713029:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784488000:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.713029:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.713034:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.713040:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e003e40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.713040:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e6:0x0].0x0 (ffff880095c72f00) 00010000:00010000:2.0:1713481296.713042:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.713045:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.713046:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.713049:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007de25b00/0xdfc0fb148a3a1a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x51e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.713061:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f941180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784485120:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.713076:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.713084:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1960:x1796714882436032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 22214us (22252us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.713088:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820165 00000100:00100000:1.0:1713481296.713108:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456896 00000100:00100000:1.0:1713481296.713110:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456896 00000100:00100000:1.0:1713481296.713133:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562953 00000100:00100000:1.0:1713481296.713136:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:17924:x1796714882456896:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.713140:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.713141:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784485440:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.713146:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096ce7180/0xdfc0fb148a3a1b5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4931e expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.713156:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880121e31f80/0xdfc0fb148a15fc5 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3980c expref: 20853 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.713159:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713160:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713162:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce7180/0xdfc0fb148a3a1b5 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4931e expref: 20853 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713170:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c276400/0xdfc0fb148a39926 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b6f expref: 16844 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.713171:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880121e31f80/0xdfc0fb148a15fc5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3980c expref: 20853 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.713176:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880121e31f80/0xdfc0fb148a15fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3980c expref: 20853 pid: 16534 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.713179:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007727c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784485568:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.713181:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784488064:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.713187:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c276400, rc 0) 00000100:00100000:1.0:1713481296.713192:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b98900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.713202:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.713204:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16844:8499:x1796714882437248:12345-192.168.202.24@tcp:101:dd.0 Request processed in 20646us (20746us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.713210:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562657 00000100:00100000:0.0:1713481296.713217:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882437120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 20586us (20749us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.713223:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820170 00000100:00100000:1.0:1713481296.713299:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800786d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784485632:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.713308:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.713315:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.713316:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.713320:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.713320:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.713325:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.713328:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077016680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1960:x1796714882436992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 20604us (20843us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.713329:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007de27840 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.713332:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820171 00010000:00010000:2.0:1713481296.713332:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.713337:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000100:00100000:3.0:1713481296.713338:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457024 00000100:00100000:3.0:1713481296.713341:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457024 00010000:00010000:2.0:1713481296.713344:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x0 (ffff8800897e3f00) 00010000:00010000:2.0:1713481296.713346:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.713348:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.713354:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007de27840/0xdfc0fb148a3a199 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x385e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.713365:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.713367:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485783 00000100:00100000:3.0:1713481296.713371:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18867:x1796714882457024:12345-192.168.202.24@tcp:101:touch.0 00000004:00010000:2.0:1713481296.713372:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007684d500 reply state ffff880124ed6000 transno 4295105902 ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.713378:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.713380:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.713386:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x38 (ffff880096340700) 00000100:00100000:0.0:1713481296.713388:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457088 00010000:00010000:2.0:1713481296.713388:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.713388:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b0b40/0xdfc0fb148a3a1bc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49325 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.713390:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.713391:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457088 00000100:00100000:0.0:1713481296.713413:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485784 00000100:00100000:0.0:1713481296.713418:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2009:18893:x1796714882457088:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:0.0:1713481296.713432:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.713433:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2187:18578:x1796714882456768:12345-192.168.202.24@tcp:36:rm.0 Request processed in 888us (934us total) trans 4295105902 rc 0/0 00000100:00100000:2.0:1713481296.713440:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485782 00010000:00010000:0.0:1713481296.713441:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132099b00/0xdfc0fb148a3a1c3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4932c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.713474:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.713482:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 3/1,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.713484:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457152 00000100:00100000:1.0:1713481296.713486:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457152 00010000:00010000:3.0:1713481296.713489:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.713492:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.713495:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.713497:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.713499:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98348 00010000:00010000:3.0:1713481296.713500:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.713501:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713481296.713502:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:1957:x1796714882457152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.713504:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.713506:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.713507:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.713508:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.713510:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800898b18c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.713513:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.713514:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098df9f80/0xdfc0fb148a398cb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b45 expref: 2795 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.713517:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.713518:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.713522:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff88007aaaf800) 00010000:00010000:3.0:1713481296.713524:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1713481296.713526:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.713526:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 2/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.713529:0:16568:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff880131402e00) 00010000:00010000:3.0:1713481296.713529:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b18c0/0xdfc0fb148a3a1ca lrc: 0/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.713531:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.713532:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713481296.713535:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.713540:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:1957:x1796714882457152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 37us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.713543:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98348 00000100:00100000:1.0:1713481296.713551:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882456960 00000100:00100000:2.0:1713481296.713551:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.713553:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882456960 00010000:00010000:1.0:1713481296.713558:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dab8000/0xdfc0fb1488e7e45 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54df expref: 16844 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.713563:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457280 00000100:00100000:1.0:1713481296.713566:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457216 00000100:00100000:2.0:1713481296.713566:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457280 00000100:00100000:1.0:1713481296.713567:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457216 00010000:00010000:1.0:1713481296.713572:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008334ba80/0xdfc0fb1488021e0 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96280a expref: 20854 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.713579:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b0b40/0xdfc0fb148a3a1bc lrc: 1/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49325 expref: 2370 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.713580:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820188 00000100:00100000:2.0:1713481296.713582:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562954 00000100:00100000:1.0:1713481296.713583:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16844:1958:x1796714882456960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.713584:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b0b40/0xdfc0fb148a3a1bc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49325 expref: 2370 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.713588:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.713588:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:10409:x1796714882457280:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.713590:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dab8000/0xdfc0fb1488e7e45 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54df expref: 16844 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.713595:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dab8000/0xdfc0fb1488e7e45 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54df expref: 16844 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.713595:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.713598:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800898b0b40, rc 0) 00010000:00010000:2.0:1713481296.713604:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007de273c0/0xdfc0fb148a3a1df lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49333 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.713608:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dab8000/0xdfc0fb1488e7e45 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54df expref: 16844 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.713611:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18867:x1796714882457024:12345-192.168.202.24@tcp:101:touch.0 Request processed in 239us (296us total) trans 0 rc 301/301 00010000:00010000:1.0:1713481296.713616:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.713616:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485783 00010000:00010000:1.0:1713481296.713617:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713619:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c276400/0xdfc0fb148a39926 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b6f expref: 16843 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713619:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206ceac0/0xdfc0fb14891d14a lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6de expref: 24479 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.713624:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c276400/0xdfc0fb148a39926 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b6f expref: 16843 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713626:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb14893ab1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e0 expref: 26936 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.713632:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713634:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c276400/0xdfc0fb148a39926 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b6f expref: 16843 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713634:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.713637:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007de273c0/0xdfc0fb148a3a1df lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49333 expref: 24479 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.713639:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784488128:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.713650:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.713653:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb14893ab1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e0 expref: 26936 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.713660:0:15473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007287e300 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:15473:1796714784488256:0@lo:1000:mdt00_009.0 00010000:00010000:2.0:1713481296.713661:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb14893ab1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e0 expref: 26936 pid: 16534 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.713678:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820189 00000100:00100000:1.0:1713481296.713682:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20854:1957:x1796714882457216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.713686:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.713689:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008334ba80/0xdfc0fb1488021e0 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96280a expref: 20854 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.713690:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a003b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784488192:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.713694:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008334ba80/0xdfc0fb1488021e0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96280a expref: 20854 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.713696:0:15473:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.713704:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713704:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.713706:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.713710:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713714:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801206ceac0/0xdfc0fb14891d14a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6de expref: 24479 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.713715:0:15473:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099310cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.713719:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.713723:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801206ceac0/0xdfc0fb14891d14a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6de expref: 24479 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.713727:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20854:1957:x1796714882457216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.713730:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820189 00000100:00100000:2.0:1713481296.713732:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a000380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784488320:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.713737:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008334ba80/0xdfc0fb1488021e0 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96280a expref: 20854 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.713745:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007727f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784485824:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.713746:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f0180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.713752:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784488256 00000100:00100000:1.0:1713481296.713754:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784488256 00010000:00010000:0.0:1713481296.713759:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.713764:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.713767:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.713768:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82886 00010000:00010000:0.0:1713481296.713771:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.713771:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15473:x1796714784488256:12345-0@lo:1000:mdt00_009.0 00010000:00010000:0.0:1713481296.713775:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.713783:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.713786:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bb7cd80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.713788:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.713792:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.713796:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.713800:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.713804:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb7cd80/0xdfc0fb148a3993b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.713809:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457344 00000100:00100000:1.0:1713481296.713810:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15473:x1796714784488256:12345-0@lo:1000:mdt00_009.0 Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.713812:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457344 00000100:00100000:1.0:1713481296.713814:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82886 00000100:00100000:2.0:1713481296.713831:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562955 00000100:00100000:2.0:1713481296.713835:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16844:18817:x1796714882457344:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.713843:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.713851:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007de24240/0xdfc0fb148a3a1e6 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4933a expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713865:0:16452:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880073734d80/0xdfc0fb1489cf625 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa220ba expref: 20852 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713870:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.713871:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.713874:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007de24240/0xdfc0fb148a3a1e6 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4933a expref: 16845 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713888:0:16452:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880073734d80/0xdfc0fb1489cf625 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa220ba expref: 20852 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.713897:0:16452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880073734d80/0xdfc0fb1489cf625 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa220ba expref: 20852 pid: 16533 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.713906:0:16452:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a002d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784488384:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.713922:0:16452:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.713941:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+108:3493:x1796714784485760:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21071us (21092us total) trans 4296040769 rc 0/0 00000100:00100000:0.0:1713481296.713947:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562659 00000004:00080000:2.0:1713481296.713948:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007dafc000/2, rc 0, transno 1073473 00000100:00100000:2.0:1713481296.713966:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784485760:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.713985:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077015880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16580:1796714784485376:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.713987:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784488448:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.713994:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.713999:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.714011:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882436736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 21997us (22026us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.714017:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820166 00000100:00100000:3.0:1713481296.714021:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.714030:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457408 00000100:00100000:1.0:1713481296.714033:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457408 00000100:00100000:2.0:1713481296.714040:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.714045:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784488448 00000100:00100000:1.0:1713481296.714047:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784488448 00000100:00100000:1.0:1713481296.714054:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457472 00000100:00100000:1.0:1713481296.714055:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457472 00000100:00100000:2.0:1713481296.714059:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.714062:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562956 00000100:00100000:1.0:1713481296.714065:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:10479:x1796714882457408:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.714070:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.714076:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096ce5b00/0xdfc0fb148a3a1ed lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49341 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.714079:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007727ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784485696:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.714079:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457536 00000100:00100000:3.0:1713481296.714081:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457536 00010000:00010000:1.0:1713481296.714086:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e67a80/0xdfc0fb148916d75 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c655a expref: 20854 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.714089:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714090:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714092:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce5b00/0xdfc0fb148a3a1ed lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49341 expref: 20854 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.714094:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485785 00000100:00100000:3.0:1713481296.714097:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18869:x1796714882457536:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.714098:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.714101:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e67a80/0xdfc0fb148916d75 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c655a expref: 20854 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.714103:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.714106:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e67a80/0xdfc0fb148916d75 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c655a expref: 20854 pid: 16536 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.714109:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b1b00/0xdfc0fb148a3a1f4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4934f expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.714110:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076afdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0001_UUID:15642:1796714784485888:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.714111:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784488512:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.714138:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562957 00000100:00100000:1.0:1713481296.714141:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.714143:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+108:3491:x1796714784488448:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.714155:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9926 count 1 00000100:00100000:1.0:1713481296.714155:0:15507:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562958 00010000:00010000:2.0:1713481296.714157:0:15642:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.714158:0:15507:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16846:17009:x1796714882457472:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.714164:0:15507:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.714166:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.714170:0:15507:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096ce5440/0xdfc0fb148a3a202 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49348 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.714176:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c240/0xdfc0fb148802218 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96287a expref: 20854 pid: 16538 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713481296.714178:0:15507:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.714180:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.714182:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.714184:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714184:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714185:0:15507:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.714186:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714186:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.714188:0:15507:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce5440/0xdfc0fb148a3a202 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49348 expref: 16847 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714191:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.714193:0:15507:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096ce5440/0xdfc0fb148a3a202 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49348 expref: 16847 pid: 15507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.714198:0:15507:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096ce5440, rc 0) 00010000:00010000:3.0:1713481296.714198:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.714200:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c240/0xdfc0fb148802218 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96287a expref: 20854 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.714202:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714206:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713481296.714207:0:15507:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16847:17009:x1796714882457472:12345-192.168.202.24@tcp:101:dd.0 Request processed in 48us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.714208:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c240/0xdfc0fb148802218 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96287a expref: 20854 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.714210:0:15507:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562958 00000100:00100000:0.0:1713481296.714218:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a290700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784488576:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.714228:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.714230:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a3a217 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.714233:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e113100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784486144:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.714233:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a3a217 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714236:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a3a217 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.714237:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff51540 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.714248:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.714249:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00010000:3.0:1713481296.714249:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a3a217 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714256:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.714259:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784486080:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.714260:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714264:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713481296.714265:0:15498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e0b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15498:1796714784486208:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.714267:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.714269:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.714269:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c277a80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.714271:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714274:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.714278:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714278:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.714279:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.714281:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.714283:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457600 00010000:00010000:3.0:1713481296.714284:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c277a80/0xdfc0fb148a3a209 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.714285:0:15498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b812d00/0xdfc0fb148a39973 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b7d expref: 24478 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.714286:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457600 00010000:00010000:1.0:1713481296.714291:0:15498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b812d00, rc 0) 00000100:00100000:0.0:1713481296.714293:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457728 00010000:00010000:3.0:1713481296.714294:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.714295:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457728 00010000:00010000:3.0:1713481296.714296:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714298:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880078280240/0xdfc0fb148688aed lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d293b expref: 26937 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.714299:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713481296.714300:0:15498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:14753:x1796714882437696:12345-192.168.202.24@tcp:101:dd.0 Request processed in 20425us (20472us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.714302:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c275440 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.714303:0:15498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562663 00010000:00010000:3.0:1713481296.714304:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.714306:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9261c0/0xdfc0fb1489f728b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2d7 expref: 2371 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.714308:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714311:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff8800973afd00) 00010000:00010000:3.0:1713481296.714313:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.714314:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.714316:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820190 00010000:00010000:3.0:1713481296.714317:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c275440/0xdfc0fb148a3a210 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.714321:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820191 00000100:00100000:2.0:1713481296.714321:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:1957:x1796714882457600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.714324:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2371:1958:x1796714882457728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.714328:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.714331:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.714332:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880078280240/0xdfc0fb148688aed lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa904:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d293b expref: 26937 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.714335:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9261c0/0xdfc0fb1489f728b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2d7 expref: 2372 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.714336:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800898b1b00/0xdfc0fb148a3a1f4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4934f expref: 2372 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.714340:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880078280240/0xdfc0fb148688aed lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa904:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d293b expref: 26937 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.714343:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9261c0/0xdfc0fb1489f728b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2d7 expref: 2371 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.714346:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a3a217 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4934f expref: 2371 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714349:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88009f9c3e00) 00010000:00010000:3.0:1713481296.714350:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.714351:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081c43600, rc 0) 00010000:00010000:0.0:1713481296.714355:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9261c0/0xdfc0fb1489f728b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3463:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2e2d7 expref: 2371 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.714357:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078280240/0xdfc0fb148688aed lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa904:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d293b expref: 26937 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.714364:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18869:x1796714882457536:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 266us (304us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.714367:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:2.0:1713481296.714368:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.714368:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485785 00010000:00010000:0.0:1713481296.714369:0:16580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.714369:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.714372:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.714374:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.714377:0:16580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15642 initiator: MDT1 00000100:00100000:3.0:1713481296.714381:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457792 00010000:00010000:2.0:1713481296.714384:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.714384:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457792 00010000:00010000:0.0:1713481296.714388:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.714394:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485786 00000100:00100000:3.0:1713481296.714397:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18729:x1796714882457792:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.714400:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:1958:x1796714882457728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (131us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.714401:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.714404:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820191 00010000:00010000:1.0:1713481296.714404:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.714409:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.714414:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.714415:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26936:1957:x1796714882457600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.714417:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714417:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713481296.714421:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.714421:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820190 00010000:00010000:1.0:1713481296.714424:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bb7d680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.714426:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714426:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad5d40/0xdfc0fb148a38354 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c5e expref: 2369 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.714430:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.714432:0:15473:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007287e300 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:15473:1796714784488256:0@lo:1000:mdt00_009.0 00010000:00010000:1.0:1713481296.714438:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714439:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800849a1200/0xdfc0fb148a2dd61 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x34c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa426c8 expref: 2368 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.714445:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb7d680/0xdfc0fb148a3992d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.714446:0:15642:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.714452:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714457:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c2:0x0].0x0 (ffff880093305600) 00010000:00010000:3.0:1713481296.714469:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.714478:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c42640/0xdfc0fb148a3a21e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.714480:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.714485:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.714486:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078c42640/0xdfc0fb148a3a21e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.714489:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.714492:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078c42640/0xdfc0fb148a3a21e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.714495:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009688f600/0xdfc0fb148a3a22c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x347f:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.714499:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009688f600/0xdfc0fb148a3a22c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714502:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009688f600/0xdfc0fb148a3a22c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00010000:0.0:1713481296.714505:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880078c42640/0xdfc0fb148a3a21e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714513:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714518:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714523:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714527:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714532:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d014d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.714532:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.714535:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.714536:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714542:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.714543:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713481296.714547:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2720:3490:x1796714784485504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21774us (21800us total) trans 4295960659 rc 0/0 00010000:00010000:0.0:1713481296.714551:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:1.0:1713481296.714551:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562658 00010000:00010000:0.0:1713481296.714553:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.714556:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714561:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014d80/0xdfc0fb148a3a1d1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714572:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714577:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00000004:00080000:1.0:1713481296.714579:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078411180/2, rc 0, transno 993363 00010000:00010000:0.0:1713481296.714583:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713481296.714583:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784485504:0@lo:6:osp-syn-1-1.0 00000004:00200000:2.0:1713481296.714583:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3463:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.714587:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d014900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.714589:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.714593:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.714594:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.714600:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3031 (ffff880130505e00) 00010000:00010000:2.0:1713481296.714600:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.714602:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.714604:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.714605:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.714609:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d014900/0xdfc0fb148a3a1d8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713481296.714609:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784488640:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.714610:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c41440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.714612:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.714618:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.714622:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.714625:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3463:0x0].0x0 (ffff88007376bc00) 00010000:00010000:2.0:1713481296.714627:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.714629:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.714634:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081c41440/0xdfc0fb148a39957 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.714642:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132099b00/0xdfc0fb148a3a1c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4932c expref: 2012 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.714643:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784488640 00000100:00100000:1.0:1713481296.714645:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784488640 00010000:00010000:0.0:1713481296.714654:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c42640/0xdfc0fb148a3a21e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4932c expref: 2011 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.714654:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562959 00000100:00100000:1.0:1713481296.714657:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2720:3492:x1796714784488640:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:3.0:1713481296.714657:0:15484:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31882, 64 off2048640 00010000:00010000:0.0:1713481296.714659:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff8801225f0000) 00000004:00080000:3.0:1713481296.714660:0:15484:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 715568539550ns, next at 716568538631ns, rc = 0 00010000:00010000:0.0:1713481296.714661:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.714675:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880078c42640, rc 0) 00002000:00080000:1.0:1713481296.714682:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43276 count 1 00000100:00100000:0.0:1713481296.714689:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2011:18893:x1796714882457088:12345-192.168.202.24@tcp:101:touch.0 Request processed in 1271us (1324us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.714692:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.714695:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485784 00010000:00010000:1.0:1713481296.714700:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148688b4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ab expref: 26935 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.714702:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.714703:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714704:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714706:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.714707:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714707:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.714711:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714712:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714715:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714716:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.714719:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148688b4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ab expref: 26935 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.714719:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133004240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.714720:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714721:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.714724:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148688b4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ab expref: 26935 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.714724:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714726:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714727:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713481296.714730:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e113100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784488704:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.714730:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714733:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x0 (ffff88009bdaf400) 00010000:00010000:3.0:1713481296.714733:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009688d8c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.714734:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.714734:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714737:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714737:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713481296.714740:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.714741:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133004240/0xdfc0fb148a39949 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714744:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c2:0x0].0x0 (ffff88012cf69200) 00010000:00010000:3.0:1713481296.714745:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.714747:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714750:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009688d8c0/0xdfc0fb148a3a241 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x34c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.714758:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.714767:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000004:00010000:2.0:1713481296.714768:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800815c5180 reply state ffff88009cd65000 transno 4295107569 ns: mdt-lustre-MDT0001_UUID lock: ffff880133007180/0xdfc0fb148a39950 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714770:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714773:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714776:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133007180/0xdfc0fb148a39950 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1cd:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.714776:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009688ed00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.714777:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714781:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.714782:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x3631 (ffff88008157f600) 00010000:00010000:2.0:1713481296.714784:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.714784:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c2:0x0].0x0 (ffff88012cf69200) 00010000:00010000:3.0:1713481296.714785:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1713481296.714786:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713481296.714787:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714789:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009688ed00/0xdfc0fb148a3a233 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.714798:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.714809:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2011:18678:x1796714882437376:12345-192.168.202.24@tcp:36:rm.0 Request processed in 21771us (21866us total) trans 4295107569 rc 0/0 00000100:00100000:1.0:1713481296.714813:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457920 00000100:00100000:1.0:1713481296.714815:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457920 00000100:00100000:2.0:1713481296.714815:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485777 00010000:00010000:1.0:1713481296.714823:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff0c480/0xdfc0fb1488021ee lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962826 expref: 20855 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.714833:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457856 00000100:00100000:0.0:1713481296.714834:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.714834:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457856 00010000:00010000:1.0:1713481296.714839:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0d8c0/0xdfc0fb1488021e7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962818 expref: 20856 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.714847:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882457984 00000100:00100000:1.0:1713481296.714848:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882457984 00010000:00010000:1.0:1713481296.714854:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dab5f80/0xdfc0fb148a13d58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f62 expref: 24478 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.714862:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820192 00000100:00100000:1.0:1713481296.714864:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007287e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20856:1958:x1796714882457920:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.714870:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.714872:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ff0c480/0xdfc0fb1488021ee lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962826 expref: 20856 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.714877:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ff0c480/0xdfc0fb1488021ee lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962826 expref: 20856 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.714882:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784486400:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.714891:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff0c480/0xdfc0fb1488021ee lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962826 expref: 20856 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.714902:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714903:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.714906:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.714907:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714907:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714911:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.714912:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.714914:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714917:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714919:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012024db00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.714921:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714924:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714927:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:1.0:1713481296.714928:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.714928:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.714930:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.714933:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a225 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000004:00010000:3.0:1713481296.714941:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880130435180 reply state ffff88007da4d000 transno 4295107570 ns: mdt-lustre-MDT0001_UUID lock: ffff88009688f600/0xdfc0fb148a3a22c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713481296.714943:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20855:1958:x1796714882457920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (185us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.714945:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009688f600/0xdfc0fb148a3a22c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:1.0:1713481296.714949:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820192 00010000:00010000:3.0:1713481296.714949:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x39 (ffff88012cf69b00) 00010000:00010000:3.0:1713481296.714950:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.714952:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713481296.714966:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820193 00000100:00100000:3.0:1713481296.714970:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18729:x1796714882457792:12345-192.168.202.24@tcp:36:rm.0 Request processed in 572us (743us total) trans 4295107570 rc 0/0 00000100:00100000:1.0:1713481296.714971:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820194 00000100:00100000:2.0:1713481296.714972:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800796de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20854:1957:x1796714882457856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.714975:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1957:x1796714882457984:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.714975:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485786 00010000:00010000:2.0:1713481296.714980:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.714981:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.714985:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0d8c0/0xdfc0fb1488021e7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962818 expref: 20854 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.714990:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dab5f80/0xdfc0fb148a13d58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f62 expref: 24478 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.714994:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0d8c0/0xdfc0fb1488021e7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962818 expref: 20854 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.714999:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dab5f80/0xdfc0fb148a13d58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f62 expref: 24478 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.715004:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784486464:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.715011:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0d8c0/0xdfc0fb1488021e7 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962818 expref: 20854 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.715014:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dab5f80/0xdfc0fb148a13d58 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f62 expref: 24478 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.715022:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.715023:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.715024:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.715024:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.715027:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b812d00/0xdfc0fb148a39973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b7d expref: 24477 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.715027:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715029:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715031:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b812d00/0xdfc0fb148a39973 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b7d expref: 24477 pid: 15498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.715033:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715042:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b812d00/0xdfc0fb148a39973 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b7d expref: 24477 pid: 15498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.715048:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16580:1796714784488768:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.715059:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.715060:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.715061:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715068:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715072:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715073:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.715076:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800796de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1957:x1796714882457856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 103us (277us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.715078:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715080:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.715082:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820193 00010000:00010000:0.0:1713481296.715084:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715084:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715087:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715089:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715090:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b811f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.715092:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715094:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800836b18c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.715096:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715097:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715103:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715104:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715107:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3996c lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715115:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.715137:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3995e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.715154:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.715169:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458048 00000100:00100000:2.0:1713481296.715173:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458048 00010000:00010000:2.0:1713481296.715185:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff0f3c0/0xdfc0fb1488021fc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962842 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.715202:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820195 00000100:00100000:2.0:1713481296.715207:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1958:x1796714882458048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.715214:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.715218:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ff0f3c0/0xdfc0fb1488021fc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962842 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.715227:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ff0f3c0/0xdfc0fb1488021fc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962842 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.715241:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff0f3c0/0xdfc0fb1488021fc lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962842 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.715245:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+110:3490:x1796714784486016:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21542us (21635us total) trans 4296040770 rc 0/0 00000100:00100000:1.0:1713481296.715249:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562662 00010000:00010000:2.0:1713481296.715253:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.715254:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.715257:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.715260:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+109:3493:x1796714784485952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21667us (21720us total) trans 4296040771 rc 0/0 00010000:00010000:2.0:1713481296.715264:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.715268:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562661 00000004:00080000:1.0:1713481296.715278:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800785a0000/2, rc 0, transno 1073474 00010000:00010000:2.0:1713481296.715281:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.715291:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784486016:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.715295:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1958:x1796714882458048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (141us total) trans 0 rc 0/0 00000004:00080000:0.0:1713481296.715300:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076affb80/2, rc 0, transno 1073475 00000100:00100000:2.0:1713481296.715301:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820195 00000100:00100000:0.0:1713481296.715304:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784485952:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.715311:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784488832:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.715323:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713481296.715324:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.715328:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.715329:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784488896:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.715331:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.715338:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784488832 00010000:00010000:2.0:1713481296.715339:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.715340:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784488832 00010000:00010000:2.0:1713481296.715346:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.715349:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.715351:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562960 00010000:00010000:2.0:1713481296.715352:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.715354:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+109:3493:x1796714784488832:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.715358:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800836b2d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.715361:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.715362:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9927 count 1 00010000:00010000:1.0:1713481296.715370:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.715372:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.715372:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715377:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091652400/0xdfc0fb14880221f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962888 expref: 20851 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.715381:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.715381:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.715383:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.715388:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715392:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091652400/0xdfc0fb14880221f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962888 expref: 20851 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.715394:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800836b2d00/0xdfc0fb148a399ab lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715397:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091652400/0xdfc0fb14880221f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962888 expref: 20851 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.715402:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784488960:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.715407:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.715414:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff51000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.715424:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784488896 00000100:00100000:1.0:1713481296.715426:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784488896 00000100:00100000:1.0:1713481296.715436:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562961 00000100:00100000:1.0:1713481296.715438:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+110:3491:x1796714784488896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.715444:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9928 count 1 00010000:00010000:1.0:1713481296.715450:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715456:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0cb40/0xdfc0fb148802226 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962896 expref: 20851 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.715460:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.715461:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.715463:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715470:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0cb40/0xdfc0fb148802226 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962896 expref: 20851 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.715474:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0cb40/0xdfc0fb148802226 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962896 expref: 20851 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.715479:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784489024:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.715489:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.715550:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+111:3492:x1796714784486336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21098us (21154us total) trans 4296040772 rc 0/0 00000004:00080000:1.0:1713481296.715555:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800785a1500/2, rc 0, transno 1073476 00000100:00100000:2.0:1713481296.715557:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562667 00000100:00100000:1.0:1713481296.715566:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784486336:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.715586:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458112 00000100:00100000:2.0:1713481296.715589:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458112 00000100:00100000:3.0:1713481296.715589:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784489088:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.715601:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0fa80/0xdfc0fb1488021f5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962834 expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.715606:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.715618:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820196 00000100:00100000:2.0:1713481296.715623:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1958:x1796714882458112:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.715630:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.715633:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0fa80/0xdfc0fb1488021f5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962834 expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.715641:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0fa80/0xdfc0fb1488021f5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962834 expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.715660:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0fa80/0xdfc0fb1488021f5 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962834 expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.715687:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.715688:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.715692:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.715698:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.715715:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.715719:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715726:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.715730:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20851:1958:x1796714882458112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (357us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.715731:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715734:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.715736:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820196 00010000:00010000:1.0:1713481296.715738:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715753:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800836b2f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.715755:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715759:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.715759:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784489088 00000100:00100000:2.0:1713481296.715763:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784489088 00010000:00010000:1.0:1713481296.715772:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.715776:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800836b2f40/0xdfc0fb148a399b2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.715778:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562962 00000100:00100000:2.0:1713481296.715782:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+111:3491:x1796714784489088:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.715793:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9929 count 1 00010000:00010000:2.0:1713481296.715804:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.715814:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009635e1c0/0xdfc0fb14880222d lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628a4 expref: 20850 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.715825:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.715827:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.715829:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.715845:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009635e1c0/0xdfc0fb14880222d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628a4 expref: 20850 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.715854:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009635e1c0/0xdfc0fb14880222d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628a4 expref: 20850 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.715854:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458176 00000100:00100000:3.0:1713481296.715857:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458176 00000100:00100000:2.0:1713481296.715863:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130434a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784489152:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.715877:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485787 00000100:00100000:2.0:1713481296.715879:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.715881:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18934:x1796714882458176:12345-192.168.202.24@tcp:101:touch.0 00000100:00100000:1.0:1713481296.715894:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+112:3491:x1796714784486272:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21336us (21580us total) trans 4296040773 rc 0/0 00010000:00010000:3.0:1713481296.715896:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.715898:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562668 00010000:00010000:3.0:1713481296.715907:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ae880/0xdfc0fb148a3a25d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x522e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49356 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.715936:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ae880/0xdfc0fb148a3a25d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x522e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49356 expref: 2795 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.715946:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ae880/0xdfc0fb148a3a25d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x522e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49356 expref: 2795 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.715960:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x522e:0x0].0x0 (ffff8801314b1200) 00010000:00010000:3.0:1713481296.715962:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713481296.715964:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908ae880, rc 0) 00000100:00100000:3.0:1713481296.715980:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18934:x1796714882458176:12345-192.168.202.24@tcp:101:touch.0 Request processed in 98us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.715990:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485787 00000004:00080000:1.0:1713481296.716086:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800785a3b80/2, rc 0, transno 1073477 00000100:00100000:1.0:1713481296.716099:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784486272:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.716167:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489216:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.716197:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.716223:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784489216 00000100:00100000:1.0:1713481296.716226:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784489216 00000100:00100000:1.0:1713481296.716240:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562963 00000100:00100000:1.0:1713481296.716244:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+112:3492:x1796714784489216:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.716254:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9930 count 1 00010000:00010000:1.0:1713481296.716264:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.716272:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0f600/0xdfc0fb148802234 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628b2 expref: 20850 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.716278:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.716279:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.716281:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.716296:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0f600/0xdfc0fb148802234 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628b2 expref: 20850 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.716303:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0f600/0xdfc0fb148802234 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628b2 expref: 20850 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.716316:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784489280:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.716331:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121ef0300 going to sleep for 11 seconds 00000001:00080000:3.0:1713481296.716508:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040764 00002000:00080000:3.0:1713481296.716574:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56530 00000100:00100000:1.0:1713481296.721152:0:16460:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784487424:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.721176:0:16460:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.721188:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.721202:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458240 00000100:00100000:1.0:1713481296.721205:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458240 00000100:00100000:1.0:1713481296.721222:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562964 00000100:00100000:1.0:1713481296.721225:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16847:18844:x1796714882458240:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.721231:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.721232:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.721239:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0480/0xdfc0fb148a3a26b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4935d expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.721249:0:16490:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.721257:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.721258:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.721261:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0480/0xdfc0fb148a3a26b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4935d expref: 16848 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721268:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0480/0xdfc0fb148a3a26b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4935d expref: 16848 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721273:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dcd0480, rc 0) 00000100:00100000:1.0:1713481296.721293:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16848:18844:x1796714882458240:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 67us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.721297:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562964 00000100:00100000:1.0:1713481296.721312:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458304 00000100:00100000:1.0:1713481296.721314:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458304 00000100:00100000:1.0:1713481296.721323:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562965 00000100:00100000:1.0:1713481296.721326:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:15045:x1796714882458304:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.721330:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.721333:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796714784487744:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.721337:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dcd33c0/0xdfc0fb148a3a272 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49364 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.721345:0:16490:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.721350:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.721351:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.721354:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dcd33c0/0xdfc0fb148a3a272 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49364 expref: 24479 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721357:0:15479:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.721359:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dcd33c0/0xdfc0fb148a3a272 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49364 expref: 24479 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721364:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dcd33c0, rc 0) 00000100:00100000:1.0:1713481296.721379:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:15045:x1796714882458304:12345-192.168.202.24@tcp:101:dd.0 Request processed in 52us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.721382:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562965 00000100:00100000:2.0:1713481296.721387:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008399ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15560:1796714784486976:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.721410:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784487104:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.721414:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721434:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.721451:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784486720:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.721459:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.721463:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784487168:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.721473:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784487616:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.721479:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.721484:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721490:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.721491:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.721502:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.721504:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458432 00000100:00100000:1.0:1713481296.721505:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458432 00000100:00100000:2.0:1713481296.721515:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a291500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784487872:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.721520:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125669 00000100:00100000:0.0:1713481296.721522:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.721523:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2011:18871:x1796714882458432:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:0.0:1713481296.721533:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.721533:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.721545:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.721550:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784486528:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.721558:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.721567:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800843533c0/0xdfc0fb148a3a122 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49302 expref: 26935 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.721575:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.721575:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800843533c0, rc 0) 00000100:00100000:2.0:1713481296.721594:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26935:11388:x1796714882455616:12345-192.168.202.24@tcp:101:dd.0 Request processed in 11374us (11792us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.721598:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459456 00000100:00100000:2.0:1713481296.721599:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562940 00000100:00100000:3.0:1713481296.721603:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459456 00000100:00100000:2.0:1713481296.721612:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458496 00000100:00100000:2.0:1713481296.721614:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458496 00000100:00100000:2.0:1713481296.721623:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458624 00000100:00100000:2.0:1713481296.721624:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458624 00000100:00100000:3.0:1713481296.721624:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485788 00000100:00100000:3.0:1713481296.721630:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2187:18899:x1796714882459456:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.721632:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459264 00000100:00100000:2.0:1713481296.721633:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459264 00000100:00100000:2.0:1713481296.721638:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459520 00000100:00100000:0.0:1713481296.721640:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.721640:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459520 00000100:00100000:1.0:1713481296.721641:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2012:18871:x1796714882458432:12345-192.168.202.24@tcp:35:touch.0 Request processed in 115us (162us total) trans 4295107571 rc 0/0 00000100:00100000:1.0:1713481296.721645:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125669 00000100:00100000:2.0:1713481296.721647:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562966 00010000:00010000:3.0:1713481296.721647:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.721650:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16850:17935:x1796714882458496:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.721655:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.721658:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a279 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49387 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721663:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007de25d40/0xdfc0fb148a3a280 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4936b expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.721684:0:16537:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562967 00000100:00100000:1.0:1713481296.721687:0:16537:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20851:18792:x1796714882458624:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.721691:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.721692:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.721693:0:16537:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.721700:0:16537:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dcd2880/0xdfc0fb148a3a287 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc50c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49372 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721703:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.721704:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.721705:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.721709:0:16537:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc50c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.721709:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007de25d40/0xdfc0fb148a3a280 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4936b expref: 16851 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721715:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.721716:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.721719:0:16537:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dcd2880/0xdfc0fb148a3a287 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49372 expref: 20852 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721719:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007de25d40/0xdfc0fb148a3a280 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4936b expref: 16851 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.721725:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.721725:0:16537:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dcd2880/0xdfc0fb148a3a287 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49372 expref: 20852 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721727:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007de25d40, rc 0) 00010000:00010000:1.0:1713481296.721729:0:16537:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dcd2880, rc 0) 00000100:00100000:0.0:1713481296.721736:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.721737:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.721746:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16851:17935:x1796714882458496:12345-192.168.202.24@tcp:101:dd.0 Request processed in 94us (254us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.721747:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721750:0:16537:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:18792:x1796714882458624:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 63us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.721752:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562966 00000100:00100000:1.0:1713481296.721755:0:16537:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562967 00010000:00010000:3.0:1713481296.721755:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.721762:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.721767:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562968 00010000:00010000:3.0:1713481296.721767:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721770:0:16537:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562969 00000100:00100000:2.0:1713481296.721770:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16850:11552:x1796714882459264:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.721773:0:16537:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16850:18836:x1796714882459520:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.721773:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.721775:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.721777:0:16537:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.721779:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.721782:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801344bc480/0xdfc0fb148a3a29c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49379 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721783:0:16537:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0fc0/0xdfc0fb148a3a2a3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49380 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.721791:0:16537:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f0ed680/0xdfc0fb14891e4d0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb444 expref: 20851 pid: 16539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721793:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090573a80/0xdfc0fb148959bf7 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebad expref: 16852 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.721796:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.721796:0:16537:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.721797:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.721798:0:16537:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0fc0/0xdfc0fb148a3a2a3 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49380 expref: 16852 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721798:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.721800:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801344bc480/0xdfc0fb148a3a29c lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49379 expref: 16852 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.721807:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.721810:0:16537:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f0ed680/0xdfc0fb14891e4d0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb444 expref: 20851 pid: 16539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.721811:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090573a80/0xdfc0fb148959bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebad expref: 16852 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.721816:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090573a80/0xdfc0fb148959bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebad expref: 16852 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.721819:0:16537:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f0ed680/0xdfc0fb14891e4d0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb444 expref: 20851 pid: 16539 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.721822:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784489408:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.721825:0:16537:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16537:1796714784489344:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.721826:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.721826:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af180/0xdfc0fb148a3a2aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.721838:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800816266c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.721838:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af180/0xdfc0fb148a3a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721843:0:16537:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f8e40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.721844:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af180/0xdfc0fb148a3a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.721860:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a293b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784487936:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.721862:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458688 00000100:00100000:1.0:1713481296.721864:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458688 00000100:00100000:0.0:1713481296.721868:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00200000:3.0:1713481296.721869:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x513e:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.721872:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880078281200/0xdfc0fb148688b48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d299d expref: 26935 pid: 16504 timeout: 815 lvb_type: 1 00000004:00200000:3.0:1713481296.721873:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713481296.721875:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.721884:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458816 00000100:00100000:1.0:1713481296.721885:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458816 00000004:00010000:3.0:1713481296.721886:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af180/0xdfc0fb148a3a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.721890:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2369 pid: 15479 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.721892:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20851:1958:x1796714882456704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 9135us (9186us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.721894:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721896:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458944 00000100:00100000:1.0:1713481296.721897:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458944 00000100:00100000:2.0:1713481296.721898:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820186 00010000:00010000:3.0:1713481296.721899:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.721902:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008afddf80/0xdfc0fb148941a3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00d2 expref: 24479 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.721904:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721907:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459072 00000100:00100000:1.0:1713481296.721909:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459072 00010000:00010000:3.0:1713481296.721909:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.721913:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009635d680/0xdfc0fb148802203 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962850 expref: 20851 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.721914:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800908af3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.721917:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721919:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459200 00000100:00100000:2.0:1713481296.721919:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459392 00000100:00100000:1.0:1713481296.721920:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459200 00000100:00100000:2.0:1713481296.721922:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459392 00010000:00010000:3.0:1713481296.721922:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.721924:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8073c0/0xdfc0fb148688b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2973 expref: 26936 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.721929:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458560 00010000:00010000:3.0:1713481296.721929:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000100:00100000:0.0:1713481296.721930:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.721931:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458560 00010000:00010000:3.0:1713481296.721932:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.721933:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800970461c0/0xdfc0fb148688b10 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2957 expref: 26938 pid: 16486 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.721934:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.721935:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148688b41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d298f expref: 26938 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.721940:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458752 00010000:00010000:3.0:1713481296.721940:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a28e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721941:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458752 00010000:00010000:1.0:1713481296.721945:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c000/0xdfc0fb14880220a lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96285e expref: 20852 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.721946:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882458880 00000100:00100000:2.0:1713481296.721948:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882458880 00000100:00100000:1.0:1713481296.721951:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459008 00000100:00100000:1.0:1713481296.721952:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459008 00010000:00010000:1.0:1713481296.721957:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096af2f40/0xdfc0fb148688af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2949 expref: 26939 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.721957:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091652f40/0xdfc0fb148802211 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96286c expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.721959:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721963:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459136 00000100:00100000:1.0:1713481296.721964:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459136 00000100:00100000:2.0:1713481296.721964:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459328 00010000:00010000:3.0:1713481296.721964:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.721966:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459328 00010000:00010000:3.0:1713481296.721968:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.721969:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096af18c0/0xdfc0fb148688b17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2965 expref: 26941 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.721972:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c3533c0/0xdfc0fb148688b25 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2981 expref: 26941 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.721972:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800908ad440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.721974:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.721976:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820197 00000100:00100000:1.0:1713481296.721979:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26941:1957:x1796714882458688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.721979:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.721981:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820198 00010000:00010000:1.0:1713481296.721983:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.721984:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800786d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:1957:x1796714882458816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.721984:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff880096325b00) 00010000:00010000:1.0:1713481296.721985:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880078281200/0xdfc0fb148688b48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d299d expref: 26941 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.721987:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.721989:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.721989:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.721993:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2369 pid: 15479 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.721993:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a295 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.721994:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880078281200/0xdfc0fb148688b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d299d expref: 26941 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.721998:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2369 pid: 15479 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.722006:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078281200/0xdfc0fb148688b48 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d299d expref: 26941 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.722007:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078570fc0/0xdfc0fb148a3999d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa48b8b expref: 2369 pid: 15479 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.722014:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722015:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722017:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722021:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722023:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:2.0:1713481296.722026:0:6918:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.722030:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a279 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49387 expref: 2189 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722031:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.722033:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.722034:0:6918:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.722042:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af180/0xdfc0fb148a3a2aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49387 expref: 2188 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722046:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.722049:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784487680:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.722052:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x513e:0x0].0x0 (ffff880136289900) 00010000:00010000:3.0:1713481296.722055:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1713481296.722056:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26940:1957:x1796714882458688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (523us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.722057:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908af180, rc 0) 00000100:00100000:2.0:1713481296.722058:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:1957:x1796714882458816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.722060:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820197 00000100:00100000:2.0:1713481296.722063:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820198 00010000:00010000:0.0:1713481296.722066:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.722075:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820199 00000100:00100000:1.0:1713481296.722078:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820200 00000100:00100000:2.0:1713481296.722079:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1957:x1796714882458944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.722080:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1957:x1796714882459072:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.722084:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18899:x1796714882459456:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 453us (508us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.722085:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.722085:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.722088:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009635d680/0xdfc0fb148802203 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962850 expref: 20853 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.722090:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a292a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784487296:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.722090:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008afddf80/0xdfc0fb148941a3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00d2 expref: 24479 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.722091:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485788 00010000:00010000:1.0:1713481296.722093:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009635d680/0xdfc0fb148802203 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962850 expref: 20853 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.722098:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008afddf80/0xdfc0fb148941a3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00d2 expref: 24479 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.722104:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722104:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009635d680/0xdfc0fb148802203 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962850 expref: 20853 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.722111:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722112:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722114:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722114:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008afddf80/0xdfc0fb148941a3a lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00d2 expref: 24479 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.722118:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722144:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.722151:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.722152:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.722156:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820201 00000100:00100000:1.0:1713481296.722156:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1957:x1796714882459072:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (465us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.722156:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800843533c0/0xdfc0fb148a3a122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49302 expref: 26939 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.722162:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26939:1957:x1796714882459200:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.722162:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800843533c0/0xdfc0fb148a3a122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49302 expref: 26939 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.722164:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820202 00000100:00100000:1.0:1713481296.722168:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820200 00010000:00010000:0.0:1713481296.722170:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.722170:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26939:1957:x1796714882458560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.722175:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8073c0/0xdfc0fb148688b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa908:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2973 expref: 26939 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.722176:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800843533c0/0xdfc0fb148a3a122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49302 expref: 26939 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.722180:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.722182:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820203 00000100:00100000:2.0:1713481296.722182:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a292a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784489472:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.722185:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8073c0/0xdfc0fb148688b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa908:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2973 expref: 26939 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.722185:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26939:1957:x1796714882459392:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.722186:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148688b41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d298f expref: 26939 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.722189:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.722192:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800970461c0/0xdfc0fb148688b10 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa906:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2957 expref: 26939 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.722196:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c7d3900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.722196:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148688b41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d298f expref: 26939 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.722198:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800970461c0/0xdfc0fb148688b10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa906:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2957 expref: 26939 pid: 16486 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.722204:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8073c0/0xdfc0fb148688b1e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa908:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2973 expref: 26939 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.722207:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722208:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722210:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722214:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722215:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.722216:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148688b41 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d298f expref: 26938 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.722217:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.722217:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820204 00010000:00010000:0.0:1713481296.722220:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722220:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.722220:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20851:1957:x1796714882458752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.722225:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.722228:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c000/0xdfc0fb14880220a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96285e expref: 20851 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.722229:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26937:1957:x1796714882459392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 44us (504us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.722229:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.722230:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.722231:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.722233:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820203 00010000:00010000:2.0:1713481296.722234:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c000/0xdfc0fb14880220a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96285e expref: 20851 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.722234:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.722241:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.722243:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820205 00000100:00100000:1.0:1713481296.722246:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26936:1957:x1796714882459008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.722246:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c000/0xdfc0fb14880220a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96285e expref: 20851 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.722247:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.722250:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.722252:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096af2f40/0xdfc0fb148688af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa905:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2949 expref: 26936 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.722256:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.722257:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722258:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096af2f40/0xdfc0fb148688af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa905:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2949 expref: 26936 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.722258:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.722262:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26936:1957:x1796714882459200:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 100us (556us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.722263:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722265:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096af2f40/0xdfc0fb148688af4 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa905:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2949 expref: 26936 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.722265:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.722268:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820201 00010000:00010000:2.0:1713481296.722274:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.722275:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722276:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722278:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.722284:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20850:1957:x1796714882458752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (521us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.722285:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.722285:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26934:1957:x1796714882458560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 114us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.722286:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820206 00000100:00100000:2.0:1713481296.722289:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820204 00000100:00100000:0.0:1713481296.722290:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20850:1957:x1796714882458880:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.722293:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.722293:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820202 00010000:00010000:0.0:1713481296.722296:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.722300:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091652f40/0xdfc0fb148802211 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96286c expref: 20850 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.722300:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26934:1957:x1796714882459008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.722304:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820205 00010000:00010000:0.0:1713481296.722307:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091652f40/0xdfc0fb148802211 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96286c expref: 20849 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.722313:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820207 00000100:00100000:1.0:1713481296.722317:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820208 00000100:00100000:2.0:1713481296.722317:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26932:1957:x1796714882459136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.722322:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26932:1957:x1796714882459328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.722323:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091652f40/0xdfc0fb148802211 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96286c expref: 20849 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.722324:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.722328:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.722328:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096af18c0/0xdfc0fb148688b17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa907:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2965 expref: 26932 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.722332:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c3533c0/0xdfc0fb148688b25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2981 expref: 26932 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.722337:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096af18c0/0xdfc0fb148688b17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa907:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2965 expref: 26932 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.722338:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.722340:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722341:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c3533c0/0xdfc0fb148688b25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2981 expref: 26932 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.722342:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722349:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722352:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096af18c0/0xdfc0fb148688b17 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa907:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2965 expref: 26932 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.722357:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c3533c0/0xdfc0fb148688b25 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2981 expref: 26932 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.722364:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.722365:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.722366:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722368:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.722368:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722369:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.722370:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722372:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722375:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.722377:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20848:1957:x1796714882458880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.722383:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820206 00010000:00010000:2.0:1713481296.722384:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.722386:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.722394:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26930:1957:x1796714882459136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 77us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.722397:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26930:1957:x1796714882459328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.722398:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820207 00000100:00100000:1.0:1713481296.722401:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820208 00010000:00010000:0.0:1713481296.722412:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722420:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722421:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722425:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722428:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722430:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722431:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722434:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722435:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722437:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722441:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722441:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722441:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722444:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078144fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.722446:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722447:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084350240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.722448:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722450:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722450:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722454:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722456:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722460:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800962be880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.722460:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722463:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722464:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880078144fc0/0xdfc0fb148a3a137 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722469:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722472:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.722478:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084350240/0xdfc0fb148a3a161 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722489:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722496:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962be880/0xdfc0fb148a3a13e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.722604:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+114:3490:x1796714784486784:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11617us (11685us total) trans 4296040775 rc 0/0 00010000:00010000:3.0:1713481296.722605:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.722608:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562943 00010000:00010000:3.0:1713481296.722614:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.722622:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722628:0:15479:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.722628:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722632:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.722635:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.722641:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800962bdf80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.722644:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801344bc240/0xdfc0fb148a3a2b1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3474:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.722644:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.722646:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2721:3493:x1796714784486912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11563us (11703us total) trans 4295960660 rc 0/0 00010000:00010000:2.0:1713481296.722649:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801344bc240/0xdfc0fb148a3a2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.722650:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.722653:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562944 00010000:00010000:2.0:1713481296.722653:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801344bc240/0xdfc0fb148a3a2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.722689:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.722696:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962bdf80/0xdfc0fb148a3a168 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa90a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.722709:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081c5df80/2, rc 0, transno 1073479 00010000:00010000:2.0:1713481296.722711:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.722716:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.722718:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784486784:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.722720:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.722735:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722742:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722750:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722756:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722763:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722770:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124c90d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.722772:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722776:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722784:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722788:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124c90d80/0xdfc0fb148a3a129 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.722800:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2722:3491:x1796714784487232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11428us (11475us total) trans 4295960661 rc 0/0 00000100:00100000:0.0:1713481296.722806:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562946 00000040:00080000:2.0:1713481296.722815:0:15479:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31883, 64 off2048704 00000004:00080000:0.0:1713481296.722837:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008399ea00/2, rc 0, transno 993364 00010000:00010000:2.0:1713481296.722846:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.722854:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722860:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.722865:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2722:3491:x1796714784487360:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11256us (11293us total) trans 4295960662 rc 0/0 00010000:00010000:2.0:1713481296.722866:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722871:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.722873:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562947 00010000:00010000:2.0:1713481296.722879:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722882:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722884:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800784ba1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.722886:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722889:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.722893:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008399ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784486912:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.722893:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c55:0x0].0x0 (ffff880091581800) 00010000:00010000:2.0:1713481296.722895:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:1.0:1713481296.722896:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2721:3493:x1796714784486592:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12233us (12265us total) trans 4295960663 rc 0/0 00010000:00010000:2.0:1713481296.722897:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 3/0,0 mode: --/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722899:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800784ba1c0/0xdfc0fb148a3a2bf lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2c55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.722901:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562942 00000004:00080000:0.0:1713481296.722907:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083183480/2, rc 0, transno 993367 00000100:00100000:0.0:1713481296.722911:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784486592:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.722919:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.722922:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722922:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722924:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.722926:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722927:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800784bb3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.722928:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.722930:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722934:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722934:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.722937:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c55:0x0].0x0 (ffff880091581800) 00010000:00010000:1.0:1713481296.722938:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.722938:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.722940:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.722942:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096ce4240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.722942:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800784bb3c0/0xdfc0fb148a3a2b8 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.722943:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722947:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.722955:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.722958:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121aea680/2, rc 0, transno 993366 00010000:00010000:1.0:1713481296.722959:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096ce4240/0xdfc0fb148a3a16f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa90b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.722962:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784487360:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.722971:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081c5c000/2, rc 0, transno 993365 00000100:00100000:0.0:1713481296.722973:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784487232:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.722977:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.722984:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784489600:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.723000:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.723017:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.723020:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.723023:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.723026:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.723028:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723028:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007de24d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.723029:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.723032:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.723036:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723036:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:2.0:1713481296.723037:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.723038:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.723042:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007de24d80/0xdfc0fb148a3a184 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.723043:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723045:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2721:3492:x1796714784487488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10982us (11094us total) trans 4295960664 rc 0/0 00000100:00100000:1.0:1713481296.723048:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562948 00010000:00010000:0.0:1713481296.723050:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.723053:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a291880 reply state ffff88009cd63000 transno 4295107572 ns: mdt-lustre-MDT0001_UUID lock: ffff8801344bc240/0xdfc0fb148a3a2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.723056:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723058:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801344bc240/0xdfc0fb148a3a2b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.723061:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x3131 (ffff880096d83e00) 00010000:00010000:0.0:1713481296.723062:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083acf3c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.723062:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.723064:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784489600 00000100:00100000:2.0:1713481296.723064:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.723065:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723066:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784489600 00010000:00010000:0.0:1713481296.723072:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.723081:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2013:18604:x1796714882456384:12345-192.168.202.24@tcp:36:rm.0 Request processed in 10835us (11170us total) trans 4295107572 rc 0/0 00000100:00100000:2.0:1713481296.723085:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485781 00010000:00010000:0.0:1713481296.723086:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723086:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562970 00000100:00100000:1.0:1713481296.723089:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801202cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2721:3491:x1796714784489600:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.723092:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a192 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.723098:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43278 count 1 00010000:00010000:1.0:1713481296.723106:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723107:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723112:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723116:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b806f40/0xdfc0fb148688b64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29c7 expref: 26928 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.723116:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723135:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723136:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.723137:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.723138:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723139:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723146:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078146640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.723147:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723149:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b806f40/0xdfc0fb148688b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29c7 expref: 26928 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.723151:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723154:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b806f40/0xdfc0fb148688b64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29c7 expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.723160:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784489664:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.723161:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723164:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078146640/0xdfc0fb148a3a145 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723172:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d596c0 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.723190:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121aead80/2, rc 0, transno 993368 00000100:00100000:1.0:1713481296.723193:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784487488:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.723196:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.723200:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489536:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.723211:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.723235:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784488000:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.723249:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.723258:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2722:3493:x1796714784487040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12092us (12144us total) trans 4295960665 rc 0/0 00000100:00100000:1.0:1713481296.723259:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1957:x1796714882456832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 10288us (10329us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.723263:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562945 00000100:00100000:1.0:1713481296.723266:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820187 00000100:00100000:2.0:1713481296.723276:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784489536 00000100:00100000:2.0:1713481296.723278:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784489536 00000100:00100000:1.0:1713481296.723288:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16580:1796714784488768:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.723297:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562971 00000100:00100000:2.0:1713481296.723300:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2722:3492:x1796714784489536:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.723304:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:2.0:1713481296.723308:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43277 count 1 00000100:00100000:1.0:1713481296.723311:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1957:x1796714882457984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 8336us (8478us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.723315:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820194 00010000:00010000:2.0:1713481296.723316:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723323:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ad21680/0xdfc0fb148688b56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29b9 expref: 26927 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.723330:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.723331:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.723333:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723342:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ad21680/0xdfc0fb148688b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29b9 expref: 26927 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.723347:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ad21680/0xdfc0fb148688b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29b9 expref: 26927 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.723353:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784489728:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.723364:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.723378:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784488064:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.723390:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784489792:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.723394:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+114:3490:x1796714784487808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10821us (10914us total) trans 4296040776 rc 0/0 00010000:00010000:1.0:1713481296.723395:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096ce7180/0xdfc0fb148a3a1b5 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4931e expref: 20847 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.723401:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562952 00010000:00010000:1.0:1713481296.723402:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096ce7180, rc 0) 00000100:00100000:2.0:1713481296.723402:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.723412:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007287d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20847:17924:x1796714882456896:12345-192.168.202.24@tcp:101:dd.0 Request processed in 10276us (10367us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.723416:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562953 00000100:00100000:0.0:1713481296.723420:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784489792 00000100:00100000:0.0:1713481296.723423:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784489792 00010000:00010000:1.0:1713481296.723440:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800970461c0/0xdfc0fb148688b10 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2957 expref: 26927 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.723441:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.723442:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562972 00000100:00100000:0.0:1713481296.723446:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+114:3491:x1796714784489792:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.723449:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784486848:192.168.202.24@tcp:104: 00002000:00080000:0.0:1713481296.723456:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9931 count 1 00010000:00010000:1.0:1713481296.723461:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723465:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723466:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723473:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723475:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb14880223b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628c0 expref: 20846 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.723477:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723480:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723481:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.723483:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.723484:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723485:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723489:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800962bd440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.723490:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723494:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723497:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb14880223b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628c0 expref: 20846 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.723502:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723504:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb14880223b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628c0 expref: 20846 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.723505:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962bd440/0xdfc0fb148a3a130 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.723512:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784489856:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.723525:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.723533:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784488960:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.723548:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723558:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489920:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.723560:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723566:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.723566:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130434a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784489152:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.723571:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.723577:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723579:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723581:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713481296.723582:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723584:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489984:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.723588:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.723589:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.723591:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.723592:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083acdd40 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.723594:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784490048:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.723595:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723600:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723607:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784489024:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.723607:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.723611:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723616:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a176 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723622:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.723623:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459648 00000100:00100000:2.0:1713481296.723625:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459648 00000100:00100000:1.0:1713481296.723633:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784489920 00000100:00100000:1.0:1713481296.723635:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784489920 00000100:00100000:2.0:1713481296.723642:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784489984 00000100:00100000:2.0:1713481296.723644:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784489984 00000100:00100000:1.0:1713481296.723646:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784490048 00000100:00100000:1.0:1713481296.723647:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784490048 00000100:00100000:3.0:1713481296.723657:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562973 00000100:00100000:2.0:1713481296.723662:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562974 00000100:00100000:1.0:1713481296.723680:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562975 00000100:00100000:2.0:1713481296.723680:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+2725:3492:x1796714784489920:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.723680:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16853:17009:x1796714882459648:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.723683:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800815c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2725:3492:x1796714784489984:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.723689:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43279 count 1 00010000:00010000:3.0:1713481296.723690:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:1.0:1713481296.723693:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43280 count 1 00010000:00010000:2.0:1713481296.723697:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723700:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.723703:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908afcc0/0xdfc0fb148a3a2e9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4938e expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.723705:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013449d440/0xdfc0fb148688b87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29d5 expref: 26926 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.723707:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096af0240/0xdfc0fb148688b8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29e3 expref: 26926 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.723708:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.723709:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.723711:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.723711:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723712:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.723714:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.723717:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.723721:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013449d440/0xdfc0fb148688b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29d5 expref: 26926 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.723724:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096af0240/0xdfc0fb148688b8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29e3 expref: 26926 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.723726:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013449d440/0xdfc0fb148688b87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29d5 expref: 26926 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.723728:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.723729:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096af0240/0xdfc0fb148688b8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29e3 expref: 26926 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.723729:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.723732:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007684f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:16535:1796714784490112:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.723734:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908afcc0/0xdfc0fb148a3a2e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4938e expref: 16854 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723735:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800815c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784490176:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.723743:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f03c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.723745:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908afcc0/0xdfc0fb148a3a2e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4938e expref: 16854 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.723749:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59600 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.723754:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908afcc0, rc 0) 00000100:00100000:0.0:1713481296.723755:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+115:3492:x1796714784487552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11646us (11685us total) trans 4296040777 rc 0/0 00000100:00100000:2.0:1713481296.723757:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562976 00000100:00100000:2.0:1713481296.723760:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2725:3491:x1796714784490048:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.723761:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562949 00000004:00080000:1.0:1713481296.723766:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ae8a80/2, rc 0, transno 1073481 00002000:00080000:2.0:1713481296.723767:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43281 count 1 00000100:00100000:1.0:1713481296.723771:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784487552:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.723771:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16854:17009:x1796714882459648:12345-192.168.202.24@tcp:101:dd.0 Request processed in 108us (331us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.723773:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.723778:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562973 00010000:00010000:2.0:1713481296.723779:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013449d8c0/0xdfc0fb148688ba3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29f1 expref: 26926 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.723783:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.723784:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.723786:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.723791:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f9fd180/2, rc 0, transno 993369 00010000:00010000:2.0:1713481296.723794:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013449d8c0/0xdfc0fb148688ba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29f1 expref: 26926 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.723796:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784487040:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.723798:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013449d8c0/0xdfc0fb148688ba3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29f1 expref: 26926 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.723804:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007684ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784490240:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.723813:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364a80 going to sleep for 11 seconds 00000004:00080000:0.0:1713481296.723826:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ae9500/2, rc 0, transno 1073480 00000100:00100000:0.0:1713481296.723829:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784487808:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.723834:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.723839:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801202c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784490304:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.723845:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784490368:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.723849:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784490432:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.723855:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.723874:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.723890:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784490304 00000100:00100000:0.0:1713481296.723893:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784490368 00000100:00100000:2.0:1713481296.723893:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784490304 00000100:00100000:0.0:1713481296.723896:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784490368 00000100:00100000:1.0:1713481296.723901:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.723918:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784490432 00000100:00100000:2.0:1713481296.723920:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784490432 00000100:00100000:3.0:1713481296.723928:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562977 00000100:00100000:0.0:1713481296.723934:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562978 00000100:00100000:3.0:1713481296.723935:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2727:3490:x1796714784490304:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.723938:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+116:3492:x1796714784490368:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.723938:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562979 00000100:00100000:1.0:1713481296.723941:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+116:3493:x1796714784490432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.723947:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9932 count 1 00002000:00080000:1.0:1713481296.723950:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9933 count 1 00002000:00080000:3.0:1713481296.723950:0:16460:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43282 count 1 00010000:00010000:0.0:1713481296.723954:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723958:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.723962:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c480/0xdfc0fb148802242 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ce expref: 20846 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.723962:0:16460:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723964:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091651200/0xdfc0fb148802249 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628dc expref: 20846 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.723966:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.723967:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.723968:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723968:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.723968:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.723970:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.723972:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.723974:0:16460:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133da6640/0xdfc0fb148688baa lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ff expref: 26926 pid: 16531 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.723978:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c480/0xdfc0fb148802242 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ce expref: 20846 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.723981:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.723982:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.723983:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c480/0xdfc0fb148802242 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ce expref: 20846 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.723985:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.723988:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091651200/0xdfc0fb148802249 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628dc expref: 20846 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.723993:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784490496:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.723996:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091651200/0xdfc0fb148802249 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628dc expref: 20846 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.723996:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a003b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784488192:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.724003:0:16460:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133da6640/0xdfc0fb148688baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ff expref: 26926 pid: 16531 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.724004:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.724006:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784490560:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.724014:0:16460:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133da6640/0xdfc0fb148688baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ff expref: 26926 pid: 16531 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724018:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a000380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784488320:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.724022:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.724025:0:16460:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784490624:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.724027:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.724038:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459776 00010000:00010000:2.0:1713481296.724040:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007de273c0/0xdfc0fb148a3a1df lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49333 expref: 24477 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724041:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459776 00010000:00010000:2.0:1713481296.724047:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007de273c0, rc 0) 00000100:00100000:3.0:1713481296.724047:0:16460:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.724057:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125670 00000100:00100000:2.0:1713481296.724057:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:10409:x1796714882457280:12345-192.168.202.24@tcp:101:dd.0 Request processed in 10470us (10507us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.724060:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2188:18578:x1796714882459776:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:2.0:1713481296.724061:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562954 00000100:00100000:2.0:1713481296.724078:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459968 00000100:00100000:2.0:1713481296.724080:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459968 00000100:00100000:0.0:1713481296.724090:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.724092:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562980 00000100:00100000:2.0:1713481296.724096:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20847:14753:x1796714882459968:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.724103:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.724111:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4000/0xdfc0fb148a3a30c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49395 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.724115:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.724143:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008306f840/0xdfc0fb148a13e00 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f69 expref: 20848 pid: 16521 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.724148:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724149:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.724150:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.724151:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4000/0xdfc0fb148a3a30c lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49395 expref: 20848 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724163:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008306f840/0xdfc0fb148a13e00 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f69 expref: 20848 pid: 16521 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.724165:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.724166:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2189:18578:x1796714882459776:12345-192.168.202.24@tcp:35:rm.0 Request processed in 103us (197us total) trans 4295105903 rc 0/0 00010000:00010000:2.0:1713481296.724171:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008306f840/0xdfc0fb148a13e00 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f69 expref: 20848 pid: 16521 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.724173:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125670 00000100:00100000:0.0:1713481296.724179:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.724180:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784490688:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.724191:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.724195:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f0180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.724207:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.724211:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784488128:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.724219:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a002d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784488384:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.724225:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.724232:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.724240:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.724241:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007de24240/0xdfc0fb148a3a1e6 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4933a expref: 16853 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724246:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16853:1958:x1796714882456960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 10661us (10748us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.724250:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007de24240, rc 0) 00000100:00100000:1.0:1713481296.724252:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820188 00000100:00100000:3.0:1713481296.724254:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460224 00000100:00100000:3.0:1713481296.724258:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460224 00000100:00100000:2.0:1713481296.724263:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16853:18817:x1796714882457344:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 10427us (10468us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.724268:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.724268:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562955 00000100:00100000:3.0:1713481296.724278:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460416 00000100:00100000:3.0:1713481296.724281:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460416 00000100:00100000:0.0:1713481296.724285:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.724286:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460864 00000100:00100000:2.0:1713481296.724289:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460864 00000100:00100000:3.0:1713481296.724295:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460672 00000100:00100000:3.0:1713481296.724298:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460672 00000100:00100000:2.0:1713481296.724302:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460992 00000100:00100000:1.0:1713481296.724303:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460288 00000100:00100000:2.0:1713481296.724304:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460992 00000100:00100000:1.0:1713481296.724306:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460288 00000100:00100000:3.0:1713481296.724310:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460736 00000100:00100000:0.0:1713481296.724311:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.724313:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460736 00010000:00010000:1.0:1713481296.724316:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801206ceac0/0xdfc0fb14891d14a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6de expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724318:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461120 00000100:00100000:2.0:1713481296.724320:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461120 00000100:00100000:3.0:1713481296.724325:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460928 00000100:00100000:3.0:1713481296.724328:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460928 00000100:00100000:0.0:1713481296.724330:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.724330:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562981 00000100:00100000:1.0:1713481296.724332:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460544 00000100:00100000:1.0:1713481296.724334:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460544 00000100:00100000:2.0:1713481296.724334:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16852:18844:x1796714882460864:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.724340:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.724342:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c240/0xdfc0fb148802218 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96287a expref: 20851 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.724344:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.724344:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485789 00010000:00010000:2.0:1713481296.724348:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0b6f40/0xdfc0fb148a3a313 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493b8 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.724350:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2190:18893:x1796714882460224:12345-192.168.202.24@tcp:101:touch.0 00000100:00100000:1.0:1713481296.724353:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460480 00000100:00100000:0.0:1713481296.724355:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.724355:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460480 00010000:00010000:3.0:1713481296.724358:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713481296.724359:0:16452:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.724362:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e67a80/0xdfc0fb148916d75 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0xaf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c655a expref: 20852 pid: 16536 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.724367:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.724368:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.724369:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3a31a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4939c expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724370:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.724373:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461056 00010000:00010000:2.0:1713481296.724374:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0b6f40/0xdfc0fb148a3a313 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493b8 expref: 16853 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724375:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461056 00000100:00100000:0.0:1713481296.724381:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.724384:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090573a80/0xdfc0fb148959bf7 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebad expref: 16854 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.724384:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0b6f40/0xdfc0fb148a3a313 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493b8 expref: 16854 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724389:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0b6f40, rc 0) 00000100:00100000:0.0:1713481296.724392:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.724396:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459584 00000100:00100000:1.0:1713481296.724399:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459584 00000100:00100000:2.0:1713481296.724399:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16854:18844:x1796714882460864:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.724403:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562981 00010000:00010000:1.0:1713481296.724406:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121e31f80/0xdfc0fb148a15fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3980c expref: 20853 pid: 16534 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724415:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461184 00000100:00100000:2.0:1713481296.724417:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461184 00000100:00100000:1.0:1713481296.724419:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459904 00000100:00100000:1.0:1713481296.724421:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459904 00000100:00100000:2.0:1713481296.724425:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461312 00000100:00100000:2.0:1713481296.724426:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461312 00010000:00010000:1.0:1713481296.724429:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0cb40/0xdfc0fb148802226 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962896 expref: 20854 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724433:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461376 00010000:00010000:3.0:1713481296.724433:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132099b00/0xdfc0fb148a3a321 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.724434:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461376 00000100:00100000:1.0:1713481296.724436:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460096 00000100:00100000:1.0:1713481296.724438:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460096 00010000:00010000:3.0:1713481296.724440:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132099b00/0xdfc0fb148a3a321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.724442:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562982 00010000:00010000:1.0:1713481296.724443:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0f600/0xdfc0fb148802234 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628b2 expref: 20856 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724444:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20856:1957:x1796714882460992:12345-192.168.202.24@tcp:2:touch.0 00010000:00010000:3.0:1713481296.724448:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132099b00/0xdfc0fb148a3a321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.724452:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820209 00000100:00100000:1.0:1713481296.724455:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1958:x1796714882460288:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.724460:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.724462:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801206ceac0/0xdfc0fb14891d14a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6de expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.724468:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801206ceac0/0xdfc0fb14891d14a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6de expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00000004:00200000:3.0:1713481296.724471:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x38b1:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.724474:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713481296.724476:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206ceac0/0xdfc0fb14891d14a lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6de expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.724481:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.724488:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.724497:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:1958:x1796714882460288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 41us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.724501:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.724501:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820209 00010000:00010000:3.0:1713481296.724501:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800836b18c0/0xdfc0fb148a3a31a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4939c expref: 2192 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.724515:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.724522:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132099b00/0xdfc0fb148a3a321 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4939c expref: 2191 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.724523:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20857:1957:x1796714882460992:12345-192.168.202.24@tcp:2:touch.0 Request processed in 77us (255us total) trans 4296040778 rc 0/0 00000100:00100000:2.0:1713481296.724527:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562982 00000100:00100000:0.0:1713481296.724528:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.724528:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff880130505e00) 00010000:00010000:3.0:1713481296.724531:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1713481296.724533:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132099b00, rc 0) 00000100:00100000:1.0:1713481296.724534:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460352 00000100:00100000:1.0:1713481296.724536:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460352 00000100:00100000:2.0:1713481296.724539:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562983 00010000:00010000:1.0:1713481296.724541:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880073734d80/0xdfc0fb1489cf625 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa220ba expref: 20857 pid: 16533 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.724542:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20857:18792:x1796714882461120:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.724546:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.724547:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461248 00000100:00100000:1.0:1713481296.724548:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461248 00000100:00100000:3.0:1713481296.724551:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2191:18893:x1796714882460224:12345-192.168.202.24@tcp:101:touch.0 Request processed in 201us (462us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.724552:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4900/0xdfc0fb148a3a328 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc50d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493bf expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724553:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0ed680/0xdfc0fb14891e4d0 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb444 expref: 20858 pid: 16539 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.724558:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882459840 00000100:00100000:3.0:1713481296.724558:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485789 00000100:00100000:1.0:1713481296.724559:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882459840 00002000:00010000:2.0:1713481296.724562:0:16452:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc50d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.724563:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091652400/0xdfc0fb14880221f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962888 expref: 20859 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.724568:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460032 00010000:00010000:2.0:1713481296.724568:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.724569:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460032 00010000:00010000:2.0:1713481296.724569:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724572:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4900/0xdfc0fb148a3a328 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493bf expref: 20861 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724573:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009635e1c0/0xdfc0fb14880222d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628a4 expref: 20861 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.724577:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4900/0xdfc0fb148a3a328 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493bf expref: 20861 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724579:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820210 00000100:00100000:1.0:1713481296.724582:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20861:1958:x1796714882460544:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.724582:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0b4900, rc 0) 00010000:00010000:1.0:1713481296.724585:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.724586:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485790 00000100:00100000:0.0:1713481296.724587:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.724588:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c240/0xdfc0fb148802218 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96287a expref: 20861 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724590:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20861:18792:x1796714882461120:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.724591:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:18869:x1796714882460416:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:1.0:1713481296.724593:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c240/0xdfc0fb148802218 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96287a expref: 20861 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724594:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562983 00010000:00010000:3.0:1713481296.724599:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.724604:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.724605:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.724605:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562984 00010000:00010000:1.0:1713481296.724607:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.724608:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16854:8499:x1796714882461184:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.724608:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d014900/0xdfc0fb148a3a32f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493a3 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724611:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724611:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.724614:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c240/0xdfc0fb148802218 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96287a expref: 20860 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.724616:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0b5680/0xdfc0fb148a3a336 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493c6 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724620:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.724624:0:16452:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfcad00/0xdfc0fb1488e7e99 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ed expref: 16855 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.724625:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a290700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784488576:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.724627:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20859:1958:x1796714882460544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 44us (478us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.724629:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724629:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.724631:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820210 00010000:00010000:2.0:1713481296.724632:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0b5680/0xdfc0fb148a3a336 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493c6 expref: 16855 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724639:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460160 00010000:00010000:0.0:1713481296.724641:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724641:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460160 00010000:00010000:2.0:1713481296.724642:0:16452:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfcad00/0xdfc0fb1488e7e99 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ed expref: 16855 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.724645:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb14893ab1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e0 expref: 26928 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.724647:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724647:0:16452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cfcad00/0xdfc0fb1488e7e99 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ed expref: 16855 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.724652:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820211 00000100:00100000:2.0:1713481296.724652:0:16452:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784490752:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.724653:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724654:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:1958:x1796714882460480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.724658:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.724659:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.724662:0:16452:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007371fb40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.724679:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724682:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e67a80/0xdfc0fb148916d75 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0xaf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c655a expref: 20858 pid: 16536 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.724685:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d014d80/0xdfc0fb148a3a33d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.724686:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724688:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e67a80/0xdfc0fb148916d75 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c655a expref: 20858 pid: 16536 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.724690:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d015200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.724693:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.724693:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d014d80/0xdfc0fb148a3a33d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.724697:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562985 00010000:00010000:1.0:1713481296.724698:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.724699:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.724700:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:17935:x1796714882461312:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.724700:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d014d80/0xdfc0fb148a3a33d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.724701:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096ce5b00/0xdfc0fb148a3a1ed lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49341 expref: 20858 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.724702:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724705:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce5b00/0xdfc0fb148a3a1ed lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xaf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49341 expref: 20858 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724705:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.724711:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724712:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bba4240/0xdfc0fb148a3a344 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493cd expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.724714:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d015200/0xdfc0fb148a3a1fb lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724720:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096ce5b00/0xdfc0fb148a3a1ed lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xaf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49341 expref: 20858 pid: 16528 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.724721:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb78f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.724726:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e404e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784490816:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.724726:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724727:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724729:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bba4240/0xdfc0fb148a3a344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493cd expref: 26929 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724735:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bba4240/0xdfc0fb148a3a344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493cd expref: 26929 pid: 16544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724736:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff51000 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.724739:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bba4240, rc 0) 00000100:00100000:2.0:1713481296.724748:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26929:17935:x1796714882461312:12345-192.168.202.24@tcp:101:dd.0 Request processed in 47us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.724751:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820212 00000100:00100000:2.0:1713481296.724751:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562985 00000100:00100000:1.0:1713481296.724754:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16855:1958:x1796714882461056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.724758:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.724761:0:16544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562986 00010000:00010000:1.0:1713481296.724764:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090573a80/0xdfc0fb148959bf7 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebad expref: 16855 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724764:0:16544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:15045:x1796714882461376:12345-192.168.202.24@tcp:101:dd.0 00000004:00200000:3.0:1713481296.724764:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x3899:0x0]: returning size 4096 00010000:00010000:2.0:1713481296.724767:0:16544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1713481296.724767:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1713481296.724769:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090573a80/0xdfc0fb148959bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebad expref: 16855 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.724773:0:16544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bba61c0/0xdfc0fb148a3a34b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493d4 expref: -99 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724778:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.724779:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713481296.724779:0:16544:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.724781:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801344bc480/0xdfc0fb148a3a29c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49379 expref: 16855 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724784:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.724785:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801344bc480/0xdfc0fb148a3a29c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49379 expref: 16855 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724785:0:16544:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724787:0:16544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bba61c0/0xdfc0fb148a3a34b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493d4 expref: 20859 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.724792:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d014900/0xdfc0fb148a3a32f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493a3 expref: 2798 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724793:0:16544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bba61c0/0xdfc0fb148a3a34b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493d4 expref: 20859 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724794:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801344bc480/0xdfc0fb148a3a29c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49379 expref: 16855 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724797:0:16544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bba61c0, rc 0) 00000100:00100000:1.0:1713481296.724803:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e406680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784490880:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.724803:0:16544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20859:15045:x1796714882461376:12345-192.168.202.24@tcp:101:dd.0 Request processed in 38us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.724806:0:16544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562986 00010000:00010000:3.0:1713481296.724809:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d014d80/0xdfc0fb148a3a33d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493a3 expref: 2797 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724812:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff51540 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.724816:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88007da00600) 00010000:00010000:3.0:1713481296.724818:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1713481296.724821:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820213 00010000:00010000:3.0:1713481296.724821:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d014d80, rc 0) 00000100:00100000:2.0:1713481296.724823:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:1959:x1796714882459584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.724824:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820214 00000100:00100000:1.0:1713481296.724826:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20858:1959:x1796714882459904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.724828:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.724830:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.724831:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121e31f80/0xdfc0fb148a15fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3980c expref: 20858 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.724833:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0cb40/0xdfc0fb148802226 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962896 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.724837:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121e31f80/0xdfc0fb148a15fc5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3980c expref: 20858 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.724838:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0cb40/0xdfc0fb148802226 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962896 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.724847:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0cb40/0xdfc0fb148802226 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962896 expref: 20858 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.724848:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121e31f80/0xdfc0fb148a15fc5 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3980c expref: 20858 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.724853:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.724854:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.724856:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724856:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724857:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724859:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096ce7180/0xdfc0fb148a3a1b5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4931e expref: 20856 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724860:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724864:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce7180/0xdfc0fb148a3a1b5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4931e expref: 20856 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724871:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.724874:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096ce7180/0xdfc0fb148a3a1b5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4931e expref: 20856 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.724879:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784490944:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.724879:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:18869:x1796714882460416:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 287us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.724880:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20856:1959:x1796714882459904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.724886:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820214 00000100:00100000:3.0:1713481296.724886:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485790 00000100:00100000:0.0:1713481296.724891:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+117:3491:x1796714784488448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10746us (10867us total) trans 4296040779 rc 0/0 00000100:00100000:2.0:1713481296.724891:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e688b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.724897:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562957 00000100:00100000:1.0:1713481296.724898:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820215 00000100:00100000:1.0:1713481296.724900:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20855:1959:x1796714882460096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.724904:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.724905:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820216 00010000:00010000:1.0:1713481296.724907:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0f600/0xdfc0fb148802234 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628b2 expref: 20855 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.724908:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20855:1959:x1796714882460352:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.724910:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485791 00010000:00010000:1.0:1713481296.724912:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0f600/0xdfc0fb148802234 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628b2 expref: 20855 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.724912:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.724914:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880073734d80/0xdfc0fb1489cf625 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa220ba expref: 20855 pid: 16533 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.724914:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2190:18678:x1796714882460672:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:1.0:1713481296.724922:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.724922:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.724923:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724923:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880073734d80/0xdfc0fb1489cf625 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa220ba expref: 20855 pid: 16533 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.724925:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724928:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.724930:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485792 00010000:00010000:3.0:1713481296.724933:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008300fa80/0xdfc0fb148a3a352 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493aa expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724935:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.724935:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073734d80/0xdfc0fb1489cf625 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa220ba expref: 20855 pid: 16533 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.724936:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:18874:x1796714882460736:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:1.0:1713481296.724941:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20854:1959:x1796714882460096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 40us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.724944:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820215 00010000:00010000:2.0:1713481296.724944:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.724945:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.724945:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.724947:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007de24240/0xdfc0fb148a3a1e6 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4933a expref: 16855 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724951:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007de24240/0xdfc0fb148a3a1e6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4933a expref: 16855 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.724952:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078c43180/0xdfc0fb148a3a359 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493b1 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.724952:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820217 00000100:00100000:1.0:1713481296.724954:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1959:x1796714882461248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.724958:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.724960:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007de24240/0xdfc0fb148a3a1e6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4933a expref: 16855 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724961:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f0ed680/0xdfc0fb14891e4d0 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb444 expref: 20853 pid: 16539 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.724965:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784491008:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.724966:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f0ed680/0xdfc0fb14891e4d0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb444 expref: 20853 pid: 16539 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.724972:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.724973:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.724973:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.724975:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0fc0/0xdfc0fb148a3a2a3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49380 expref: 16855 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724979:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0fc0/0xdfc0fb148a3a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49380 expref: 16855 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.724989:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0fc0/0xdfc0fb148a3a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49380 expref: 16855 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.724991:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090573a80/0xdfc0fb148959bf7 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebad expref: 16855 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.724992:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.724994:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e406a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784491072:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.724999:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.724999:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.725002:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784489408:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.725003:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f80c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.725005:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.725006:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.725010:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713481296.725015:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801344bc480/0xdfc0fb148a3a29c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49379 expref: 16854 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725016:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713481296.725018:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820218 00010000:00010000:3.0:1713481296.725018:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x230:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.725020:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713481296.725021:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20853:1959:x1796714882459840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.725023:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713481296.725023:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801344bc480, rc 0) 00010000:00010000:1.0:1713481296.725024:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.725024:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.725027:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091652400/0xdfc0fb14880221f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962888 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.725029:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.725030:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16854:11552:x1796714882459264:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3260us (3509us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.725032:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091652400/0xdfc0fb14880221f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962888 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.725034:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562968 00010000:00010000:1.0:1713481296.725040:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091652400/0xdfc0fb14880221f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962888 expref: 20853 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.725048:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6640/0xdfc0fb148a3a37c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725048:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.725049:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.725050:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.725052:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485793 00010000:00010000:0.0:1713481296.725054:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6640/0xdfc0fb148a3a37c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725054:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.725055:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2368:18729:x1796714882460928:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:0.0:1713481296.725060:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6640/0xdfc0fb148a3a37c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725063:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.725069:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c98c0/0xdfc0fb148a3a383 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x386d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.725071:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20852:1959:x1796714882459840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 49us (556us total) trans 0 rc 0/0 00000004:00010000:0.0:1713481296.725072:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6640/0xdfc0fb148a3a37c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713481296.725074:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820218 00010000:00010000:3.0:1713481296.725076:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c98c0/0xdfc0fb148a3a383 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x386d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.725078:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.725080:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.725082:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c98c0/0xdfc0fb148a3a383 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x386d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.725083:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820219 00010000:00010000:0.0:1713481296.725085:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713481296.725086:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079564380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20851:1959:x1796714882460032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.725086:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f850b40/0xdfc0fb148a3837e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c65 expref: 2368 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725089:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.725090:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725092:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009635e1c0/0xdfc0fb14880222d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628a4 expref: 20851 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.725095:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725097:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009635e1c0/0xdfc0fb14880222d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628a4 expref: 20851 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.725098:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c84:0x0].0x0 (ffff880124d79000) 00010000:00010000:2.0:1713481296.725099:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.725100:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c23f840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.725103:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725104:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009635e1c0/0xdfc0fb14880222d lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628a4 expref: 20851 pid: 15511 timeout: 815 lvb_type: 1 00000004:00200000:3.0:1713481296.725104:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x386d:0x0]: returning size 0 00000004:00200000:3.0:1713481296.725106:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.725108:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713481296.725108:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.725110:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.725111:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.725113:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725113:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.725115:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000004:00010000:3.0:1713481296.725115:0:15475:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c98c0/0xdfc0fb148a3a383 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x386d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.725117:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725117:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.725135:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.725138:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713481296.725140:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463c000/0xdfc0fb148a3a391 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x347f:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.725142:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c23f840/0xdfc0fb148a3a367 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725142:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.725144:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013463c000/0xdfc0fb148a3a391 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725147:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013463c000/0xdfc0fb148a3a391 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.725147:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c98c0/0xdfc0fb148a3a383 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x386d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.725149:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079564380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20850:1959:x1796714882460032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (622us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.725151:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713481296.725153:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820219 00010000:00010000:3.0:1713481296.725154:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.725155:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.725159:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.725160:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00010000:00010000:0.0:1713481296.725163:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099b8cb40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.725164:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.725165:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 00000100:00100000:1.0:1713481296.725165:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820220 00000100:00100000:1.0:1713481296.725167:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1959:x1796714882460160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.725169:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.725170:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.725171:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.725173:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.725174:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff88009993a400) 00010000:00010000:1.0:1713481296.725174:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb14893ab1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e0 expref: 26928 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.725175:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008300c000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.725176:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.725177:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.725178:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:1.0:1713481296.725178:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb14893ab1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e0 expref: 26928 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.725178:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.725180:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.725182:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099b8cb40/0xdfc0fb148a3a36e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.725184:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.725188:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb14893ab1a lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e0 expref: 26928 pid: 16534 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.725192:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88007aaaf800) 00010000:00010000:3.0:1713481296.725194:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.725197:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.725197:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.725199:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.725201:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007de273c0/0xdfc0fb148a3a1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49333 expref: 24475 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.725202:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008300c000/0xdfc0fb148a3a360 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.725205:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007de273c0/0xdfc0fb148a3a1df lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49333 expref: 24475 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725211:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078c43180/0xdfc0fb148a3a359 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493b1 expref: 2798 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725213:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007de273c0/0xdfc0fb148a3a1df lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49333 expref: 24475 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.725218:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784491136:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.725218:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.725223:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.725227:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b98900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.725228:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6640/0xdfc0fb148a3a37c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493b1 expref: 2797 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.725228:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.725233:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff880091605b00) 00010000:00010000:3.0:1713481296.725233:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c1c86c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.725235:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.725236:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.725237:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a6e6640, rc 0) 00010000:00010000:3.0:1713481296.725240:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.725247:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x39 (ffff88012cf69200) 00010000:00010000:1.0:1713481296.725248:0:16537:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f0ed680/0xdfc0fb14891e4d0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb444 expref: 20849 pid: 16539 timeout: 815 lvb_type: 0 00000040:00080000:2.0:1713481296.725249:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3431, 64 off227776 00010000:00010000:3.0:1713481296.725249:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.725250:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:18874:x1796714882460736:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 316us (1042us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.725252:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.725255:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485792 00000100:00100000:1.0:1713481296.725256:0:16537:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16537:1796714784489344:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.725257:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c86c0/0xdfc0fb148a3a375 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.725270:0:16537:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0fc0/0xdfc0fb148a3a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49380 expref: 16853 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725273:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.725274:0:16537:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dcd0fc0, rc 0) 00010000:00010000:2.0:1713481296.725280:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.725282:0:16537:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800786d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16853:18836:x1796714882459520:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 3509us (3725us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.725285:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.725286:0:16537:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562969 00010000:00010000:2.0:1713481296.725291:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725295:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.725298:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008300fa80/0xdfc0fb148a3a352 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493aa expref: 2192 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725300:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15642 initiator: MDT1 00000004:00080000:0.0:1713481296.725301:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121aea300/2, rc 0, transno 1073483 00010000:00010000:2.0:1713481296.725305:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.725308:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784488448:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.725310:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e113100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784488704:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.725310:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013463cfc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.725313:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725318:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.725324:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.725324:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c98c0/0xdfc0fb148a3a383 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x386d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493aa expref: 2191 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725325:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c84:0x0].0x0 (ffff880124d79000) 00010000:00010000:2.0:1713481296.725327:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713481296.725330:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 3/0,0 mode: --/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725334:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cfc0/0xdfc0fb148a3a39f lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2c84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.725336:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x386d:0x0].0x0 (ffff880096442100) 00010000:00010000:1.0:1713481296.725337:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.725338:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.725341:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c1c98c0, rc 0) 00010000:00010000:1.0:1713481296.725342:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.725343:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491200:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.725346:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725349:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725353:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725356:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b60d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.725357:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.725358:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.725359:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2191:18678:x1796714882460672:12345-192.168.202.24@tcp:101:rm.0 Request processed in 443us (1166us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.725360:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.725362:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725363:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.725365:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.725366:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013463f840 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:3.0:1713481296.725366:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485791 00010000:00010000:2.0:1713481296.725367:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725370:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.725372:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725374:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c84:0x0].0x0 (ffff880124d79000) 00010000:00010000:2.0:1713481296.725375:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.725376:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b60d80/0xdfc0fb148a3a24f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725377:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725379:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013463f840/0xdfc0fb148a3a398 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:3.0:1713481296.725397:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784491200 00000100:00100000:3.0:1713481296.725400:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784491200 00000100:00100000:3.0:1713481296.725420:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562987 00000100:00100000:3.0:1713481296.725424:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+118:3490:x1796714784491200:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.725437:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9934 count 1 00010000:00010000:2.0:1713481296.725449:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.725449:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725452:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725455:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725458:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.725459:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.725460:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bba5200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.725461:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c50900/0xdfc0fb148802250 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ea expref: 20848 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.725462:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725464:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.725467:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.725469:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.725470:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:2.0:1713481296.725471:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.725472:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725474:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 3/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725478:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009bba5200/0xdfc0fb148a3a38a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.725479:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882460608 00000100:00100000:0.0:1713481296.725482:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882460608 00000100:00100000:1.0:1713481296.725484:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+118:3491:x1796714784488896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10044us (10133us total) trans 4296040780 rc 0/0 00000100:00100000:1.0:1713481296.725488:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562961 00000004:00010000:2.0:1713481296.725490:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800784c3b80 reply state ffff880090975000 transno 4295107573 ns: mdt-lustre-MDT0001_UUID lock: ffff88013463c000/0xdfc0fb148a3a391 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.725491:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081c50900/0xdfc0fb148802250 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ea expref: 20848 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.725494:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148688b4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ab expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.725496:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013463c000/0xdfc0fb148a3a391 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.725502:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x37 (ffff8801225f6500) 00010000:00010000:3.0:1713481296.725502:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081c50900/0xdfc0fb148802250 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ea expref: 20848 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.725504:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.725506:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.725512:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820221 00000100:00100000:3.0:1713481296.725512:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784491264:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.725518:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1959:x1796714882460608:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.725518:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e67a80/0xdfc0fb148916d75 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c655a expref: 20848 pid: 16536 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.725525:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.725527:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18729:x1796714882460928:12345-192.168.202.24@tcp:36:rm.0 Request processed in 470us (1285us total) trans 4295107573 rc 0/0 00010000:00010000:0.0:1713481296.725529:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148688b4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ab expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.725529:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784488512:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.725532:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.725533:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485793 00010000:00010000:0.0:1713481296.725542:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148688b4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ab expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.725545:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096ce5b00/0xdfc0fb148a3a1ed lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xaf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49341 expref: 20847 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725550:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096ce5b00, rc 0) 00010000:00010000:2.0:1713481296.725558:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.725559:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20847:10479:x1796714882457408:12345-192.168.202.24@tcp:101:dd.0 Request processed in 11494us (11567us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.725561:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148688b4f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ab expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.725563:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562956 00010000:00010000:2.0:1713481296.725563:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725568:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725571:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725572:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.725574:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.725575:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725576:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725578:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007de24000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.725580:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725581:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725583:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725583:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725585:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725589:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725593:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725593:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725597:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.725598:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007de24000/0xdfc0fb148a3a256 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725599:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.725601:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122522880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.725602:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725606:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.725613:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26927:1959:x1796714882460608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.725613:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725618:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122522880/0xdfc0fb148a3a248 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.725620:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820221 00000004:00080000:0.0:1713481296.725653:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121aeb480/2, rc 0, transno 1073484 00000100:00100000:0.0:1713481296.725660:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784488896:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.725691:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725698:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725709:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725715:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725721:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.725726:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096ce6400 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.725727:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+119:3491:x1796714784489088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9943us (10118us total) trans 4296040781 rc 0/0 00010000:00010000:0.0:1713481296.725728:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.725733:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562962 00010000:00010000:0.0:1713481296.725734:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.725741:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+119:3493:x1796714784488832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10385us (10411us total) trans 4296040782 rc 0/0 00010000:00010000:0.0:1713481296.725745:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.725745:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562960 00010000:00010000:0.0:1713481296.725751:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096ce6400/0xdfc0fb148a3a23a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa90c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.725771:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ae9880/2, rc 0, transno 1073486 00000100:00100000:1.0:1713481296.725774:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784488832:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.725793:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0f600/0xdfc0fb148802234 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628b2 expref: 20846 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.725805:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784489280:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.725827:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725834:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725840:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725847:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725853:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725860:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725866:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dcd0000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.725868:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.725875:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.725887:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2728:3492:x1796714784488640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11227us (11262us total) trans 4295960667 rc 0/0 00010000:00010000:1.0:1713481296.725891:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.725893:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562959 00010000:00010000:1.0:1713481296.725902:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dcd0000/0xdfc0fb148a3a264 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.725926:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ae9c00/2, rc 0, transno 1073485 00000100:00100000:0.0:1713481296.725930:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784489088:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713481296.725949:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078ce7100/2, rc 0, transno 993371 00000100:00100000:0.0:1713481296.725954:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784488640:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.725982:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.725989:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491328:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.726011:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.726043:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+118:3492:x1796714784489216:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9797us (9843us total) trans 4296040783 rc 0/0 00000100:00100000:1.0:1713481296.726049:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562963 00000004:00080000:0.0:1713481296.726051:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130437480/2, rc 0, transno 1073487 00000100:00100000:0.0:1713481296.726055:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489216:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.726065:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784491328 00000100:00100000:0.0:1713481296.726068:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784491328 00000100:00100000:0.0:1713481296.726081:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562988 00000100:00100000:0.0:1713481296.726085:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2728:3490:x1796714784491328:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.726094:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43283 count 1 00010000:00010000:0.0:1713481296.726104:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.726113:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013449cd80/0xdfc0fb148688bb8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a0d expref: 26926 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.726117:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2728:3491:x1796714784486656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15488us (15517us total) trans 4295960666 rc 0/0 00010000:00010000:0.0:1713481296.726134:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.726136:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.726137:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562941 00010000:00010000:0.0:1713481296.726138:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.726153:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013449cd80/0xdfc0fb148688bb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a0d expref: 26926 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.726165:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013449cd80/0xdfc0fb148688bb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a0d expref: 26926 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.726172:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079564700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784491392:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.726187:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.726230:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801322a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491584:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.726249:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.726267:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.726271:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801322a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491648:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.726287:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.726296:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801322a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784491520:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713481296.726301:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f9ff800/2, rc 0, transno 993370 00000100:00100000:2.0:1713481296.726307:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784486656:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.726311:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.726314:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784491456:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.726330:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784491584 00000100:00100000:2.0:1713481296.726331:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713481296.726332:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.726333:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784491584 00000100:00100000:2.0:1713481296.726338:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784491712:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.726342:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784491648 00000100:00100000:1.0:1713481296.726344:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784491648 00000100:00100000:1.0:1713481296.726349:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784491520 00000100:00100000:1.0:1713481296.726350:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784491520 00000100:00100000:1.0:1713481296.726355:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784491456 00000100:00100000:1.0:1713481296.726356:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784491456 00000100:00100000:2.0:1713481296.726357:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.726361:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562989 00000100:00100000:1.0:1713481296.726363:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784491712 00000100:00100000:1.0:1713481296.726364:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784491712 00000100:00100000:0.0:1713481296.726366:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+121:3490:x1796714784491584:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.726372:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562990 00000100:00100000:1.0:1713481296.726375:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+121:3490:x1796714784491648:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.726377:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9937 count 1 00002000:00080000:1.0:1713481296.726383:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9938 count 1 00010000:00010000:1.0:1713481296.726391:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.726394:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562991 00000100:00100000:2.0:1713481296.726398:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+121:3493:x1796714784491520:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.726402:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb14880226c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962922 expref: 20845 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.726406:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.726407:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.726409:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.726411:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9936 count 1 00010000:00010000:1.0:1713481296.726419:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb14880226c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962922 expref: 20845 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.726419:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.726424:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb14880226c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962922 expref: 20845 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.726427:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091653a80/0xdfc0fb14880225e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962906 expref: 20845 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.726430:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784491776:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.726431:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.726432:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.726434:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.726444:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091653a80/0xdfc0fb14880225e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962906 expref: 20845 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.726445:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121ef0300 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.726450:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091653a80/0xdfc0fb14880225e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962906 expref: 20845 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.726456:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784491840:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.726457:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562992 00000100:00100000:1.0:1713481296.726460:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+121:3492:x1796714784491456:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.726461:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.726466:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9935 count 1 00000100:00100000:2.0:1713481296.726470:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099f51000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.726472:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148802265 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962914 expref: 20845 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.726473:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.726478:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.726479:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.726479:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0ddf80/0xdfc0fb148802257 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628f8 expref: 20845 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.726481:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.726483:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.726484:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.726484:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562993 00010000:00010000:1.0:1713481296.726485:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.726487:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2728:3493:x1796714784491712:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.726493:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43284 count 1 00010000:00010000:1.0:1713481296.726494:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0ddf80/0xdfc0fb148802257 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628f8 expref: 20845 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.726500:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148802265 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962914 expref: 20845 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.726500:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d0ddf80/0xdfc0fb148802257 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628f8 expref: 20845 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.726500:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.726505:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784491904:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.726506:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148688bcd lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a1b expref: 26926 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.726508:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148802265 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962914 expref: 20845 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.726509:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.726510:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.726512:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.726514:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.726517:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072865880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784491968:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.726520:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148688bcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a1b expref: 26926 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.726525:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148688bcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a1b expref: 26926 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.726534:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784492032:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.726537:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941da80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.726543:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c86c0 going to sleep for 11 seconds 00000001:00080000:3.0:1713481296.727104:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040774 00000100:00100000:0.0:1713481296.727160:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.727235:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461504 00002000:00080000:3.0:1713481296.727235:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56658 00000100:00100000:1.0:1713481296.727241:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461504 00000100:00100000:2.0:1713481296.727251:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a292a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784489472:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.727263:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125671 00000100:00100000:1.0:1713481296.727268:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2191:18899:x1796714882461504:12345-192.168.202.24@tcp:35:mrename.0 00010000:00010000:2.0:1713481296.727270:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.727299:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24475:1957:x1796714882458944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5218us (5658us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.727304:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820199 00000100:00100000:0.0:1713481296.727342:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784489856:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.727343:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18899:x1796714882461504:12345-192.168.202.24@tcp:35:mrename.0 Request processed in 74us (184us total) trans 4295105904 rc 0/0 00000100:00100000:1.0:1713481296.727348:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125671 00010000:00010000:0.0:1713481296.727358:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.727367:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784489728:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.727383:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784489664:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.727386:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.727402:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.727578:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.727613:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461632 00000100:00100000:2.0:1713481296.727616:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461632 00000100:00100000:0.0:1713481296.727627:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.727637:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485794 00000100:00100000:2.0:1713481296.727641:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2013:18604:x1796714882461632:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:1.0:1713481296.727650:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800815c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784490176:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.727677:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.727678:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.727688:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079bd8b40/0xdfc0fb148a349cc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3486:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa45c13 expref: 2013 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.727699:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3486:0x0].0x0 (ffff880083588f00) 00010000:00010000:2.0:1713481296.727701:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.727709:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.727710:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.727715:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.727719:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.727722:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.727725:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052ed00/0xdfc0fb148a3a3de lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3474:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.727730:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012052ed00/0xdfc0fb148a3a3de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.727733:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462080 00010000:00010000:2.0:1713481296.727735:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012052ed00/0xdfc0fb148a3a3de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.727736:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462080 00000100:00100000:3.0:1713481296.727743:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462208 00000100:00100000:0.0:1713481296.727745:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.727748:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462208 00000100:00100000:1.0:1713481296.727749:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462016 00000100:00100000:1.0:1713481296.727751:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462016 00000100:00100000:1.0:1713481296.727757:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462272 00000100:00100000:1.0:1713481296.727758:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462272 00000100:00100000:0.0:1713481296.727759:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.727766:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462336 00000100:00100000:1.0:1713481296.727767:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462336 00010000:00010000:2.0:1713481296.727771:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713481296.727771:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485795 00000100:00100000:1.0:1713481296.727776:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562994 00000100:00100000:3.0:1713481296.727777:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18578:x1796714882462208:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:2.0:1713481296.727778:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.727779:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16855:11388:x1796714882462080:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.727784:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.727785:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.727791:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350f7180/0xdfc0fb148a3a3ec lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6973:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493e2 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.727803:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097d1cd80/0xdfc0fb148941a41 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6973:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00e0 expref: 20846 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.727804:0:15483:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1713481296.727807:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.727808:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.727810:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f7180/0xdfc0fb148a3a3ec lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6973:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493e2 expref: 16856 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.727818:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3b46c0/0xdfc0fb148a38b8f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47f9f expref: 2192 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.727821:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097d1cd80/0xdfc0fb148941a41 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6973:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00e0 expref: 20846 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.727826:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097d1cd80/0xdfc0fb148941a41 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6973:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00e0 expref: 20846 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.727835:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784492096:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.727839:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009688a880/0xdfc0fb148a10328 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3682b expref: 2191 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.727852:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.727852:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x0 (ffff8800897e3f00) 00000040:00080000:2.0:1713481296.727860:0:15479:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3432, 64 off227840 00000100:00100000:1.0:1713481296.727870:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e406680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784490880:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.727873:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880120640000/0xdfc0fb148a37634 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa477e2 expref: 2190 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.727881:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.727885:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.727890:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16856:1958:x1796714882461056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3135us (3605us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.727890:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.727893:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88011f854800) 00010000:00010000:2.0:1713481296.727894:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.727895:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820212 00010000:00010000:2.0:1713481296.727897:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.727897:0:15483:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.727902:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.727905:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.727908:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.727909:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.727911:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012052c900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.727912:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.727913:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562995 00000100:00100000:1.0:1713481296.727915:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16855:17009:x1796714882462016:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.727915:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.727917:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.727919:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3486:0x0].0x0 (ffff880083588f00) 00010000:00010000:1.0:1713481296.727920:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.727921:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713481296.727922:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.727925:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3a3f3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3486:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.727926:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350f5b00/0xdfc0fb148a3a401 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493db expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.727927:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00002000:00010000:1.0:1713481296.727934:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.727938:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x385d:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.727940:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.727941:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.727942:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.727944:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f5b00/0xdfc0fb148a3a401 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493db expref: 16856 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.727945:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.727945:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.727948:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.727950:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350f5b00/0xdfc0fb148a3a401 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493db expref: 16856 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.727950:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012052d440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.727951:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.727953:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.727956:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350f5b00, rc 0) 00010000:00010000:2.0:1713481296.727956:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.727959:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3486:0x0].0x0 (ffff880083588f00) 00010000:00010000:2.0:1713481296.727960:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.727962:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.727964:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012052d440/0xdfc0fb148a3a3e5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3486:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.727967:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784490496:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.727968:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16856:17009:x1796714882462016:12345-192.168.202.24@tcp:101:dd.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.727971:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562995 00010000:00010000:0.0:1713481296.727981:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.727985:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562996 00000100:00100000:1.0:1713481296.727987:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20846:18792:x1796714882462272:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.727987:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.727991:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.727995:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.727996:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350f6640/0xdfc0fb148a3a416 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc50e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493e9 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728001:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00002000:00010000:1.0:1713481296.728003:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc50e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.728008:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.728009:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.728011:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f6640/0xdfc0fb148a3a416 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493e9 expref: 20847 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.728016:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350f6640/0xdfc0fb148a3a416 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493e9 expref: 20847 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.728020:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350f6640, rc 0) 00000100:00100000:1.0:1713481296.728029:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20847:18792:x1796714882462272:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 42us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.728033:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562996 00010000:00010000:2.0:1713481296.728036:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.728039:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.728042:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.728043:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562997 00010000:00010000:2.0:1713481296.728044:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.728045:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16855:18844:x1796714882462336:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.728047:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013463cd80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.728048:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.728049:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.728051:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.728054:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8d5440/0xdfc0fb148a3a41d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493f0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.728055:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:2.0:1713481296.728056:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.728058:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.728061:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013463cd80/0xdfc0fb148a3a3d7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3474:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00002000:00010000:1.0:1713481296.728064:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.728068:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.728069:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00010000:2.0:1713481296.728069:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007796dc00 reply state ffff88007c2d3000 transno 4295107574 ns: mdt-lustre-MDT0001_UUID lock: ffff88012052ed00/0xdfc0fb148a3a3de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.728071:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8d5440/0xdfc0fb148a3a41d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493f0 expref: 16856 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.728075:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012052ed00/0xdfc0fb148a3a3de lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3474:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.728077:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8d5440/0xdfc0fb148a3a41d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493f0 expref: 16856 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.728081:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8d5440, rc 0) 00010000:00010000:2.0:1713481296.728081:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x3231 (ffff8800821dfa00) 00010000:00010000:2.0:1713481296.728083:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.728084:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713481296.728089:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16856:18844:x1796714882462336:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 43us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.728092:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562997 00000100:00100000:2.0:1713481296.728111:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2014:18604:x1796714882461632:12345-192.168.202.24@tcp:36:rm.0 Request processed in 467us (532us total) trans 4295107574 rc 0/0 00000100:00100000:1.0:1713481296.728116:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784490560:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.728138:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485794 00000004:00200000:3.0:1713481296.728148:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385e:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.728149:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728157:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.728161:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.728163:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.728168:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.728171:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:16535:1796714784490112:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.728173:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c1cb180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.728176:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.728181:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.728185:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728189:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x0 (ffff88009cd7c000) 00000100:00100000:0.0:1713481296.728191:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.728191:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.728194:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.728199:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462528 00010000:00010000:3.0:1713481296.728199:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1cb180/0xdfc0fb148a3a40f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x385e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.728200:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007684ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784490240:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.728201:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462528 00010000:00010000:1.0:1713481296.728211:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.728213:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562998 00000100:00100000:2.0:1713481296.728216:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16856:17935:x1796714882462528:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.728221:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.728224:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784490944:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.728229:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012052cfc0/0xdfc0fb148a3a424 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493fe expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.728239:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1713481296.728240:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.728247:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.728248:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.728251:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012052cfc0/0xdfc0fb148a3a424 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493fe expref: 16857 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728251:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.728252:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20846:1959:x1796714882459584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3428us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.728257:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820213 00010000:00010000:2.0:1713481296.728257:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012052cfc0/0xdfc0fb148a3a424 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493fe expref: 16857 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728258:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.728261:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012052cfc0, rc 0) 00010000:00010000:3.0:1713481296.728263:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.728268:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.728272:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c1c9f80 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.728274:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16857:17935:x1796714882462528:12345-192.168.202.24@tcp:101:dd.0 Request processed in 58us (84us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.728275:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.728278:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562998 00000100:00100000:1.0:1713481296.728279:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784490688:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.728280:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.728287:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88011f854800) 00010000:00010000:3.0:1713481296.728290:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.728292:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4000/0xdfc0fb148a3a30c lrc: 3/0,0 mode: --/PW res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49395 expref: 20845 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728292:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 3/0,0 mode: --/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.728296:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079564700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784491392:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.728298:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0b4000, rc 0) 00010000:00010000:3.0:1713481296.728298:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9f80/0xdfc0fb148a3a3fa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.728300:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784490752:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.728308:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20845:14753:x1796714882459968:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4212us (4281us total) trans 0 rc 0/0 00000004:00010000:3.0:1713481296.728309:0:15483:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007796ed80 reply state ffff880094298000 transno 4295105905 ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:1.0:1713481296.728312:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562980 00010000:00010000:0.0:1713481296.728315:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728316:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.728317:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0b5680/0xdfc0fb148a3a336 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493c6 expref: 16856 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.728321:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x38 (ffff88012cf69300) 00010000:00010000:2.0:1713481296.728323:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0b5680, rc 0) 00010000:00010000:3.0:1713481296.728323:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.728326:0:15483:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713481296.728330:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784491008:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.728334:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16856:8499:x1796714882461184:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3726us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.728338:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562984 00010000:00010000:1.0:1713481296.728342:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.728353:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462464 00000100:00100000:2.0:1713481296.728355:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462464 00000100:00100000:1.0:1713481296.728356:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20844:1959:x1796714882460352:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3447us (3877us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.728360:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820216 00000100:00100000:3.0:1713481296.728360:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18578:x1796714882462208:12345-192.168.202.24@tcp:36:rm.0 Request processed in 582us (635us total) trans 4295105905 rc 0/0 00000100:00100000:2.0:1713481296.728365:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485796 00000100:00100000:2.0:1713481296.728368:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18893:x1796714882462464:12345-192.168.202.24@tcp:101:touch.0 00000100:00100000:3.0:1713481296.728369:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485795 00010000:00010000:2.0:1713481296.728374:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.728381:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e406a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784491072:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.728381:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012052c240/0xdfc0fb148a3a42b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa493f7 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.728396:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.728405:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20843:1959:x1796714882461248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3449us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.728408:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820217 00000100:00100000:1.0:1713481296.728426:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e404e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784490816:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.728438:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.728438:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728443:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728447:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728453:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x38b1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.728457:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20842:1958:x1796714882460480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3801us (4277us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.728457:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728460:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.728463:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820211 00000100:00100000:3.0:1713481296.728527:0:16460:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16460:1796714784490624:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.728558:0:16460:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.728624:0:15479:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000408:0x3bff:0x0], index 1: 0 00010000:00010000:2.0:1713481296.728701:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880086f621c0/0xdfc0fb148a3a440 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x38b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728706:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086f621c0/0xdfc0fb148a3a440 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728710:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880086f621c0/0xdfc0fb148a3a440 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x38b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728727:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728733:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728737:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728742:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728747:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134f5e1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.728749:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728754:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728762:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff880130505e00) 00010000:00010000:2.0:1713481296.728764:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.728767:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728773:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a432 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000004:00010000:2.0:1713481296.728788:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007dcd9500 reply state ffff880120210000 transno 4295105906 ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728795:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.728799:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x31 (ffff88007354db00) 00010000:00010000:2.0:1713481296.728801:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.728803:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713481296.728822:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012052c240/0xdfc0fb148a3a42b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493f7 expref: 2194 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.728832:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880086f621c0/0xdfc0fb148a3a440 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x38b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493f7 expref: 2193 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.728835:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b5:0x0].0x0 (ffff88007354dd00) 00010000:00010000:2.0:1713481296.728836:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713481296.728838:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086f621c0, rc 0) 00000100:00100000:2.0:1713481296.728863:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2194:18893:x1796714882462464:12345-192.168.202.24@tcp:101:touch.0 Request processed in 493us (701us total) trans 4295105906 rc 0/0 00000100:00100000:2.0:1713481296.728867:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485796 00000100:00100000:1.0:1713481296.728972:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784491776:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.728989:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.728995:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784491840:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.729002:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072865880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784491968:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.729012:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784491136:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.729015:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729019:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729026:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.729046:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26926:1959:x1796714882460160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3876us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.729052:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820220 00000100:00100000:2.0:1713481296.729066:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784491264:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.729087:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784491904:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.729089:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729105:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729106:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.729140:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462656 00000100:00100000:2.0:1713481296.729143:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462656 00000100:00100000:2.0:1713481296.729157:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2562999 00000100:00100000:2.0:1713481296.729160:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24475:15045:x1796714882462656:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.729162:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.729165:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.729172:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086f61680/0xdfc0fb148a3a44e lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49405 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729174:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.729180:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463360 00002000:00010000:2.0:1713481296.729181:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.729183:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463360 00000100:00100000:0.0:1713481296.729185:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.729188:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729189:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729191:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086f61680/0xdfc0fb148a3a44e lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49405 expref: 24476 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729197:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086f61680/0xdfc0fb148a3a44e lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49405 expref: 24476 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729202:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462720 00010000:00010000:2.0:1713481296.729202:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086f61680, rc 0) 00000100:00100000:1.0:1713481296.729204:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462720 00000100:00100000:0.0:1713481296.729210:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.729220:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c480/0xdfc0fb148802242 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ce expref: 20842 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.729222:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:15045:x1796714882462656:12345-192.168.202.24@tcp:101:dd.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.729228:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562999 00000100:00100000:1.0:1713481296.729234:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462848 00000100:00100000:1.0:1713481296.729236:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462848 00010000:00010000:1.0:1713481296.729244:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008306f840/0xdfc0fb148a13e00 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f69 expref: 20843 pid: 16521 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.729244:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463488 00000100:00100000:2.0:1713481296.729247:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463488 00000100:00100000:2.0:1713481296.729261:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563000 00000100:00100000:1.0:1713481296.729263:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820222 00000100:00100000:0.0:1713481296.729266:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.729266:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26926:11552:x1796714882463360:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.729267:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20843:1958:x1796714882462720:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.729272:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.729273:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.729274:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c480/0xdfc0fb148802242 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ce expref: 20843 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.729279:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.729280:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c480/0xdfc0fb148802242 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ce expref: 20843 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729280:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086f63840/0xdfc0fb148a3a455 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4940c expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729290:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.729290:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133bf8fc0/0xdfc0fb148959c28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebb4 expref: 26927 pid: 16477 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.729291:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd0c480/0xdfc0fb148802242 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ce expref: 20843 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729294:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729295:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729297:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086f63840/0xdfc0fb148a3a455 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4940c expref: 26927 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729300:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.729300:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.729301:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.729303:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729307:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729308:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133bf8fc0/0xdfc0fb148959c28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebb4 expref: 26927 pid: 16477 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.729310:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.729314:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133bf8fc0/0xdfc0fb148959c28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebb4 expref: 26927 pid: 16477 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.729320:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784492160:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.729325:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.729329:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729335:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.729338:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099f51000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.729340:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20842:1958:x1796714882462720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.729342:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729343:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820222 00010000:00010000:0.0:1713481296.729352:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.729356:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784492032:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.729357:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462976 00010000:00010000:0.0:1713481296.729358:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729359:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462976 00010000:00010000:0.0:1713481296.729363:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078c40b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.729365:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729368:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133da6640/0xdfc0fb148688baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ff expref: 26928 pid: 16531 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729368:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729371:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.729380:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563001 00010000:00010000:0.0:1713481296.729381:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729381:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463104 00000100:00100000:1.0:1713481296.729383:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463104 00000100:00100000:2.0:1713481296.729383:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16856:18836:x1796714882463488:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.729386:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880078c40b40/0xdfc0fb148a3a2f7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729387:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.729389:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091653a80/0xdfc0fb14880225e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962906 expref: 20842 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729395:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086f61200/0xdfc0fb148a3a45c lrc: 2/0,0 mode: --/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49413 expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729401:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463232 00000100:00100000:1.0:1713481296.729403:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463232 00010000:00010000:1.0:1713481296.729409:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148802265 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962914 expref: 20843 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729409:0:16452:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dfa61c0/0xdfc0fb14891e5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb4b4 expref: 20843 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729415:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.729417:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.729420:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086f61200/0xdfc0fb148a3a45c lrc: 4/0,0 mode: --/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49413 expref: 16857 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729421:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463424 00000100:00100000:1.0:1713481296.729422:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463424 00010000:00010000:1.0:1713481296.729429:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50900/0xdfc0fb148802250 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ea expref: 20844 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729434:0:16452:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dfa61c0/0xdfc0fb14891e5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb4b4 expref: 20844 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729440:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820223 00010000:00010000:2.0:1713481296.729442:0:16452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dfa61c0/0xdfc0fb14891e5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb4b4 expref: 20844 pid: 16545 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.729444:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4019c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20844:1958:x1796714882462848:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.729450:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.729452:0:16452:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784492224:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.729461:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008306f840/0xdfc0fb148a13e00 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc175:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f69 expref: 20844 pid: 16521 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.729468:0:16452:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c86c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.729469:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008306f840/0xdfc0fb148a13e00 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc175:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f69 expref: 20844 pid: 16521 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.729482:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462592 00000100:00100000:2.0:1713481296.729484:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462592 00010000:00010000:1.0:1713481296.729487:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008306f840/0xdfc0fb148a13e00 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc175:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37f69 expref: 20844 pid: 16521 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729492:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013449d8c0/0xdfc0fb148688ba3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29f1 expref: 26929 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.729495:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.729496:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.729498:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4000/0xdfc0fb148a3a30c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49395 expref: 20843 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729503:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4000/0xdfc0fb148a3a30c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49395 expref: 20843 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.729512:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820224 00010000:00010000:1.0:1713481296.729514:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0b4000/0xdfc0fb148a3a30c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49395 expref: 20843 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.729515:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26929:1958:x1796714882462976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.729520:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcdaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784492288:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.729520:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.729522:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133da6640/0xdfc0fb148688baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa912:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ff expref: 26929 pid: 16531 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729528:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133da6640/0xdfc0fb148688baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa912:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ff expref: 26929 pid: 16531 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.729534:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0b40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.729539:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133da6640/0xdfc0fb148688baa lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa912:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29ff expref: 26929 pid: 16531 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729549:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729550:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.729553:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820225 00010000:00010000:2.0:1713481296.729553:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729557:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20843:1958:x1796714882463104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.729557:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729563:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.729567:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091653a80/0xdfc0fb14880225e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962906 expref: 20843 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729569:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.729572:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820226 00010000:00010000:1.0:1713481296.729576:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091653a80/0xdfc0fb14880225e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962906 expref: 20843 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.729579:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20843:1958:x1796714882463232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.729580:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1958:x1796714882462976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.729584:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820224 00010000:00010000:3.0:1713481296.729589:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.729593:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091653a80/0xdfc0fb14880225e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962906 expref: 20843 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.729595:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148802265 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962914 expref: 20843 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.729596:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820227 00000100:00100000:2.0:1713481296.729599:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20842:1958:x1796714882463424:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.729603:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.729606:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081c50900/0xdfc0fb148802250 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ea expref: 20842 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.729606:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148802265 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962914 expref: 20842 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.729607:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.729608:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.729611:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729612:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081c50900/0xdfc0fb148802250 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ea expref: 20842 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.729618:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729624:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+123:3492:x1796714784490368:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5684us (5748us total) trans 4296040785 rc 0/0 00010000:00010000:2.0:1713481296.729626:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081c50900/0xdfc0fb148802250 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628ea expref: 20842 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.729631:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562978 00010000:00010000:3.0:1713481296.729632:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148802265 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962914 expref: 20841 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.729634:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.729635:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729637:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729638:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729642:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.729648:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.729649:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20840:1958:x1796714882463104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.729650:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729651:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.729653:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820225 00010000:00010000:3.0:1713481296.729653:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729658:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820228 00010000:00010000:3.0:1713481296.729660:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.729661:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20840:1958:x1796714882463424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.729678:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26927:1958:x1796714882462592:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.729682:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820227 00010000:00010000:0.0:1713481296.729687:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.729693:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013449d8c0/0xdfc0fb148688ba3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa911:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29f1 expref: 26927 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.729696:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.729699:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729701:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013449d8c0/0xdfc0fb148688ba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa911:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29f1 expref: 26927 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729703:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729708:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729713:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729714:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013449d8c0/0xdfc0fb148688ba3 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa911:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29f1 expref: 26927 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.729718:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.729718:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20838:1958:x1796714882463232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 138us (426us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.729723:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c1c8000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.729726:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.729726:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820226 00010000:00010000:0.0:1713481296.729730:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.729732:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.729733:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729735:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729742:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729744:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729750:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c1c8000/0xdfc0fb148a3a3a6 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.729755:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.729763:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.729767:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.729770:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.729777:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729780:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729781:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26926:1958:x1796714882462592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 117us (469us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.729785:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729788:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820228 00010000:00010000:3.0:1713481296.729789:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729790:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729794:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.729795:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a6e5200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.729798:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729801:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729805:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d0b5d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.729805:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729807:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729810:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.729819:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.729820:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.729822:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007de11180/2, rc 0, transno 1073489 00010000:00010000:1.0:1713481296.729822:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0b5d40/0xdfc0fb148a3a2f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.729826:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a6e5200/0xdfc0fb148a3a3c2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.729828:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784490368:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.729862:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+123:3490:x1796714784491200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4437us (4496us total) trans 4296040786 rc 0/0 00000100:00100000:2.0:1713481296.729866:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562987 00010000:00010000:2.0:1713481296.729885:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729890:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729893:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729897:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729901:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729908:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013463cb40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.729909:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729913:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.729921:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729923:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2729:3491:x1796714784490048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6161us (6314us total) trans 4295960668 rc 0/0 00010000:00010000:2.0:1713481296.729925:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013463cb40/0xdfc0fb148a3a3bb lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.729927:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562976 00000004:00080000:1.0:1713481296.729954:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801202c9880/2, rc 0, transno 993372 00000100:00100000:1.0:1713481296.729958:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784490048:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.729962:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079564000/2, rc 0, transno 1073490 00000100:00100000:0.0:1713481296.729969:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491200:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.729979:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.729981:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.729984:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784492416:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.729987:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784492352:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.729993:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+124:3490:x1796714784491584:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3624us (3740us total) trans 4296040787 rc 0/0 00000100:00100000:1.0:1713481296.729998:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.730000:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562989 00000100:00100000:0.0:1713481296.730009:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.730019:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784492416 00000100:00100000:1.0:1713481296.730021:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784492416 00000100:00100000:3.0:1713481296.730029:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784492352 00000100:00100000:3.0:1713481296.730032:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784492352 00000100:00100000:1.0:1713481296.730033:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563002 00000100:00100000:1.0:1713481296.730036:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2729:3491:x1796714784492416:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.730038:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801322a5180/2, rc 0, transno 1073491 00000100:00100000:0.0:1713481296.730042:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801322a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491584:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.730045:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43285 count 1 00010000:00010000:1.0:1713481296.730052:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.730052:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563003 00000100:00100000:2.0:1713481296.730053:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+124:3493:x1796714784491520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3651us (3737us total) trans 4296040788 rc 0/0 00000004:00080000:0.0:1713481296.730055:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801322a4700/2, rc 0, transno 1073492 00000100:00100000:3.0:1713481296.730057:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+124:3492:x1796714784492352:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.730058:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801322a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784491520:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.730060:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562991 00010000:00010000:1.0:1713481296.730061:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007952cd80/0xdfc0fb148688bd4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a29 expref: 26925 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.730065:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.730066:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.730067:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.730069:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9939 count 1 00010000:00010000:1.0:1713481296.730076:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007952cd80/0xdfc0fb148688bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a29 expref: 26925 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.730080:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.730081:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007952cd80/0xdfc0fb148688bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a29 expref: 26925 pid: 16513 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.730087:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784492544:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.730091:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713481296.730094:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c7c480/0xdfc0fb148802273 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962930 expref: 20837 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.730095:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784492480:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.730098:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0780 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.730100:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730101:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730104:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.730110:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.730134:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784492480 00000100:00100000:1.0:1713481296.730137:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784492480 00000100:00100000:2.0:1713481296.730138:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.730140:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c7c480/0xdfc0fb148802273 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962930 expref: 20837 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.730146:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784492608:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.730150:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c7c480/0xdfc0fb148802273 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962930 expref: 20837 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.730151:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563004 00000100:00100000:1.0:1713481296.730153:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+124:3490:x1796714784492480:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.730159:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.730160:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784492736:192.168.202.24@tcp:104: 00002000:00080000:1.0:1713481296.730161:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9940 count 1 00010000:00010000:1.0:1713481296.730168:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.730171:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.730174:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008931e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784492672:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.730175:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd46f40/0xdfc0fb14880227a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96293e expref: 20837 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.730179:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.730180:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.730180:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.730181:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.730188:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.730191:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd46f40/0xdfc0fb14880227a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96293e expref: 20837 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.730196:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd46f40/0xdfc0fb14880227a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96293e expref: 20837 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.730198:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730202:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784492800:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.730205:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730212:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b98900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.730213:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730220:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784492608 00010000:00010000:3.0:1713481296.730220:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730222:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784492608 00010000:00010000:3.0:1713481296.730227:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730232:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784492672 00000100:00100000:1.0:1713481296.730233:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784492672 00010000:00010000:3.0:1713481296.730233:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012024db00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.730235:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.730237:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563005 00010000:00010000:3.0:1713481296.730241:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.730242:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+126:3492:x1796714784492608:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.730249:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563006 00000100:00100000:1.0:1713481296.730251:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+126:3492:x1796714784492672:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.730254:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9941 count 1 00010000:00010000:3.0:1713481296.730256:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.730258:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9942 count 1 00010000:00010000:3.0:1713481296.730262:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012024db00/0xdfc0fb148a3a305 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.730264:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.730265:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.730274:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd47180/0xdfc0fb148802296 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96295a expref: 20837 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.730274:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148802281 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96294c expref: 20837 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.730278:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.730279:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.730281:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.730285:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.730286:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.730288:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.730289:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd47180/0xdfc0fb148802296 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96295a expref: 20837 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.730293:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd47180/0xdfc0fb148802296 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96295a expref: 20837 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.730298:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784492864:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.730305:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148802281 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96294c expref: 20837 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.730310:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121ef0300 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.730313:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148802281 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96294c expref: 20837 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.730322:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784492928:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.730342:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008d09bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.730358:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464128 00000100:00100000:2.0:1713481296.730361:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464128 00000100:00100000:2.0:1713481296.730378:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485797 00000100:00100000:2.0:1713481296.730382:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18729:x1796714882464128:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1713481296.730395:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.730402:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a486 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49421 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.730417:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+2730:3490:x1796714784490304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6482us (6560us total) trans 4295960669 rc 0/0 00000004:00080000:1.0:1713481296.730421:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801202c9500/2, rc 0, transno 993373 00000100:00100000:3.0:1713481296.730425:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562977 00000100:00100000:1.0:1713481296.730426:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784490304:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.730444:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784492992:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.730458:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:2.0:1713481296.730463:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c1:0x0]: returning size 4096 00000100:00100000:3.0:1713481296.730486:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784492992 00000100:00100000:3.0:1713481296.730490:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784492992 00000100:00100000:3.0:1713481296.730510:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563007 00010000:00010000:2.0:1713481296.730514:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a486 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49421 expref: 2371 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.730515:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2730:3490:x1796714784492992:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.730517:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.730521:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a486 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49421 expref: 2371 pid: 15479 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.730528:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43286 count 1 00010000:00010000:2.0:1713481296.730539:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801346b3cc0, rc 0) 00010000:00010000:3.0:1713481296.730540:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.730546:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.730556:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fe07a80/0xdfc0fb148688bdb lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a37 expref: 26925 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.730563:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730564:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730567:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.730570:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18729:x1796714882464128:12345-192.168.202.24@tcp:101:rm.0 Request processed in 186us (451us total) trans 4295107575 rc 301/301 00000100:00100000:2.0:1713481296.730576:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485797 00000100:00100000:0.0:1713481296.730585:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.730585:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007fe07a80/0xdfc0fb148688bdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a37 expref: 26925 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.730594:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462784 00010000:00010000:3.0:1713481296.730595:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007fe07a80/0xdfc0fb148688bdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a37 expref: 26925 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.730597:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462784 00000100:00100000:0.0:1713481296.730599:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.730605:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882462912 00000100:00100000:3.0:1713481296.730606:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784493056:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.730607:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091651200/0xdfc0fb148802249 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628dc expref: 20838 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.730608:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882462912 00000100:00100000:0.0:1713481296.730615:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.730619:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfcad00/0xdfc0fb1488e7e99 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ed expref: 16858 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.730620:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463040 00000100:00100000:1.0:1713481296.730621:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463040 00010000:00010000:1.0:1713481296.730628:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013449cd80/0xdfc0fb148688bb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a0d expref: 26926 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.730629:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.730633:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463168 00000100:00100000:0.0:1713481296.730636:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.730636:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463296 00000100:00100000:2.0:1713481296.730636:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463168 00000100:00100000:1.0:1713481296.730637:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463296 00010000:00010000:1.0:1713481296.730643:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb14880226c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962922 expref: 20840 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.730644:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0ddf80/0xdfc0fb148802257 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628f8 expref: 20840 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.730650:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.730651:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463552 00000100:00100000:1.0:1713481296.730653:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820229 00000100:00100000:3.0:1713481296.730654:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463552 00000100:00100000:1.0:1713481296.730656:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20840:1958:x1796714882462784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.730660:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.730660:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820230 00000100:00100000:0.0:1713481296.730662:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.730663:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091651200/0xdfc0fb148802249 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628dc expref: 20840 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.730679:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16858:1958:x1796714882462912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.730682:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091651200/0xdfc0fb148802249 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628dc expref: 20840 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.730685:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148688bcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a1b expref: 26927 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.730688:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.730692:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cfcad00/0xdfc0fb1488e7e99 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ed expref: 16858 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.730693:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.730693:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091651200/0xdfc0fb148802249 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628dc expref: 20840 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.730701:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.730701:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cfcad00/0xdfc0fb1488e7e99 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ed expref: 16858 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.730702:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.730704:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.730708:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.730709:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.730709:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820231 00010000:00010000:2.0:1713481296.730716:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cfcad00/0xdfc0fb1488e7e99 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54ed expref: 16858 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.730716:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26927:1958:x1796714882463040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.730723:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.730724:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.730729:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013449cd80/0xdfc0fb148688bb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa913:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a0d expref: 26927 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.730735:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.730737:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20839:1958:x1796714882462784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 80us (223us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.730737:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730739:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013449cd80/0xdfc0fb148688bb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa913:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a0d expref: 26927 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.730740:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0b5680/0xdfc0fb148a3a336 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493c6 expref: 16857 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730742:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820229 00010000:00010000:2.0:1713481296.730748:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0b5680/0xdfc0fb148a3a336 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493c6 expref: 16857 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730753:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463808 00000100:00100000:1.0:1713481296.730755:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463808 00010000:00010000:3.0:1713481296.730755:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013449cd80/0xdfc0fb148688bb8 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa913:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a0d expref: 26927 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.730766:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98349 00010000:00010000:2.0:1713481296.730766:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0b5680/0xdfc0fb148a3a336 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493c6 expref: 16857 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730769:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:1957:x1796714882463808:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:1.0:1713481296.730772:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.730773:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.730775:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc89500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784493120:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.730775:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730778:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.730779:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081c43600/0xdfc0fb148a3a217 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4934f expref: 2370 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.730786:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.730793:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a883c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.730795:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.730804:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.730806:0:16553:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88009f9c3e00) 00000100:00100000:2.0:1713481296.730813:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820232 00010000:00010000:1.0:1713481296.730814:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.730818:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20838:1958:x1796714882463296:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.730820:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.730825:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:1957:x1796714882463808:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 55us (117us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.730825:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.730825:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26926:1958:x1796714882463040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 108us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.730828:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98349 00010000:00010000:2.0:1713481296.730829:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb14880226c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962922 expref: 20838 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.730833:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820231 00010000:00010000:2.0:1713481296.730837:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb14880226c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962922 expref: 20838 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.730840:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820233 00000100:00100000:1.0:1713481296.730842:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20838:1958:x1796714882463168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.730846:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.730849:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d0ddf80/0xdfc0fb148802257 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628f8 expref: 20838 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.730851:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb14880226c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962922 expref: 20838 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.730855:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d0ddf80/0xdfc0fb148802257 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628f8 expref: 20838 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.730855:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820234 00000100:00100000:3.0:1713481296.730861:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008931f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26925:1958:x1796714882463552:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.730863:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d0ddf80/0xdfc0fb148802257 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628f8 expref: 20837 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.730867:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.730868:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730868:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.730871:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.730871:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.730872:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730873:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148688bcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa914:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a1b expref: 26925 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.730874:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.730878:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.730878:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.730882:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148688bcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa914:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a1b expref: 26925 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.730887:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.730887:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.730895:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.730896:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20836:1958:x1796714882463168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.730900:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820233 00010000:00010000:3.0:1713481296.730902:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148688bcd lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa914:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a1b expref: 26925 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.730910:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.730912:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20835:1958:x1796714882463296:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 93us (297us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.730916:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.730917:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.730919:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464064 00000100:00100000:2.0:1713481296.730919:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820232 00010000:00010000:3.0:1713481296.730920:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.730921:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464064 00010000:00010000:3.0:1713481296.730927:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.730928:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.730933:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26102 00000100:00100000:1.0:1713481296.730936:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:18869:x1796714882464064:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:2.0:1713481296.730943:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463744 00010000:00010000:3.0:1713481296.730945:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.730946:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463744 00010000:00010000:1.0:1713481296.730950:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.730959:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943dc900/0xdfc0fb148a35445 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa460b2 expref: 2797 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.730960:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464384 00000100:00100000:3.0:1713481296.730960:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26924:1958:x1796714882463552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.730962:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464384 00000100:00100000:3.0:1713481296.730967:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820234 00000100:00100000:2.0:1713481296.730971:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464448 00010000:00010000:1.0:1713481296.730972:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88007da00600) 00000100:00100000:2.0:1713481296.730972:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464448 00010000:00010000:1.0:1713481296.730974:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.730985:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563008 00000100:00100000:2.0:1713481296.730989:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:10479:x1796714882463744:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.730994:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800784c0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784493184:0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713481296.730995:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.730998:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463680 00000100:00100000:3.0:1713481296.731002:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463680 00010000:00010000:2.0:1713481296.731004:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801346b33c0/0xdfc0fb148a3a49b lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4941a expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731008:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.731014:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.731017:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008333c900/0xdfc0fb148916d7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6561 expref: 24477 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.731022:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e688b40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.731028:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.731030:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.731033:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801346b33c0/0xdfc0fb148a3a49b lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4941a expref: 24477 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.731041:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784493184 00000100:00100000:1.0:1713481296.731043:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784493184 00010000:00010000:2.0:1713481296.731047:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008333c900/0xdfc0fb148916d7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6561 expref: 24477 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.731055:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008333c900/0xdfc0fb148916d7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6561 expref: 24477 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.731059:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82887 00000100:00100000:1.0:1713481296.731062:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+31:15514:x1796714784493184:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.731064:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784493248:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.731070:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464256 00000100:00100000:3.0:1713481296.731073:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464256 00000100:00100000:2.0:1713481296.731080:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099f51b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.731089:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464320 00000100:00100000:3.0:1713481296.731091:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464320 00010000:00010000:2.0:1713481296.731093:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.731097:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+31:15514:x1796714784493184:12345-0@lo:1000:mdt_io00_009.0 Request processed in 35us (83us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.731100:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731101:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.731101:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82887 00000100:00100000:3.0:1713481296.731101:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464512 00000100:00100000:3.0:1713481296.731104:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464512 00010000:00010000:2.0:1713481296.731107:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.731114:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731115:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.731138:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.731140:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800784c0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784493184:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.731141:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485798 00010000:00010000:2.0:1713481296.731143:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013463e1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.731146:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.731148:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2194:18678:x1796714882463680:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.731150:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.731153:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731163:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.731168:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731170:0:15476:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713481296.731175:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013463e1c0/0xdfc0fb148a3a3d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731176:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.731181:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c98c0/0xdfc0fb148a3a383 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x386d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493aa expref: 2194 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731182:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.731186:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.731198:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd9f600/0xdfc0fb148a1937a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x386d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3c3a9 expref: 2193 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731201:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.731204:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.731209:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713481296.731215:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800784c0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784493312:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.731220:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x386d:0x0].0x0 (ffff880096442100) 00000100:00100000:1.0:1713481296.731228:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.731236:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092a4fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.731239:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.731243:0:15476:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.731248:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784493312 00000100:00100000:1.0:1713481296.731249:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784493312 00010000:00010000:3.0:1713481296.731255:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.731260:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82888 00000100:00100000:0.0:1713481296.731261:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.731263:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+31:15514:x1796714784493312:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.731263:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731268:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.731270:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731274:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009670b3c0/0xdfc0fb148a3a4b7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a4a9 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731276:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.731279:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,1 mode: --/PW res: [0x200000400:0x230:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731284:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009670b3c0/0xdfc0fb148a3a4b7 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a4a9 expref: 32 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731285:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731289:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009670b3c0/0xdfc0fb148a3a4b7 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a4a9 expref: 32 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731292:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731293:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.731294:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.731295:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009670b3c0, rc 0) 00000100:00100000:0.0:1713481296.731298:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.731312:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+32:15514:x1796714784493312:12345-0@lo:101:mdt_io00_009.0 Request processed in 48us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.731315:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82888 00000100:00100000:0.0:1713481296.731320:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.731324:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2731:3493:x1796714784491712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4834us (4965us total) trans 4295960670 rc 0/0 00010000:00010000:3.0:1713481296.731327:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713481296.731331:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562993 00000100:00100000:0.0:1713481296.731332:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.731333:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465088 00010000:00010000:3.0:1713481296.731334:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.731335:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465088 00000100:00100000:0.0:1713481296.731341:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.731341:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.731345:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26103 00000100:00100000:2.0:1713481296.731347:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464576 00000100:00100000:1.0:1713481296.731348:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18899:x1796714882465088:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:0.0:1713481296.731349:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.731350:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464576 00000100:00100000:0.0:1713481296.731356:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.731363:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464704 00010000:00010000:1.0:1713481296.731364:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:2.0:1713481296.731365:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464704 00010000:00010000:1.0:1713481296.731373:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801354333c0/0xdfc0fb148a331ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x3866:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44bab expref: 2193 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731376:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464768 00000100:00100000:2.0:1713481296.731378:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464768 00000100:00100000:2.0:1713481296.731387:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464960 00000100:00100000:2.0:1713481296.731389:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464960 00010000:00010000:1.0:1713481296.731390:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800798acfc0/0xdfc0fb148a32384 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4422e expref: 2192 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731398:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465152 00010000:00010000:1.0:1713481296.731399:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff880098564000) 00000100:00100000:2.0:1713481296.731400:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465152 00000100:00100000:2.0:1713481296.731411:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563009 00000100:00100000:0.0:1713481296.731414:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.731414:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af180/0xdfc0fb148a3a2aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49387 expref: 2191 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731415:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20835:18792:x1796714882464384:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.731422:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.731425:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x513e:0x0].0x0 (ffff880136289900) 00010000:00010000:1.0:1713481296.731427:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.731431:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465216 00010000:00010000:2.0:1713481296.731432:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b97180/0xdfc0fb148a3a4cc lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc50f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49428 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731433:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465216 00010000:00010000:1.0:1713481296.731434:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.731439:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00002000:00010000:2.0:1713481296.731442:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc50f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.731443:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.731447:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563010 00010000:00010000:1.0:1713481296.731449:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.731450:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26925:18817:x1796714882464448:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.731450:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.731452:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.731452:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.731455:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.731456:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.731456:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b97180/0xdfc0fb148a3a4cc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49428 expref: 20837 pid: 16488 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713481296.731458:0:15476:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14790, 64 off954752 00010000:00010000:0.0:1713481296.731462:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a6e4fc0/0xdfc0fb148a3a4e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49436 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731462:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.731465:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.731465:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b97180/0xdfc0fb148a3a4cc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc50f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49428 expref: 20837 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731468:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.731473:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800917d3cc0/0xdfc0fb1489cf728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22138 expref: 24479 pid: 16547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.731473:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b97180, rc 0) 00010000:00010000:0.0:1713481296.731481:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.731482:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.731484:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6e4fc0/0xdfc0fb148a3a4e1 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49436 expref: 26926 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731486:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20837:18792:x1796714882464384:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 70us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.731491:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563009 00010000:00010000:0.0:1713481296.731494:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800917d3cc0/0xdfc0fb1489cf728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22138 expref: 24479 pid: 16547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.731498:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800917d3cc0/0xdfc0fb1489cf728 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22138 expref: 24479 pid: 16547 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.731501:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 3/0,1 mode: --/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713481296.731504:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880089881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784493376:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.731506:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563011 00010000:00010000:1.0:1713481296.731508:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.731510:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16859:18844:x1796714882464576:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.731510:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731513:0:15793:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ef40/0xdfc0fb148a30c15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435f5 expref: 2796 pid: 15591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731515:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941da80 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.731516:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.731516:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731517:0:15793:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.731523:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.731524:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b973c0/0xdfc0fb148a3a4fd lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49444 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731527:0:15793:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ef40/0xdfc0fb148a30c15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435f5 expref: 2796 pid: 15591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731529:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713481296.731530:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464640 00000100:00100000:0.0:1713481296.731531:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464640 00010000:00010000:1.0:1713481296.731532:0:15793:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ef40/0xdfc0fb148a30c15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435f5 expref: 2796 pid: 15591 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1713481296.731534:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.731534:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.731539:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097d1cd80/0xdfc0fb148941a41 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6973:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00e0 expref: 20837 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.731539:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de11880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000_UUID:15793:1796714784493440:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.731539:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.731541:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.731543:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.731543:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800908af3c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.731546:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713481296.731547:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461760 00010000:00010000:2.0:1713481296.731547:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b973c0/0xdfc0fb148a3a4fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49444 expref: 16860 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731548:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461760 00000100:00100000:1.0:1713481296.731549:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0d80 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.731551:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.731552:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb14880223b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628c0 expref: 20838 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.731555:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b973c0/0xdfc0fb148a3a4fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49444 expref: 16860 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.731558:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461888 00010000:00010000:3.0:1713481296.731558:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x386d:0x0].0x0 (ffff880096325b00) 00000100:00100000:0.0:1713481296.731559:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461888 00010000:00010000:3.0:1713481296.731561:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713481296.731562:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b973c0, rc 0) 00010000:00010000:0.0:1713481296.731563:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013449d440/0xdfc0fb148688b87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29d5 expref: 26927 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.731564:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 3/0,0 mode: --/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.731566:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485799 00000100:00100000:0.0:1713481296.731568:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882463872 00000100:00100000:0.0:1713481296.731569:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882463872 00010000:00010000:3.0:1713481296.731569:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af3c0/0xdfc0fb148a3a4ef lrc: 0/0,0 mode: --/PW res: [0x200000404:0x386d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.731570:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2015:18905:x1796714882464256:12345-192.168.202.24@tcp:36:mkdir.0 00000100:00100000:2.0:1713481296.731573:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16860:18844:x1796714882464576:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 62us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.731574:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461696 00000100:00100000:0.0:1713481296.731575:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461696 00010000:00010000:0.0:1713481296.731579:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b806f40/0xdfc0fb148688b64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29c7 expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.731579:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563011 00000100:00100000:0.0:1713481296.731584:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461824 00000100:00100000:0.0:1713481296.731585:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461824 00010000:00010000:0.0:1713481296.731589:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ad21680/0xdfc0fb148688b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29b9 expref: 26929 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.731592:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563012 00000100:00100000:0.0:1713481296.731594:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882461952 00000100:00100000:0.0:1713481296.731595:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882461952 00010000:00010000:3.0:1713481296.731595:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713481296.731596:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a11ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10409:x1796714882464704:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.731599:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096af0240/0xdfc0fb148688b8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29e3 expref: 26930 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.731601:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.731601:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713481296.731605:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820235 00010000:00010000:3.0:1713481296.731606:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713481296.731607:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a11b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20838:1957:x1796714882464640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.731609:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b96640/0xdfc0fb148a3a504 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4944b expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.731611:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2015:18905:x1796714882464256:12345-192.168.202.24@tcp:36:mkdir.0 Request processed in 40us (817us total) trans 0 rc -17/-17 00010000:00010000:3.0:1713481296.731611:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800908ad440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.731613:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.731614:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.731615:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485799 00010000:00010000:0.0:1713481296.731617:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097d1cd80/0xdfc0fb148941a41 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6973:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00e0 expref: 20838 pid: 16545 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.731619:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.731621:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800916d1200/0xdfc0fb14891d429 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6e5 expref: 24480 pid: 16464 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.731625:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097d1cd80/0xdfc0fb148941a41 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6973:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00e0 expref: 20838 pid: 16545 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.731626:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x386d:0x0].0x0 (ffff880096325b00) 00000100:00100000:1.0:1713481296.731628:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485800 00010000:00010000:3.0:1713481296.731628:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.731629:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800803806c0/0xdfc0fb14893ab7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e7 expref: 26930 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.731630:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.731631:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2014:18578:x1796714882464320:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1713481296.731634:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.731635:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.731635:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800908ad440/0xdfc0fb148a3a4c5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x386d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.731636:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.731639:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b96640/0xdfc0fb148a3a504 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4944b expref: 24480 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731642:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080144b40/0xdfc0fb148a3a50b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4942f expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.731647:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.731649:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.731653:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350f7180/0xdfc0fb148a3a3ec lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6973:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493e2 expref: 16859 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.731658:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800803806c0/0xdfc0fb14893ab7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e7 expref: 26930 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.731660:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f7180/0xdfc0fb148a3a3ec lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6973:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493e2 expref: 16859 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.731683:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800803806c0/0xdfc0fb14893ab7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e7 expref: 26930 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.731690:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801350f7180/0xdfc0fb148a3a3ec lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6973:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493e2 expref: 16859 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731692:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784493504:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.731699:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880089883800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784493568:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.731700:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.731706:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.731710:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731714:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800916d1200/0xdfc0fb14891d429 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6e5 expref: 24480 pid: 16464 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.731715:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941d180 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.731716:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.731720:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731721:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800916d1200/0xdfc0fb14891d429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6e5 expref: 24480 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.731723:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.731730:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784493632:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.731731:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.731739:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731740:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876d00/0xdfc0fb148a3a520 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.731742:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f03c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.731744:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876d00/0xdfc0fb148a3a520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.731745:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731748:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876d00/0xdfc0fb148a3a520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.731752:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731752:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000004:00010000:1.0:1713481296.731754:0:15642:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876d00/0xdfc0fb148a3a520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.731757:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563013 00010000:00010000:3.0:1713481296.731757:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.731758:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731760:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.731761:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:17924:x1796714882464768:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.731761:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731763:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.731764:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.731765:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a6e6ac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.731767:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731767:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731767:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.731767:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b811f80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.731769:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731770:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.731773:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f875440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.731773:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.731774:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731774:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731775:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b958c0/0xdfc0fb148a3a527 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49452 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731777:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.731777:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88007376bc00) 00010000:00010000:3.0:1713481296.731779:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.731780:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731781:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x0 (ffff880083123100) 00010000:00010000:1.0:1713481296.731783:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.731783:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811f80/0xdfc0fb148a3a4b0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731784:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.731787:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f875440/0xdfc0fb148a3a512 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731787:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d17840/0xdfc0fb148a16257 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39813 expref: 24481 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.731789:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.731795:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a3ad lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731797:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731797:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00010000:3.0:1713481296.731798:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880079b73480 reply state ffff88009429d000 transno 4295105907 ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.731799:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.731800:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731802:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b958c0/0xdfc0fb148a3a527 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49452 expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731803:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.731803:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731805:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f876640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.731806:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x39 (ffff880088059300) 00010000:00010000:1.0:1713481296.731807:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.731807:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.731808:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713481296.731812:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.731815:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x37 (ffff88009cbd1800) 00010000:00010000:2.0:1713481296.731815:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d17840/0xdfc0fb148a16257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39813 expref: 24481 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.731816:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.731818:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.731820:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876640/0xdfc0fb148a3a519 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.731822:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d17840/0xdfc0fb148a16257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39813 expref: 24481 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.731827:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18678:x1796714882463680:12345-192.168.202.24@tcp:36:rm.0 Request processed in 680us (1177us total) trans 4295105907 rc 0/0 00000100:00100000:2.0:1713481296.731830:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800786d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784493696:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.731832:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485798 00000100:00100000:2.0:1713481296.731844:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800964f0d80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.731846:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080144b40/0xdfc0fb148a3a50b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4942f expref: 2016 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.731847:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485801 00000100:00100000:3.0:1713481296.731850:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a11aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2369:18874:x1796714882464512:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:1.0:1713481296.731855:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876d00/0xdfc0fb148a3a520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4942f expref: 2015 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731855:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.731859:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88009de91e00) 00010000:00010000:1.0:1713481296.731860:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.731861:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f876d00, rc 0) 00010000:00010000:3.0:1713481296.731862:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800836b2f40/0xdfc0fb148a3a52e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4943d expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731867:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563014 00000100:00100000:2.0:1713481296.731871:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26930:17935:x1796714882464960:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.731872:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2015:18578:x1796714882464320:12345-192.168.202.24@tcp:101:rm.0 Request processed in 240us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.731876:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485800 00010000:00010000:2.0:1713481296.731877:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.731886:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b96400/0xdfc0fb148a3a535 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49459 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.731897:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820236 00002000:00010000:2.0:1713481296.731897:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb790:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.731900:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20838:1959:x1796714882461760:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.731905:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.731905:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.731906:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.731908:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb14880223b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628c0 expref: 20838 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.731910:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b96400/0xdfc0fb148a3a535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49459 expref: 26931 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731913:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800836b2d00/0xdfc0fb148a3a53c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.731917:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb14880223b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628c0 expref: 20838 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.731919:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800836b2d00/0xdfc0fb148a3a53c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.731924:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084b96400/0xdfc0fb148a3a535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49459 expref: 26931 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.731924:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800836b2d00/0xdfc0fb148a3a53c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713481296.731929:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2731:3490:x1796714784491328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5842us (5916us total) trans 4295960671 rc 0/0 00010000:00010000:1.0:1713481296.731930:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb14880223b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9628c0 expref: 20838 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.731931:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b96400, rc 0) 00000100:00100000:0.0:1713481296.731936:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562988 00010000:00010000:1.0:1713481296.731937:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.731938:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.731940:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731943:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26931:17935:x1796714882464960:12345-192.168.202.24@tcp:101:dd.0 Request processed in 72us (769us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.731944:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.731949:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563014 00000100:00100000:0.0:1713481296.731956:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563015 00010000:00010000:1.0:1713481296.731956:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.731960:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16859:17009:x1796714882465152:12345-192.168.202.24@tcp:101:dd.0 00000004:00200000:3.0:1713481296.731962:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c3:0x0]: returning size 4096 00000100:00100000:1.0:1713481296.731963:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20837:1959:x1796714882461760:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (666us total) trans 0 rc 0/0 00000004:00200000:3.0:1713481296.731965:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713481296.731967:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.731967:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820236 00000100:00100000:2.0:1713481296.731973:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563016 00000100:00100000:2.0:1713481296.731977:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20836:15045:x1796714882465216:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.731978:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ebe1c0/0xdfc0fb148a3a543 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49460 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.731979:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820237 00000100:00100000:1.0:1713481296.731981:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26930:1959:x1796714882461888:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.731983:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.731984:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800836b2f40/0xdfc0fb148a3a52e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x34c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4943d expref: 2371 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731986:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.731989:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013449d440/0xdfc0fb148688b87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29d5 expref: 26930 pid: 16504 timeout: 815 lvb_type: 1 00002000:00010000:0.0:1713481296.731990:0:16541:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.731992:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084b94b40/0xdfc0fb148a3a54a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49467 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.731994:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013449d440/0xdfc0fb148688b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29d5 expref: 26930 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.731999:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.731999:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800836b2d00/0xdfc0fb148a3a53c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4943d expref: 2370 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732000:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1713481296.732002:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.732003:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00010000:00010000:0.0:1713481296.732005:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ebe1c0/0xdfc0fb148a3a543 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49460 expref: 16860 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732005:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013449d440/0xdfc0fb148688b87 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29d5 expref: 26930 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.732005:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.732007:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800836b2d00, rc 0) 00010000:00010000:2.0:1713481296.732009:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.732011:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732012:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732013:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.732014:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084b94b40/0xdfc0fb148a3a54a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49467 expref: 20837 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732015:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ebe1c0/0xdfc0fb148a3a543 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49460 expref: 16860 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732015:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732019:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732020:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a11aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18874:x1796714882464512:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 169us (1013us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.732023:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ebe1c0, rc 0) 00010000:00010000:2.0:1713481296.732023:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084b94b40/0xdfc0fb148a3a54a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49467 expref: 20837 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732024:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485801 00010000:00010000:1.0:1713481296.732027:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.732030:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b94b40, rc 0) 00000100:00100000:0.0:1713481296.732039:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16860:17009:x1796714882465152:12345-192.168.202.24@tcp:101:dd.0 Request processed in 77us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.732045:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563015 00000100:00100000:1.0:1713481296.732045:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26929:1959:x1796714882461888:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.732048:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820237 00000100:00100000:2.0:1713481296.732048:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20837:15045:x1796714882465216:12345-192.168.202.24@tcp:101:dd.0 Request processed in 70us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.732057:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820238 00000100:00100000:2.0:1713481296.732057:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563016 00000100:00100000:1.0:1713481296.732060:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1959:x1796714882461696:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.732064:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.732066:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b806f40/0xdfc0fb148688b64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29c7 expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.732071:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b806f40/0xdfc0fb148688b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29c7 expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.732071:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820239 00000100:00100000:3.0:1713481296.732075:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26928:1959:x1796714882461824:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.732077:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732081:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.732082:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b806f40/0xdfc0fb148688b64 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29c7 expref: 26928 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.732083:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732086:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ad21680/0xdfc0fb148688b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29b9 expref: 26928 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.732089:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732090:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732090:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732092:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732093:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ad21680/0xdfc0fb148688b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29b9 expref: 26927 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.732095:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732095:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732096:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732100:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732102:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732104:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078c41440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.732104:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.732104:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ad21680/0xdfc0fb148688b56 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29b9 expref: 26927 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.732107:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732109:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732112:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26926:1959:x1796714882461696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 51us (770us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.732113:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732115:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732116:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820238 00010000:00010000:3.0:1713481296.732116:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.732136:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.732138:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732139:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732139:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732140:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820240 00000100:00100000:1.0:1713481296.732143:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26925:1959:x1796714882461952:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.732144:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d0b4d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.732144:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732145:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880078c41440/0xdfc0fb148a3a2d4 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732147:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.732147:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732150:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096af0240/0xdfc0fb148688b8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa910:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29e3 expref: 26925 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.732153:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732156:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096af0240/0xdfc0fb148688b8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa910:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29e3 expref: 26925 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.732164:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.732166:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732167:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096af0240/0xdfc0fb148688b8e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa910:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d29e3 expref: 26925 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.732172:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a2db lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa90f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732175:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26924:1959:x1796714882461824:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 100us (825us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.732176:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732177:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732179:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732180:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820239 00010000:00010000:1.0:1713481296.732183:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732192:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.732197:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98350 00000100:00100000:3.0:1713481296.732200:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:1959:x1796714882463872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.732201:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26923:1959:x1796714882461952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.732205:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820240 00010000:00010000:3.0:1713481296.732205:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.732212:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d014d80/0xdfc0fb148a3a33d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3899:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493a3 expref: 2797 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732224:0:15497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff88007da00600) 00000100:00100000:1.0:1713481296.732233:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800784c0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784493312:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.732238:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.732245:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732247:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:1959:x1796714882463872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 46us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.732251:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98350 00010000:00010000:1.0:1713481296.732253:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.732261:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+127:3491:x1796714784489792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8812us (8855us total) trans 4296040789 rc 0/0 00000100:00100000:0.0:1713481296.732267:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562972 00000004:00080000:1.0:1713481296.732271:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:1.0:1713481296.732286:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.732290:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.732294:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713481296.732301:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de12d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784493760:0@lo:101:mdt_io00_009.0 00000100:00100000:2.0:1713481296.732301:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+2731:3492:x1796714784489920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8620us (8727us total) trans 4295960672 rc 0/0 00000100:00100000:0.0:1713481296.732303:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.732307:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562974 00000100:00100000:1.0:1713481296.732318:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.732327:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008987ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.732341:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784493760 00000100:00100000:1.0:1713481296.732343:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784493760 00000100:00100000:2.0:1713481296.732347:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0000_UUID:16452:1796714784492224:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.732351:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.732357:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82889 00000100:00100000:1.0:1713481296.732361:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+32:15514:x1796714784493760:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.732367:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086f61200/0xdfc0fb148a3a45c lrc: 3/0,0 mode: --/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49413 expref: 16859 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732368:0:6936:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.732376:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086f61200, rc 0) 00010000:00010000:1.0:1713481296.732378:0:6936:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009f877600/0xdfc0fb148a3a558 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a551 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.732390:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16859:18836:x1796714882463488:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 3005us (3215us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.732391:0:6936:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009f877600/0xdfc0fb148a3a558 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a551 expref: 33 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.732396:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563001 00010000:00010000:1.0:1713481296.732399:0:6936:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009f877600/0xdfc0fb148a3a558 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a551 expref: 33 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.732401:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.732405:0:6936:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880079a55700) 00010000:00010000:1.0:1713481296.732407:0:6936:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.732409:0:6936:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f877600, rc 0) 00000100:00100000:2.0:1713481296.732410:0:16452:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465792 00000100:00100000:2.0:1713481296.732413:0:16452:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465792 00000100:00100000:0.0:1713481296.732419:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.732428:0:16452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563017 00000100:00100000:2.0:1713481296.732433:0:16452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882465792:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.732437:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784493760:12345-0@lo:101:mdt_io00_009.0 Request processed in 75us (117us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.732439:0:16452:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.732443:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82889 00010000:00010000:2.0:1713481296.732447:0:16452:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b95440/0xdfc0fb148a3a55f lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4946e expref: -99 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732459:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465344 00010000:00010000:2.0:1713481296.732461:0:16452:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008306dd40/0xdfc0fb148a13e4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37faf expref: 24483 pid: 16455 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.732462:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465344 00010000:00010000:2.0:1713481296.732467:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.732468:0:16452:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.732472:0:16452:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b95440/0xdfc0fb148a3a55f lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4946e expref: 24483 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732475:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485802 00000100:00100000:1.0:1713481296.732477:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784492864:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.732478:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18893:x1796714882465344:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:2.0:1713481296.732487:0:16452:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008306dd40/0xdfc0fb148a13e4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37faf expref: 24483 pid: 16455 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.732489:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.732493:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732495:0:16452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008306dd40/0xdfc0fb148a13e4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37faf expref: 24483 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.732498:0:15475:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.732504:0:16452:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0001_UUID:16452:1796714784493824:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.732506:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880086f621c0/0xdfc0fb148a3a440 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x38b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493f7 expref: 2192 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732513:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465408 00000100:00100000:1.0:1713481296.732516:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465408 00000100:00100000:2.0:1713481296.732518:0:16452:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800979649c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.732522:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b5:0x0].0x0 (ffff88007354dd00) 00010000:00010000:1.0:1713481296.732528:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133bf8fc0/0xdfc0fb148959c28 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebb4 expref: 26923 pid: 16477 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.732535:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465472 00010000:00010000:3.0:1713481296.732536:0:15475:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.732538:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465472 00010000:00010000:2.0:1713481296.732548:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dfa61c0/0xdfc0fb14891e5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb4b4 expref: 20837 pid: 16545 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.732549:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465600 00000100:00100000:1.0:1713481296.732550:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465600 00000100:00100000:0.0:1713481296.732551:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.732560:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c7c480/0xdfc0fb148802273 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962930 expref: 20838 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.732560:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465728 00000100:00100000:2.0:1713481296.732562:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465728 00010000:00010000:2.0:1713481296.732569:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd47180/0xdfc0fb148802296 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96295a expref: 20839 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.732572:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820241 00000100:00100000:1.0:1713481296.732576:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26923:1959:x1796714882465408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.732580:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820242 00000004:00080000:0.0:1713481296.732581:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801202ca300/2, rc 0, transno 993376 00010000:00010000:1.0:1713481296.732583:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.732583:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x38b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.732585:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20839:1959:x1796714882465472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.732588:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489920:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.732588:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.732591:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.732592:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.732593:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133bf8fc0/0xdfc0fb148959c28 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebb4 expref: 26923 pid: 16477 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.732595:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dfa61c0/0xdfc0fb14891e5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb4b4 expref: 20839 pid: 16545 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.732602:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133bf8fc0/0xdfc0fb148959c28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebb4 expref: 26923 pid: 16477 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.732608:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dfa61c0/0xdfc0fb14891e5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb4b4 expref: 20839 pid: 16545 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.732616:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820243 00010000:00010000:1.0:1713481296.732619:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.732620:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20839:1959:x1796714882465600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.732620:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732623:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880086f63840/0xdfc0fb148a3a455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4940c expref: 26923 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732623:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dfa61c0/0xdfc0fb14891e5f6 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb4b4 expref: 20839 pid: 16545 timeout: 815 lvb_type: 0 00000004:00010000:3.0:1713481296.732624:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880089881880 reply state ffff880094266000 transno 4295105908 ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.732627:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.732629:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.732630:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086f63840/0xdfc0fb148a3a455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4940c expref: 26923 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732632:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c7c480/0xdfc0fb148802273 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962930 expref: 20838 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.732632:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b5:0x0].0x0 (ffff880096325c00) 00010000:00010000:3.0:1713481296.732633:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.732635:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.732635:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713481296.732636:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.732640:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086f61200/0xdfc0fb148a3a45c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49413 expref: 16858 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732645:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c7c480/0xdfc0fb148802273 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962930 expref: 20838 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.732646:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880086f63840/0xdfc0fb148a3a455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4940c expref: 26923 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732647:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086f61200/0xdfc0fb148a3a45c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49413 expref: 16858 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732657:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.732657:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18893:x1796714882465344:12345-192.168.202.24@tcp:36:touch.0 Request processed in 178us (355us total) trans 4295105908 rc 0/0 00010000:00010000:0.0:1713481296.732659:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.732660:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784493952:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.732662:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732662:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485802 00010000:00010000:2.0:1713481296.732679:0:16520:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880086f61200/0xdfc0fb148a3a45c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49413 expref: 16858 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732682:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732689:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121ef0300 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.732689:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:16520:1796714784494016:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.732697:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.732698:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.732702:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.732705:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.732707:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.732711:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20838:1959:x1796714882465600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.732711:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820244 00010000:00010000:3.0:1713481296.732711:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732714:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732715:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20838:1959:x1796714882465728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.732717:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800784b9f80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.732718:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820243 00010000:00010000:3.0:1713481296.732719:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732722:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.732723:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732726:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd47180/0xdfc0fb148802296 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96295a expref: 20838 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.732732:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd47180/0xdfc0fb148802296 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96295a expref: 20837 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.732734:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784492928:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.732735:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732743:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800784b9f80/0xdfc0fb148a3a2cd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa90d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732744:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd47180/0xdfc0fb148802296 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96295a expref: 20837 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.732751:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.732752:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079566300/2, rc 0, transno 993375 00010000:00010000:1.0:1713481296.732752:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732753:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732755:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.732759:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491328:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.732759:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.732763:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.732768:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784493888:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.732769:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.732769:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732778:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20836:1959:x1796714882465728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (228us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.732779:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732785:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820244 00000100:00100000:0.0:1713481296.732786:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.732786:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732793:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732800:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732802:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732805:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350f58c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.732806:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732808:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732810:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732814:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732814:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732818:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732821:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009670af40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.732822:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732826:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732827:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732832:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.732833:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a3b4 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.732836:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009670af40/0xdfc0fb148a3a47f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.732862:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2731:3492:x1796714784489536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9560us (9649us total) trans 4295960673 rc 0/0 00000100:00100000:3.0:1713481296.732867:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562971 00000100:00100000:0.0:1713481296.732879:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007da26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494080:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.732886:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784493888 00000100:00100000:3.0:1713481296.732888:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784493888 00000100:00100000:0.0:1713481296.732897:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.732902:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494080 00000100:00100000:3.0:1713481296.732904:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494080 00000100:00100000:3.0:1713481296.732913:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563018 00000100:00100000:3.0:1713481296.732915:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2732:3490:x1796714784493888:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.732923:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801202ca680/2, rc 0, transno 993377 00002000:00080000:3.0:1713481296.732924:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43287 count 1 00000100:00100000:0.0:1713481296.732928:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489536:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.732932:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.732940:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007952c240/0xdfc0fb148688be2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa917:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a45 expref: 26923 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.732944:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.732945:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.732947:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+128:3492:x1796714784492672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2693us (2758us total) trans 4296040790 rc 0/0 00010000:00010000:3.0:1713481296.732947:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.732952:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563006 00010000:00010000:3.0:1713481296.732959:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007952c240/0xdfc0fb148688be2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa917:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a45 expref: 26923 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.732963:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563019 00000004:00080000:0.0:1713481296.732964:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008931e300/2, rc 0, transno 1073494 00000100:00100000:1.0:1713481296.732967:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007da26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2732:3492:x1796714784494080:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.732968:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007952c240/0xdfc0fb148688be2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa917:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a45 expref: 26923 pid: 16513 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.732971:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008931e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784492672:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.732974:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784494208:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.732975:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00080000:1.0:1713481296.732975:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43288 count 1 00000100:00100000:2.0:1713481296.732978:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+127:3490:x1796714784491648:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6600us (6688us total) trans 4296040791 rc 0/0 00000100:00100000:0.0:1713481296.732981:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007da26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494144:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.732983:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.732985:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562990 00000100:00100000:3.0:1713481296.732986:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095fc1d80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.732991:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007952eac0/0xdfc0fb148688c0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa918:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a53 expref: 26923 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.732994:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732995:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.732997:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733000:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.733007:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007952eac0/0xdfc0fb148688c0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa918:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a53 expref: 26923 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.733008:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494144 00000100:00100000:2.0:1713481296.733011:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494144 00010000:00010000:1.0:1713481296.733013:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007952eac0/0xdfc0fb148688c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa918:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a53 expref: 26923 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.733013:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c7c480/0xdfc0fb148802273 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962930 expref: 20835 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.733019:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784494272:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.733024:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784492736:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.733027:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563020 00000100:00100000:1.0:1713481296.733030:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092a4fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.733030:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007da25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2733:3492:x1796714784494144:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.733039:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801322a6a00/2, rc 0, transno 1073495 00002000:00080000:2.0:1713481296.733041:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43289 count 1 00000100:00100000:0.0:1713481296.733043:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801322a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784491648:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.733046:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784492544:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.733049:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733052:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733054:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733058:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.733059:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.733060:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a293b80/2, rc 0, transno 1073493 00010000:00010000:2.0:1713481296.733061:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148688d47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa919:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a61 expref: 26923 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.733062:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733063:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784489792:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.733066:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733066:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733068:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.733070:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733070:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733073:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de12d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784493760:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.733074:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800962be880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.733076:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.733078:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007dc88a80/2, rc 0, transno 993374 00010000:00010000:1.0:1713481296.733079:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733080:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733082:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784491712:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.733084:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733085:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148688d47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa919:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a61 expref: 26923 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.733087:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733091:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962be880/0xdfc0fb148a3a46a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733093:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148688d47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa919:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a61 expref: 26923 pid: 15558 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.733097:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:2.0:1713481296.733101:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e404e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784494336:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.733104:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784494400:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.733110:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784494464:0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.733134:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.733142:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.733142:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.733154:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c43bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.733154:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494400 00000100:00100000:2.0:1713481296.733157:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494400 00000100:00100000:1.0:1713481296.733165:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494464 00000100:00100000:1.0:1713481296.733167:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494464 00000100:00100000:2.0:1713481296.733175:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563021 00000100:00100000:1.0:1713481296.733178:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82890 00000100:00100000:2.0:1713481296.733179:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2734:3490:x1796714784494400:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.733180:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784494464:12345-0@lo:1000:mdt_io00_009.0 00002000:00080000:2.0:1713481296.733190:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43290 count 1 00000100:00100000:0.0:1713481296.733195:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494592:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.733202:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733211:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009172a400/0xdfc0fb148688d4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a6f expref: 26923 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.733212:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+127:3492:x1796714784492352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3155us (3202us total) trans 4296040792 rc 0/0 00010000:00010000:2.0:1713481296.733217:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.733217:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563003 00010000:00010000:2.0:1713481296.733218:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.733219:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.733219:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784494464:12345-0@lo:1000:mdt_io00_009.0 Request processed in 38us (77us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.733220:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733223:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82890 00000100:00100000:3.0:1713481296.733232:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494592 00000100:00100000:3.0:1713481296.733234:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494592 00010000:00010000:2.0:1713481296.733235:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009172a400/0xdfc0fb148688d4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a6f expref: 26923 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.733243:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009172a400/0xdfc0fb148688d4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a6f expref: 26923 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.733245:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563022 00000100:00100000:3.0:1713481296.733248:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+127:3492:x1796714784494592:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713481296.733249:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078543800/2, rc 0, transno 1073496 00000100:00100000:1.0:1713481296.733250:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784492800:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.733251:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e406a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784494720:192.168.202.24@tcp:104: 00002000:00080000:3.0:1713481296.733255:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9944 count 1 00000100:00100000:0.0:1713481296.733256:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784492352:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.733260:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733263:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713481296.733264:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.733266:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.733267:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494656:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.733271:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c7d200/0xdfc0fb14880228f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962976 expref: 20834 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.733272:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097d1cd80/0xdfc0fb148941a41 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6973:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e00e0 expref: 20834 pid: 16545 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.733279:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733280:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.733282:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784492096:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.733282:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733286:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.733292:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c7d200/0xdfc0fb14880228f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962976 expref: 20833 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.733293:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350f7180/0xdfc0fb148a3a3ec lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6973:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493e2 expref: 16858 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733297:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c7d200/0xdfc0fb14880228f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962976 expref: 20833 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.733298:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350f7180, rc 0) 00010000:00010000:2.0:1713481296.733301:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133bf8fc0/0xdfc0fb148959c28 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebb4 expref: 26923 pid: 16477 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.733304:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784494784:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.733307:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16858:11388:x1796714882462080:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5528us (5681us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.733311:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2562994 00000100:00100000:0.0:1713481296.733312:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.733315:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784492160:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.733315:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095fc1240 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.733318:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784494528:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.733323:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494656 00000100:00100000:1.0:1713481296.733325:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494656 00010000:00010000:2.0:1713481296.733336:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086f63840/0xdfc0fb148a3a455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x82ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4940c expref: 26922 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733337:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.733344:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086f63840, rc 0) 00000100:00100000:1.0:1713481296.733348:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494528 00000100:00100000:1.0:1713481296.733349:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494528 00000100:00100000:3.0:1713481296.733354:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563023 00000100:00100000:3.0:1713481296.733358:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+129:3492:x1796714784494656:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.733359:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26922:11552:x1796714882463360:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4093us (4197us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.733362:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563024 00000100:00100000:1.0:1713481296.733365:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+129:3490:x1796714784494528:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.733365:0:16460:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9945 count 1 00000100:00100000:2.0:1713481296.733366:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563000 00002000:00080000:1.0:1713481296.733373:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9943 count 1 00010000:00010000:3.0:1713481296.733375:0:16460:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.733381:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733382:0:16460:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008324fa80/0xdfc0fb14880229d lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962984 expref: 20833 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.733386:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.733387:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008324e400/0xdfc0fb148802288 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962968 expref: 20833 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.733387:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733388:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.733391:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.733392:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.733394:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713481296.733394:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733400:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784494848:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.733400:0:16460:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008324fa80/0xdfc0fb14880229d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962984 expref: 20833 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.733406:0:16460:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008324fa80/0xdfc0fb14880229d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962984 expref: 20833 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.733407:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008324e400/0xdfc0fb148802288 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962968 expref: 20833 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.733410:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.733412:0:16460:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16460:1796714784494912:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.733413:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008324e400/0xdfc0fb148802288 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962968 expref: 20833 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.733419:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784494976:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.733427:0:16460:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.733429:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.733432:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e688b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.733436:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.733444:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882464896 00000100:00100000:1.0:1713481296.733446:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882464896 00000100:00100000:3.0:1713481296.733447:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784494848 00000100:00100000:3.0:1713481296.733449:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784494848 00000100:00100000:1.0:1713481296.733457:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125672 00000100:00100000:1.0:1713481296.733459:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:18934:x1796714882464896:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:3.0:1713481296.733472:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563025 00000100:00100000:3.0:1713481296.733475:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+130:3491:x1796714784494848:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.733482:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9946 count 1 00010000:00010000:3.0:1713481296.733490:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733497:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0d80/0xdfc0fb1488022a4 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962992 expref: 20833 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.733501:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733502:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733504:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.733505:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.733514:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0d80/0xdfc0fb1488022a4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962992 expref: 20833 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.733523:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0d80/0xdfc0fb1488022a4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962992 expref: 20833 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.733529:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784495040:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.733537:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:18934:x1796714882464896:12345-192.168.202.24@tcp:35:touch.0 Request processed in 76us (2373us total) trans 4295105909 rc 0/0 00000100:00100000:1.0:1713481296.733541:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125672 00000100:00100000:3.0:1713481296.733541:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.733552:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465856 00000100:00100000:3.0:1713481296.733554:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465856 00000100:00100000:1.0:1713481296.733561:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465536 00000100:00100000:1.0:1713481296.733563:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465536 00010000:00010000:3.0:1713481296.733563:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148802281 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96294c expref: 20834 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.733571:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007952cd80/0xdfc0fb148688bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a29 expref: 26922 pid: 16513 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.733575:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465664 00000100:00100000:3.0:1713481296.733576:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465664 00010000:00010000:3.0:1713481296.733582:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd46f40/0xdfc0fb14880227a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96293e expref: 20835 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.733592:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820245 00000100:00100000:1.0:1713481296.733595:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20835:1957:x1796714882465856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.733598:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820246 00010000:00010000:1.0:1713481296.733601:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.733603:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820247 00000100:00100000:2.0:1713481296.733604:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26922:1959:x1796714882465536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.733605:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148802281 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96294c expref: 20835 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.733607:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20835:1959:x1796714882465664:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.733611:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148802281 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96294c expref: 20835 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.733611:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.733613:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.733614:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd46f40/0xdfc0fb14880227a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96293e expref: 20835 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.733618:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007952cd80/0xdfc0fb148688bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa915:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a29 expref: 26922 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.733620:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd46f40/0xdfc0fb14880227a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96293e expref: 20835 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.733624:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148802281 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96294c expref: 20835 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.733627:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007952cd80/0xdfc0fb148688bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa915:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a29 expref: 26922 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.733631:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.733632:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.733634:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.733638:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733639:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd46f40/0xdfc0fb14880227a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96293e expref: 20834 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.733643:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007952cd80/0xdfc0fb148688bd4 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa915:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a29 expref: 26922 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.733649:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.733651:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733652:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733654:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733658:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.733658:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733659:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20833:1957:x1796714882465856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (251us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.733659:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.733662:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733679:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820245 00010000:00010000:2.0:1713481296.733686:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733686:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.733699:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20832:1959:x1796714882465664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.733704:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820247 00010000:00010000:2.0:1713481296.733706:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.733715:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784494464:0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.733721:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1959:x1796714882465536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 117us (284us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.733721:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733726:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.733727:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820246 00010000:00010000:3.0:1713481296.733730:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733734:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733737:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733744:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096708900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.733746:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733747:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784495104:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.733750:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733753:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733760:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.733760:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733761:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.733764:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096708900/0xdfc0fb148a3a471 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733767:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733770:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.733774:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733779:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495104 00010000:00010000:2.0:1713481296.733780:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733781:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495104 00010000:00010000:2.0:1713481296.733786:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8d6400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.733788:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733791:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82891 00000100:00100000:1.0:1713481296.733793:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784495104:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:2.0:1713481296.733795:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733811:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.733817:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a463 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.733838:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784495104:12345-0@lo:1000:mdt_io00_009.0 Request processed in 44us (76us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.733842:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82891 00000100:00100000:1.0:1713481296.733868:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784495104:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.733887:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+131:3490:x1796714784492480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3732us (3775us total) trans 4296040793 rc 0/0 00000100:00100000:3.0:1713481296.733891:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563004 00000004:00080000:0.0:1713481296.733896:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078541880/2, rc 0, transno 1073497 00000100:00100000:1.0:1713481296.733896:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784495168:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.733904:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784492480:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.733909:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.733915:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c43bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.733924:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495168 00000100:00100000:1.0:1713481296.733925:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495168 00000100:00100000:0.0:1713481296.733929:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784495232:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.733935:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82892 00000100:00100000:1.0:1713481296.733937:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800784c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784495168:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.733947:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.733948:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dcdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2735:3491:x1796714784492416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3909us (3947us total) trans 4295960674 rc 0/0 00000100:00100000:2.0:1713481296.733954:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563002 00000100:00100000:3.0:1713481296.733967:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495232 00000100:00100000:3.0:1713481296.733969:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495232 00010000:00010000:2.0:1713481296.733976:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.733982:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563026 00010000:00010000:2.0:1713481296.733983:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.733985:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007dcd9c00/2, rc 0, transno 993378 00000100:00100000:1.0:1713481296.733985:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784495168:12345-0@lo:1000:mdt_io00_009.0 Request processed in 46us (74us total) trans 0 rc 1/1 00000100:00100000:3.0:1713481296.733985:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+131:3491:x1796714784495232:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.733990:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.733992:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784492416:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.733992:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82892 00002000:00080000:3.0:1713481296.733993:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9947 count 1 00010000:00010000:2.0:1713481296.733996:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734002:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.734002:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734008:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801346b2400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.734010:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.734012:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f394d80/0xdfc0fb1488022ab lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629a0 expref: 20831 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.734017:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734022:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784495296:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.734022:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.734023:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784495168:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.734024:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.734026:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734028:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734034:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801346b2400/0xdfc0fb148a3a478 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734039:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.734044:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f394d80/0xdfc0fb1488022ab lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629a0 expref: 20831 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.734052:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.734052:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f394d80/0xdfc0fb1488022ab lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629a0 expref: 20831 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.734056:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.734061:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.734062:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784495360:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.734067:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784495424:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.734081:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800985c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.734089:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.734099:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.734113:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495424 00000100:00100000:2.0:1713481296.734114:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495296 00000100:00100000:1.0:1713481296.734116:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495424 00000100:00100000:2.0:1713481296.734136:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495296 00000100:00100000:1.0:1713481296.734152:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82893 00000100:00100000:1.0:1713481296.734156:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784495424:12345-0@lo:101:mdt_io00_009.0 00000100:00100000:2.0:1713481296.734156:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563027 00000100:00100000:2.0:1713481296.734161:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2735:3492:x1796714784495296:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.734164:0:6936:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:2.0:1713481296.734171:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43291 count 1 00010000:00010000:1.0:1713481296.734172:0:6936:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a5ac expref: -99 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734182:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734186:0:6936:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880135440240/0xdfc0fb148a32d9b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44a62 expref: 2014 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734192:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa640/0xdfc0fb148688d55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a84 expref: 26920 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.734194:0:6936:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2014 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734198:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.734199:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.734201:0:6936:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 5/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 34 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734201:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.734213:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008931fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+132:3492:x1796714784492608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3969us (4052us total) trans 4296040794 rc 0/0 00010000:00010000:2.0:1713481296.734217:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa640/0xdfc0fb148688d55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a84 expref: 26920 pid: 16533 timeout: 0 lvb_type: 1 00000004:00080000:0.0:1713481296.734218:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008931ca80/2, rc 0, transno 1073498 00010000:00010000:1.0:1713481296.734218:0:6936:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2014 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.734221:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563005 00000100:00100000:0.0:1713481296.734225:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008931ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784492608:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.734226:0:6936:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2014 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.734231:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa640/0xdfc0fb148688d55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a84 expref: 26920 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.734235:0:6936:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6936:1796714784495552:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.734240:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e405880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784495488:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.734254:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784495616:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.734256:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0780 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.734258:0:6936:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880135440240/0xdfc0fb148a32d9b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44a62 expref: 2014 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734266:0:6936:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880135440240/0xdfc0fb148a32d9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44a62 expref: 2014 pid: 15577 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.734274:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.734279:0:6936:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6936:1796714784495680:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.734292:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495616 00000100:00100000:1.0:1713481296.734293:0:6936:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.734295:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495616 00000100:00100000:2.0:1713481296.734311:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563028 00000100:00100000:2.0:1713481296.734315:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+132:3493:x1796714784495616:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.734323:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.734324:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9948 count 1 00010000:00010000:1.0:1713481296.734330:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734334:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734337:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734342:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734344:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a655d40/0xdfc0fb1488022b2 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ae expref: 20831 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.734349:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734350:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.734351:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.734353:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734355:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350f4900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.734357:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734364:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734368:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a655d40/0xdfc0fb1488022b2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ae expref: 20831 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.734376:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a655d40/0xdfc0fb1488022b2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ae expref: 20831 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.734377:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734389:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350f4900/0xdfc0fb148a3a3c9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.734390:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784495744:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.734407:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.734493:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+133:3492:x1796714784491456:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8031us (8160us total) trans 4296040795 rc 0/0 00000100:00100000:1.0:1713481296.734498:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562992 00000004:00080000:0.0:1713481296.734509:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079567480/2, rc 0, transno 1073499 00000100:00100000:0.0:1713481296.734514:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784491456:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.734515:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734520:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734524:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734528:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734531:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734534:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350f6400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.734536:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734537:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784495808:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.734539:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734548:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734552:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a2c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa90e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734560:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.734648:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801202cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2736:3491:x1796714784489600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11557us (11647us total) trans 4295960675 rc 0/0 00000100:00100000:1.0:1713481296.734652:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562970 00000100:00100000:1.0:1713481296.734681:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495808 00000004:00080000:0.0:1713481296.734683:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801202c9c00/2, rc 0, transno 993379 00000100:00100000:1.0:1713481296.734684:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495808 00000100:00100000:0.0:1713481296.734690:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784489600:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.734701:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563029 00000100:00100000:1.0:1713481296.734703:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+133:3490:x1796714784495808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.734712:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9949 count 1 00000100:00100000:0.0:1713481296.734715:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713481296.734720:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734721:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784495872:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.734727:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0240/0xdfc0fb1488022b9 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629bc expref: 20831 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.734731:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.734732:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.734733:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734740:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.734743:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0240/0xdfc0fb1488022b9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629bc expref: 20831 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.734751:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0240/0xdfc0fb1488022b9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629bc expref: 20831 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.734757:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784495936:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.734758:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784495872 00000100:00100000:2.0:1713481296.734762:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784495872 00000100:00100000:1.0:1713481296.734772:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941d900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.734777:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563030 00000100:00100000:2.0:1713481296.734781:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2736:3490:x1796714784495872:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.734782:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734786:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734790:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.734791:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43292 count 1 00010000:00010000:1.0:1713481296.734794:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734797:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734800:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350f61c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.734802:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734802:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734805:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734812:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007952dd40/0xdfc0fb148688d5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a92 expref: 26920 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.734815:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734818:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a2e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734818:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.734819:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.734821:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.734836:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007952dd40/0xdfc0fb148688d5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a92 expref: 26920 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.734845:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007952dd40/0xdfc0fb148688d5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a92 expref: 26920 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.734853:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784496000:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.734875:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.734908:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800815c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2737:3492:x1796714784489984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11223us (11315us total) trans 4295960676 rc 0/0 00000100:00100000:1.0:1713481296.734912:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562975 00000004:00080000:0.0:1713481296.734918:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801202cb100/2, rc 0, transno 993380 00000100:00100000:0.0:1713481296.734924:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801202cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784489984:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.734931:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734935:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734939:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734943:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734946:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713481296.734946:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734949:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350f4240 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.734950:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784496064:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.734951:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734955:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.734963:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.734966:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.734967:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350f4240/0xdfc0fb148a3a2fe lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.735058:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+134:3493:x1796714784490432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11115us (11155us total) trans 4296040796 rc 0/0 00000100:00100000:1.0:1713481296.735062:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562979 00000004:00080000:0.0:1713481296.735091:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007de10a80/2, rc 0, transno 1073500 00000100:00100000:0.0:1713481296.735098:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784490432:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.735147:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.735154:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784496128:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.735175:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.735190:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcdaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784492288:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.735206:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.735226:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4019c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20831:1958:x1796714882462848:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5781us (6016us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.735233:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820223 00000100:00100000:1.0:1713481296.735249:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784496064 00000100:00100000:1.0:1713481296.735252:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784496064 00000100:00100000:1.0:1713481296.735261:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784496128 00000100:00100000:1.0:1713481296.735262:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784496128 00000100:00100000:1.0:1713481296.735269:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563031 00000100:00100000:1.0:1713481296.735272:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2737:3493:x1796714784496064:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.735280:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43293 count 1 00010000:00010000:1.0:1713481296.735287:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.735289:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563032 00000100:00100000:2.0:1713481296.735293:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+134:3492:x1796714784496128:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.735294:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9c6c0/0xdfc0fb148688d63 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aa0 expref: 26920 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.735298:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.735299:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.735300:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.735303:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9950 count 1 00010000:00010000:1.0:1713481296.735310:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ff9c6c0/0xdfc0fb148688d63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aa0 expref: 26920 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.735313:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.735315:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ff9c6c0/0xdfc0fb148688d63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aa0 expref: 26920 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.735320:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784496192:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.735323:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f397cc0/0xdfc0fb1488022c0 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ca expref: 20830 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.735328:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.735329:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.735332:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.735333:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88600 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.735346:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f397cc0/0xdfc0fb1488022c0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ca expref: 20830 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.735354:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f397cc0/0xdfc0fb1488022c0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ca expref: 20830 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.735363:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784496256:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.735371:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784493056:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.735381:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880088150300 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.735395:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.735434:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.735479:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465920 00000100:00100000:2.0:1713481296.735483:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465920 00000100:00100000:2.0:1713481296.735511:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485803 00000100:00100000:2.0:1713481296.735516:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2015:18905:x1796714882465920:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:2.0:1713481296.735528:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.735536:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095c91f80/0xdfc0fb148a3a5e4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49475 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.735574:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880089883800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784493568:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.735585:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.735592:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880089881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784493376:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.735593:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.735594:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.735600:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735610:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.735615:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.735616:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a11b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1957:x1796714882464640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4005us (4514us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.735618:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a6e4fc0/0xdfc0fb148a3a4e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49436 expref: 26920 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.735620:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.735622:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820235 00010000:00010000:0.0:1713481296.735628:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a6e4fc0, rc 0) 00000100:00100000:0.0:1713481296.735646:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:18817:x1796714882464448:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4194us (4735us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.735650:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124abcb40/0xdfc0fb148a3a5f9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.735652:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563010 00010000:00010000:2.0:1713481296.735655:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124abcb40/0xdfc0fb148a3a5f9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735675:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124abcb40/0xdfc0fb148a3a5f9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000004:00200000:2.0:1713481296.735698:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c39:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.735701:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713481296.735709:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880124abcb40/0xdfc0fb148a3a5f9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735717:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735722:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735726:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735732:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735736:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095c93600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.735738:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735743:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735749:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:2.0:1713481296.735751:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.735754:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735758:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095c93600/0xdfc0fb148a3a5eb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735773:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735778:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735782:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735786:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095c918c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.735788:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.735790:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de11880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000_UUID:15793:1796714784493440:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.735793:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735798:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff880136196200) 00010000:00010000:2.0:1713481296.735800:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.735802:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.735807:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3a5f2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.735809:0:15793:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.735843:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095c91f80/0xdfc0fb148a3a5e4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49475 expref: 2017 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.735855:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880124abcb40/0xdfc0fb148a3a5f9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49475 expref: 2016 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.735860:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff880136196c00) 00010000:00010000:2.0:1713481296.735862:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713481296.735865:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124abcb40, rc 0) 00000100:00100000:2.0:1713481296.735888:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2016:18905:x1796714882465920:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 370us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.735895:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485803 00000100:00100000:2.0:1713481296.735932:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800786d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784493696:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.735946:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.735952:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084b958c0/0xdfc0fb148a3a527 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49452 expref: 24483 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.735961:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b958c0, rc 0) 00000100:00100000:0.0:1713481296.735962:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.735977:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.735977:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466240 00000100:00100000:1.0:1713481296.735980:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466240 00000100:00100000:2.0:1713481296.735981:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:17924:x1796714882464768:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4219us (4830us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.735987:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563013 00000100:00100000:1.0:1713481296.735999:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563033 00000100:00100000:1.0:1713481296.736004:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16858:18844:x1796714882466240:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.736011:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.736020:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086afeac0/0xdfc0fb148a3a600 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49483 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.736021:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc89500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784493120:192.168.202.24@tcp:105: 00002000:00010000:1.0:1713481296.736031:0:15510:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.736034:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.736035:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.736040:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.736042:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.736046:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086afeac0/0xdfc0fb148a3a600 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49483 expref: 16859 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.736051:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.736052:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16859:1958:x1796714882462912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5386us (5505us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.736055:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086afeac0/0xdfc0fb148a3a600 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49483 expref: 16859 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.736059:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820230 00010000:00010000:1.0:1713481296.736060:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086afeac0, rc 0) 00000100:00100000:1.0:1713481296.736074:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16858:18844:x1796714882466240:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 70us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.736078:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563033 00000100:00100000:0.0:1713481296.736093:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.736098:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882465984 00000100:00100000:1.0:1713481296.736100:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882465984 00010000:00010000:1.0:1713481296.736107:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe07a80/0xdfc0fb148688bdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a37 expref: 26920 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.736107:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466176 00000100:00100000:2.0:1713481296.736110:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466176 00000100:00100000:1.0:1713481296.736117:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466368 00000100:00100000:1.0:1713481296.736135:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466368 00000100:00100000:0.0:1713481296.736137:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.736137:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800916d1200/0xdfc0fb14891d429 lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6e5 expref: 24483 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.736141:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ef40/0xdfc0fb148a30c15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435f5 expref: 2797 pid: 15591 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.736149:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466496 00000100:00100000:1.0:1713481296.736151:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466496 00010000:00010000:1.0:1713481296.736155:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d17840/0xdfc0fb148a16257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39813 expref: 24484 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.736156:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466112 00000100:00100000:0.0:1713481296.736157:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.736159:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466112 00000100:00100000:3.0:1713481296.736168:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466304 00010000:00010000:2.0:1713481296.736169:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008333c900/0xdfc0fb148916d7c lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6561 expref: 24485 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.736170:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.736171:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820248 00000100:00100000:1.0:1713481296.736173:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1957:x1796714882465984:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.736173:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466304 00010000:00010000:1.0:1713481296.736178:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.736180:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.736180:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007fe07a80/0xdfc0fb148688bdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa916:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a37 expref: 26920 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.736186:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007fe07a80/0xdfc0fb148688bdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa916:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a37 expref: 26920 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736189:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800917d3cc0/0xdfc0fb1489cf728 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22138 expref: 24486 pid: 16547 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.736191:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466432 00000100:00100000:2.0:1713481296.736193:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466432 00000100:00100000:0.0:1713481296.736194:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.736200:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fe07a80/0xdfc0fb148688bdb lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa916:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a37 expref: 26921 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.736202:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800803806c0/0xdfc0fb14893ab7c lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e7 expref: 26921 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.736209:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.736210:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.736210:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.736212:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736217:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.736219:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820249 00000100:00100000:3.0:1713481296.736225:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:1957:x1796714882466368:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.736229:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820250 00010000:00010000:1.0:1713481296.736230:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.736232:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.736235:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820251 00000100:00100000:2.0:1713481296.736235:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4019850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24486:1957:x1796714882466176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.736238:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ef40/0xdfc0fb148a30c15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435f5 expref: 2797 pid: 15591 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.736241:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24486:1957:x1796714882466496:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.736243:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.736244:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1957:x1796714882465984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (265us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.736247:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800916d1200/0xdfc0fb14891d429 lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6e5 expref: 24486 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736248:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ef40/0xdfc0fb148a30c15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435f5 expref: 2797 pid: 15591 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.736249:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820248 00010000:00010000:0.0:1713481296.736250:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.736254:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d17840/0xdfc0fb148a16257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39813 expref: 24486 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.736256:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800916d1200/0xdfc0fb14891d429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6e5 expref: 24486 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736262:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ef40/0xdfc0fb148a30c15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435f5 expref: 2797 pid: 15591 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.736265:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d17840/0xdfc0fb148a16257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39813 expref: 24486 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.736266:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820252 00010000:00010000:2.0:1713481296.736267:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.736271:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24486:1957:x1796714882466112:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.736277:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.736278:0:16582:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x513e:0x0].0x0 (ffff880136289900) 00010000:00010000:0.0:1713481296.736282:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d17840/0xdfc0fb148a16257 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39813 expref: 24486 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736283:0:16582:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.736284:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4019850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24486:1957:x1796714882466176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 49us (249us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.736288:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008333c900/0xdfc0fb148916d7c lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6561 expref: 24486 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736289:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.736291:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820250 00010000:00010000:0.0:1713481296.736293:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.736295:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.736295:0:16582:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736296:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008333c900/0xdfc0fb148916d7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6561 expref: 24485 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.736298:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084b958c0/0xdfc0fb148a3a527 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49452 expref: 24485 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.736305:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b958c0/0xdfc0fb148a3a527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49452 expref: 24484 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736311:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.736312:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.736313:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.736317:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801346b33c0/0xdfc0fb148a3a49b lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4941a expref: 24484 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.736319:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880084b958c0/0xdfc0fb148a3a527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49452 expref: 24484 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736322:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801346b33c0/0xdfc0fb148a3a49b lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4941a expref: 24484 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.736332:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784496320:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.736332:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:1957:x1796714882466368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (279us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.736335:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801346b33c0/0xdfc0fb148a3a49b lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4941a expref: 24484 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.736339:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820249 00000100:00100000:1.0:1713481296.736341:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784496384:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.736349:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800909a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.736355:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.736358:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820253 00000100:00100000:3.0:1713481296.736364:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1957:x1796714882466304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.736368:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466624 00000100:00100000:1.0:1713481296.736369:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466624 00000100:00100000:0.0:1713481296.736370:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.736371:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.736372:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820254 00010000:00010000:3.0:1713481296.736375:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800917d3cc0/0xdfc0fb1489cf728 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22138 expref: 24484 pid: 16547 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.736378:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26919:1957:x1796714882466432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.736380:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466752 00000100:00100000:1.0:1713481296.736381:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466752 00010000:00010000:2.0:1713481296.736385:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.736385:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800917d3cc0/0xdfc0fb1489cf728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22138 expref: 24484 pid: 16547 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.736389:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563034 00010000:00010000:2.0:1713481296.736390:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800803806c0/0xdfc0fb14893ab7c lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e7 expref: 26919 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.736392:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16859:8499:x1796714882466624:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.736397:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.736402:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.736403:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086afc900/0xdfc0fb148a3a607 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4948a expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.736404:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800803806c0/0xdfc0fb14893ab7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e7 expref: 26919 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736407:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800917d3cc0/0xdfc0fb1489cf728 lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22138 expref: 24484 pid: 16547 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.736412:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb1488e7e4c lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54f4 expref: 16860 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.736416:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.736417:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.736418:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.736419:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086afc900/0xdfc0fb148a3a607 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4948a expref: 16860 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.736420:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.736420:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.736422:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.736424:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084b96640/0xdfc0fb148a3a504 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4944b expref: 24483 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.736426:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a6e4fc0/0xdfc0fb148a3a4e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49436 expref: 26919 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736428:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb1488e7e4c lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54f4 expref: 16860 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.736432:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b96640/0xdfc0fb148a3a504 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4944b expref: 24483 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736433:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb1488e7e4c lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54f4 expref: 16860 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736435:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6e4fc0/0xdfc0fb148a3a4e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49436 expref: 26919 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.736438:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784496448:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.736449:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880084b96640/0xdfc0fb148a3a504 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4944b expref: 24483 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.736452:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c43b6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.736453:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a6e4fc0/0xdfc0fb148a3a4e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49436 expref: 26919 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.736458:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc89500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784496512:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.736459:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.736461:0:15793:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:3.0:1713481296.736463:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784496576:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.736465:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736476:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.736476:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801356046c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.736482:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736487:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:3.0:1713481296.736488:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.736489:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466880 00000100:00100000:2.0:1713481296.736492:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466880 00000100:00100000:2.0:1713481296.736516:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563035 00000100:00100000:2.0:1713481296.736520:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16860:17935:x1796714882466752:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.736522:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563036 00000100:00100000:0.0:1713481296.736527:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:18792:x1796714882466880:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.736527:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.736531:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.736535:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.736535:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.736537:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2e5f80/0xdfc0fb148a3a615 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49498 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736538:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736540:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206ceac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.736542:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.736545:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ebcb40/0xdfc0fb148a3a61c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc510:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4949f expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736545:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736549:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff88008afe1000) 00002000:00010000:2.0:1713481296.736549:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.736551:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.736552:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736555:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801206ceac0/0xdfc0fb148a3a60e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00002000:00010000:0.0:1713481296.736557:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc510:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.736558:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.736560:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.736564:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2e5f80/0xdfc0fb148a3a615 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49498 expref: 16861 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.736566:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.736568:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.736572:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ebcb40/0xdfc0fb148a3a61c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4949f expref: 20831 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.736573:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2e5f80/0xdfc0fb148a3a615 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49498 expref: 16861 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736578:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736581:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.736581:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2e5f80, rc 0) 00010000:00010000:0.0:1713481296.736583:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ebcb40/0xdfc0fb148a3a61c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc510:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4949f expref: 20831 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736584:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736587:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800801461c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.736588:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.736590:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ebcb40, rc 0) 00010000:00010000:1.0:1713481296.736591:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736594:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x513e:0x0].0x0 (ffff880136289900) 00010000:00010000:1.0:1713481296.736595:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.736596:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736599:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800801461c0/0xdfc0fb148a3a4f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.736599:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16861:17935:x1796714882466752:12345-192.168.202.24@tcp:101:dd.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.736605:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563035 00000100:00100000:0.0:1713481296.736606:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20831:18792:x1796714882466880:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.736612:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563036 00010000:00010000:1.0:1713481296.736614:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736617:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736619:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736622:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736624:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096709200 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.736625:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466816 00010000:00010000:1.0:1713481296.736626:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.736627:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466816 00010000:00010000:1.0:1713481296.736631:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736634:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.736635:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.736637:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736639:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096709200/0xdfc0fb148a3a4d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.736641:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.736642:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98351 00000100:00100000:2.0:1713481296.736646:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084836d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2016:1957:x1796714882466816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.736650:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.736652:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.736653:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736656:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.736657:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466944 00010000:00010000:1.0:1713481296.736658:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009670b840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.736659:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.736660:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466944 00010000:00010000:2.0:1713481296.736660:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f876d00/0xdfc0fb148a3a520 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4942f expref: 2016 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736662:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736682:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff88009e4d4b00) 00010000:00010000:1.0:1713481296.736683:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.736685:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736688:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009670b840/0xdfc0fb148a3a4da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.736690:0:6919:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88009de91e00) 00000100:00100000:0.0:1713481296.736693:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563037 00010000:00010000:2.0:1713481296.736693:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.736697:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16861:17009:x1796714882466944:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.736704:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.736709:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084836d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2015:1957:x1796714882466816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (305us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.736710:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.736712:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ebc000/0xdfc0fb148a3a623 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494a6 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.736713:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.736715:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98351 00010000:00010000:1.0:1713481296.736716:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736719:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096709680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.736720:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736723:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00002000:00010000:0.0:1713481296.736724:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.736726:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff88008372fa00) 00010000:00010000:1.0:1713481296.736727:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.736728:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.736730:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096709680/0xdfc0fb148a3a4e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.736732:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.736734:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.736738:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ebc000/0xdfc0fb148a3a623 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494a6 expref: 16862 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.736748:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ebc000/0xdfc0fb148a3a623 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494a6 expref: 16862 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.736748:0:16452:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_024:lustre-OST0001_UUID:16452:1796714784493824:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.736755:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ebc000, rc 0) 00000100:00100000:1.0:1713481296.736762:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18899:x1796714882465088:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 5412us (5500us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.736766:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26103 00010000:00010000:2.0:1713481296.736768:0:16452:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084b95440/0xdfc0fb148a3a55f lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4946e expref: 24483 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.736772:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466048 00000100:00100000:0.0:1713481296.736773:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16862:17009:x1796714882466944:12345-192.168.202.24@tcp:101:dd.0 Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.736776:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466048 00010000:00010000:2.0:1713481296.736777:0:16452:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b95440, rc 0) 00000100:00100000:0.0:1713481296.736778:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563037 00000100:00100000:2.0:1713481296.736791:0:16452:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:14753:x1796714882465792:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4357us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.736796:0:16452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563017 00000100:00100000:3.0:1713481296.736796:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466688 00000100:00100000:3.0:1713481296.736798:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466688 00000100:00100000:1.0:1713481296.736805:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882466560 00000100:00100000:1.0:1713481296.736807:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882466560 00000100:00100000:3.0:1713481296.736813:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485804 00000100:00100000:3.0:1713481296.736817:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2015:18678:x1796714882466048:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:1.0:1713481296.736818:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125673 00000100:00100000:1.0:1713481296.736820:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18729:x1796714882466560:12345-192.168.202.24@tcp:37:rm.0 00010000:00010000:3.0:1713481296.736825:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.736829:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008333c900/0xdfc0fb148916d7c lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6561 expref: 24482 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.736836:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073543cc0/0xdfc0fb148a3a62a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4947c expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.736842:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784493248:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.736860:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801346b33c0/0xdfc0fb148a3a49b lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x29b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4941a expref: 24481 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.736868:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801346b33c0, rc 0) 00000100:00100000:2.0:1713481296.736883:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:10479:x1796714882463744:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5893us (6220us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.736888:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563008 00010000:00010000:3.0:1713481296.736901:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.736908:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.736916:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.736920:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:16520:1796714784494016:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.736926:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.736932:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.736938:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.736939:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.736957:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1959:x1796714882465472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4371us (4537us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.736963:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820242 00000100:00100000:0.0:1713481296.736968:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.736976:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800735406c0/0xdfc0fb148a3a63f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.736983:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800735406c0/0xdfc0fb148a3a63f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.736987:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467200 00010000:00010000:3.0:1713481296.736989:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800735406c0/0xdfc0fb148a3a63f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.736990:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467200 00000100:00100000:0.0:1713481296.737004:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.737005:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563038 00000100:00100000:2.0:1713481296.737010:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16862:11552:x1796714882467200:12345-192.168.202.24@tcp:101:dd.0 00000004:00200000:3.0:1713481296.737014:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2ca6:0x0]: returning size 0 00000004:00200000:3.0:1713481296.737017:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713481296.737018:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.737028:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008af8e880/0xdfc0fb148a3a646 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494ad expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713481296.737028:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800735406c0/0xdfc0fb148a3a63f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.737035:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800735406c0/0xdfc0fb148a3a63f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.737042:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007df5b180/0xdfc0fb148959bfe lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebbb expref: 16863 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.737042:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.737043:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.737048:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.737048:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.737050:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.737052:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.737053:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008af8e880/0xdfc0fb148a3a646 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494ad expref: 16863 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737057:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.737062:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800735418c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.737065:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.737068:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007df5b180/0xdfc0fb148959bfe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebbb expref: 16863 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.737070:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.737077:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007df5b180/0xdfc0fb148959bfe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebbb expref: 16863 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737077:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x0 (ffff88007fef3600) 00010000:00010000:3.0:1713481296.737079:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.737082:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.737086:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784496640:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.737087:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800735418c0/0xdfc0fb148a3a631 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.737104:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.737108:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.737114:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.737137:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467072 00000100:00100000:2.0:1713481296.737140:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467072 00010000:00010000:3.0:1713481296.737144:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.737148:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073540000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.737151:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.737152:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148688d47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa919:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a61 expref: 26920 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737156:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.737162:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x3331 (ffff88009cabaf00) 00010000:00010000:3.0:1713481296.737165:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.737167:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467264 00010000:00010000:3.0:1713481296.737167:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.737169:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467264 00010000:00010000:3.0:1713481296.737172:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073540000/0xdfc0fb148a3a638 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.737177:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007952eac0/0xdfc0fb148688c0c lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa918:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a53 expref: 26921 pid: 16513 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.737189:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820255 00000100:00100000:2.0:1713481296.737193:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1959:x1796714882467072:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.737199:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.737203:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148688d47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa919:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a61 expref: 26921 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.737211:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148688d47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa919:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a61 expref: 26921 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737212:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073543cc0/0xdfc0fb148a3a62a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4947c expref: 2017 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737226:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.737227:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.737230:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737236:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800735406c0/0xdfc0fb148a3a63f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4947c expref: 2016 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737237:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737242:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca6:0x0].0x0 (ffff88009a48ae00) 00010000:00010000:3.0:1713481296.737245:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.737247:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800735406c0, rc 0) 00000100:00100000:0.0:1713481296.737248:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.737250:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.737270:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2016:18678:x1796714882466048:12345-192.168.202.24@tcp:101:rm.0 Request processed in 451us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.737273:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1959:x1796714882467072:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.737276:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485804 00000100:00100000:2.0:1713481296.737280:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820255 00000100:00100000:2.0:1713481296.737295:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467008 00000100:00100000:3.0:1713481296.737296:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485805 00000100:00100000:2.0:1713481296.737298:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467008 00000100:00100000:0.0:1713481296.737301:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.737302:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2192:18578:x1796714882466688:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:1.0:1713481296.737303:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784493952:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.737307:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008306dd40/0xdfc0fb148a13e4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37faf expref: 24481 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737312:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.737316:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.737321:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a64d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49491 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.737323:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467136 00000100:00100000:2.0:1713481296.737325:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467136 00000100:00100000:1.0:1713481296.737326:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1959:x1796714882465408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4750us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.737331:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820241 00010000:00010000:2.0:1713481296.737332:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007952c240/0xdfc0fb148688be2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa917:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a45 expref: 26921 pid: 16513 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.737343:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820256 00000100:00100000:2.0:1713481296.737347:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1959:x1796714882467264:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.737354:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.737358:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007952eac0/0xdfc0fb148688c0c lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa918:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a53 expref: 26920 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.737365:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007952eac0/0xdfc0fb148688c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa918:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a53 expref: 26920 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737377:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb148a3a654 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.737379:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.737381:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.737383:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.737384:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820257 00010000:00010000:3.0:1713481296.737385:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb148a3a654 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.737388:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1959:x1796714882467008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.737390:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737392:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb148a3a654 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.737395:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.737402:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.737405:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008306dd40/0xdfc0fb148a13e4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37faf expref: 24481 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.737412:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008306dd40/0xdfc0fb148a13e4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37faf expref: 24481 pid: 16455 timeout: 815 lvb_type: 1 00000004:00200000:3.0:1713481296.737412:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385d:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.737414:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713481296.737420:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1959:x1796714882467264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (375us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.737425:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008306dd40/0xdfc0fb148a13e4d lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37faf expref: 24481 pid: 16455 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.737425:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820256 00010000:00010000:1.0:1713481296.737435:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.737436:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.737438:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084b95440/0xdfc0fb148a3a55f lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4946e expref: 24480 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737438:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0b4d80/0xdfc0fb148a3a64d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49491 expref: 2194 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737443:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084b95440/0xdfc0fb148a3a55f lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4946e expref: 24480 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.737444:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820258 00000100:00100000:2.0:1713481296.737448:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26919:1959:x1796714882467136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.737451:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb148a3a654 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49491 expref: 2193 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737454:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880084b95440/0xdfc0fb148a3a55f lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4946e expref: 24480 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737455:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.737458:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88011f854800) 00000100:00100000:1.0:1713481296.737460:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081566a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784496704:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.737460:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007952c240/0xdfc0fb148688be2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa917:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a45 expref: 26919 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737460:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.737463:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0dcfc0, rc 0) 00010000:00010000:2.0:1713481296.737469:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007952c240/0xdfc0fb148688be2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa917:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a45 expref: 26919 pid: 16513 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.737474:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121ef0300 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.737481:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.737483:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.737484:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18578:x1796714882466688:12345-192.168.202.24@tcp:101:rm.0 Request processed in 182us (1273us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.737485:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.737490:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485805 00010000:00010000:1.0:1713481296.737492:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007952eac0/0xdfc0fb148688c0c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa918:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a53 expref: 26919 pid: 16513 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.737492:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.737502:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784494272:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.737504:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.737514:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737517:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737519:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.737521:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1959:x1796714882467136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.737522:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.737523:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737525:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737527:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.737527:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820258 00010000:00010000:1.0:1713481296.737530:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737533:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737534:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737537:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f877cc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.737539:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737540:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737543:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.737543:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467328 00000100:00100000:2.0:1713481296.737545:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467328 00010000:00010000:3.0:1713481296.737546:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737551:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737552:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009172a400/0xdfc0fb148688d4e lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a6f expref: 26918 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737553:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009635d680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.737556:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f877cc0/0xdfc0fb148a3a574 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737556:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737562:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.737564:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820259 00000100:00100000:2.0:1713481296.737567:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1959:x1796714882467328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.737574:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.737575:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737578:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009172a400/0xdfc0fb148688d4e lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a6f expref: 26918 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.737586:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009172a400/0xdfc0fb148688d4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a6f expref: 26918 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.737586:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009635d680/0xdfc0fb148a3a494 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737601:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.737602:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.737605:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737612:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737623:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.737640:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26918:1959:x1796714882467328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.737646:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820259 00000100:00100000:1.0:1713481296.737702:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007da26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2739:3492:x1796714784494080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4733us (4803us total) trans 4295960677 rc 0/0 00010000:00010000:2.0:1713481296.737703:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009172a400/0xdfc0fb148688d4e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a6f expref: 26917 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.737707:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563019 00000100:00100000:2.0:1713481296.737719:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e406a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784494720:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.737733:0:6936:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6936:1796714784495552:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.737734:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.737740:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.737745:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467392 00000100:00100000:1.0:1713481296.737746:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467392 00010000:00010000:2.0:1713481296.737747:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737754:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737755:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c7d200/0xdfc0fb14880228f lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962976 expref: 20830 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.737761:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.737766:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820260 00010000:00010000:2.0:1713481296.737767:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.737769:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007da26680/2, rc 0, transno 993381 00000100:00100000:1.0:1713481296.737769:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1959:x1796714882467392:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.737773:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.737773:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.737773:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800784c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2738:3490:x1796714784492992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7256us (7311us total) trans 4295960678 rc 0/0 00010000:00010000:1.0:1713481296.737775:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c7d200/0xdfc0fb14880228f lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962976 expref: 20830 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.737776:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007da26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494080:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.737779:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007975a640 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.737781:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563007 00010000:00010000:2.0:1713481296.737782:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737784:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c7d200/0xdfc0fb14880228f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962976 expref: 20830 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.737788:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737794:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.737795:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.737797:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737799:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.737800:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007dcd8700/2, rc 0, transno 993382 00010000:00010000:1.0:1713481296.737802:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.737806:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a582 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa91a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737810:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.737825:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1959:x1796714882467392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (92us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.737825:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007952c240/0xdfc0fb148688be2 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa917:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a45 expref: 26916 pid: 16513 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.737830:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820260 00000100:00100000:3.0:1713481296.737840:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784494208:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.737862:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784494976:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.737862:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737870:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737876:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.737878:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737883:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737889:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737900:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737906:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083acf3c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.737908:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737915:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.737926:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784492992:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.737930:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.737936:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083acf3c0/0xdfc0fb148a3a56d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.737942:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2738:3490:x1796714784494400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4761us (4798us total) trans 4295960679 rc 0/0 00000100:00100000:1.0:1713481296.737944:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:0.0:1713481296.737945:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099844a80/2, rc 0, transno 993383 00000100:00100000:0.0:1713481296.737948:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784494400:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.737949:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563021 00000100:00100000:1.0:1713481296.737970:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.737974:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467456 00000100:00100000:2.0:1713481296.737976:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467456 00010000:00010000:2.0:1713481296.737987:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008324fa80/0xdfc0fb14880229d lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962984 expref: 20830 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.737992:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.738000:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738003:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467520 00000100:00100000:2.0:1713481296.738005:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467520 00010000:00010000:2.0:1713481296.738014:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008324e400/0xdfc0fb148802288 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962968 expref: 20831 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738016:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.738023:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738024:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467584 00000100:00100000:2.0:1713481296.738026:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467584 00000100:00100000:1.0:1713481296.738030:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738032:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0d80/0xdfc0fb1488022a4 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962992 expref: 20832 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738037:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738040:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467648 00000100:00100000:0.0:1713481296.738042:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784496832:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.738042:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467648 00000100:00100000:1.0:1713481296.738043:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738047:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f394d80/0xdfc0fb1488022ab lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629a0 expref: 20833 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738054:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738054:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467776 00000100:00100000:2.0:1713481296.738056:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467776 00010000:00010000:2.0:1713481296.738061:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa640/0xdfc0fb148688d55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a84 expref: 26916 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738065:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738070:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467968 00000100:00100000:2.0:1713481296.738071:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467968 00000100:00100000:0.0:1713481296.738074:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.738079:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a655d40/0xdfc0fb1488022b2 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ae expref: 20834 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738081:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.738085:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2738:3490:x1796714784493888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5167us (5298us total) trans 4295960680 rc 0/0 00000100:00100000:2.0:1713481296.738087:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468160 00000100:00100000:2.0:1713481296.738089:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468160 00000100:00100000:3.0:1713481296.738092:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563018 00000100:00100000:1.0:1713481296.738096:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738096:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff9c6c0/0xdfc0fb148688d63 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aa0 expref: 26917 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.738097:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.738103:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784496768:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.738105:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738105:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468032 00000100:00100000:2.0:1713481296.738107:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468032 00000100:00100000:3.0:1713481296.738112:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784496832 00000100:00100000:1.0:1713481296.738113:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738113:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0240/0xdfc0fb1488022b9 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629bc expref: 20835 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.738116:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784496832 00000100:00100000:0.0:1713481296.738136:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.738138:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738148:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468224 00000100:00100000:2.0:1713481296.738151:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468224 00000100:00100000:3.0:1713481296.738154:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468288 00000100:00100000:3.0:1713481296.738157:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468288 00010000:00010000:2.0:1713481296.738161:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f397cc0/0xdfc0fb1488022c0 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ca expref: 20836 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.738166:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784496768 00000100:00100000:3.0:1713481296.738168:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784496768 00000100:00100000:2.0:1713481296.738169:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467712 00000100:00100000:2.0:1713481296.738171:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467712 00000100:00100000:3.0:1713481296.738177:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563039 00010000:00010000:2.0:1713481296.738178:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2016 pid: 15483 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.738183:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2739:3491:x1796714784496832:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.738185:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468096 00000100:00100000:2.0:1713481296.738187:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468096 00010000:00010000:2.0:1713481296.738193:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007952dd40/0xdfc0fb148688d5c lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a92 expref: 26918 pid: 16454 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.738194:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43295 count 1 00000100:00100000:2.0:1713481296.738200:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468416 00000100:00100000:2.0:1713481296.738202:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468416 00010000:00010000:3.0:1713481296.738207:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.738209:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738209:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468352 00000100:00100000:2.0:1713481296.738211:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468352 00010000:00010000:3.0:1713481296.738217:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942aaf40/0xdfc0fb148688d71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2abc expref: 26918 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.738218:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.738219:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820261 00000100:00100000:1.0:1713481296.738220:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738224:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20836:1959:x1796714882467456:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.738224:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.738226:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784496896:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.738226:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.738229:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.738230:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738230:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.738234:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008324fa80/0xdfc0fb14880229d lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962984 expref: 20836 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738240:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738242:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008324fa80/0xdfc0fb14880229d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962984 expref: 20836 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.738245:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.738245:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942aaf40/0xdfc0fb148688d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2abc expref: 26918 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.738249:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.738255:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942aaf40/0xdfc0fb148688d71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2abc expref: 26918 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.738257:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.738258:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.738260:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738261:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.738265:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784496960:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.738268:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738272:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882467904 00000100:00100000:0.0:1713481296.738275:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882467904 00010000:00010000:2.0:1713481296.738281:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.738286:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.738297:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20836:1959:x1796714882467456:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.738302:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820261 00000100:00100000:1.0:1713481296.738306:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.738312:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c7d200/0xdfc0fb14880228f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962976 expref: 20836 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738315:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.738318:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820262 00000100:00100000:2.0:1713481296.738322:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20834:1959:x1796714882467520:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.738328:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.738328:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784494784:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.738333:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008324e400/0xdfc0fb148802288 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962968 expref: 20834 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.738341:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008324e400/0xdfc0fb148802288 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962968 expref: 20834 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.738343:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468544 00000100:00100000:0.0:1713481296.738346:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468544 00010000:00010000:2.0:1713481296.738354:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008324e400/0xdfc0fb148802288 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962968 expref: 20834 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.738354:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738361:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125674 00010000:00010000:2.0:1713481296.738365:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.738366:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738367:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2017:25569:x1796714882467904:12345-192.168.202.24@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1713481296.738367:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.738369:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738372:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738376:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738380:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.738382:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.738387:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.738390:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738393:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.738394:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738399:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084350240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.738402:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738409:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738411:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20833:1959:x1796714882467520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 87us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.738416:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820262 00010000:00010000:3.0:1713481296.738422:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738430:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084350240/0xdfc0fb148a3a589 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738431:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469120 00000100:00100000:2.0:1713481296.738434:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469120 00000100:00100000:1.0:1713481296.738443:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.738443:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb1488e7e4c lrc: 5/0,0 mode: PR/PR res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54f4 expref: 16865 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.738444:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2018:25569:x1796714882467904:12345-192.168.202.24@tcp:35:ldlm_bl.0 Request processed in 76us (425us total) trans 4295107576 rc 0/0 00000100:00100000:0.0:1713481296.738449:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125674 00000100:00100000:2.0:1713481296.738454:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820263 00000100:00100000:2.0:1713481296.738458:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20832:1959:x1796714882467584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.738465:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125675 00010000:00010000:2.0:1713481296.738465:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.738469:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2372:18874:x1796714882468544:12345-192.168.202.24@tcp:35:mrename.0 00010000:00010000:2.0:1713481296.738469:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0d80/0xdfc0fb1488022a4 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962992 expref: 20832 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738471:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784496448:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.738476:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0d80/0xdfc0fb1488022a4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962992 expref: 20832 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.738489:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.738490:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738493:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086afc900/0xdfc0fb148a3a607 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4948a expref: 16865 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738493:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738499:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738500:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086afc900, rc 0) 00010000:00010000:2.0:1713481296.738511:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.738514:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16865:8499:x1796714882466624:12345-192.168.202.24@tcp:101:dd.0 Request processed in 2122us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.738521:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563034 00000100:00100000:2.0:1713481296.738523:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20832:1959:x1796714882467584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.738526:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2373:18874:x1796714882468544:12345-192.168.202.24@tcp:35:mrename.0 Request processed in 55us (419us total) trans 4295107577 rc 0/0 00000100:00100000:2.0:1713481296.738528:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820263 00000100:00100000:0.0:1713481296.738531:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125675 00000100:00100000:1.0:1713481296.738535:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468608 00000100:00100000:1.0:1713481296.738537:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468608 00000100:00100000:2.0:1713481296.738544:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820264 00000100:00100000:1.0:1713481296.738547:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468736 00000100:00100000:0.0:1713481296.738548:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784496896 00000100:00100000:1.0:1713481296.738548:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468736 00000100:00100000:2.0:1713481296.738548:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20831:1959:x1796714882467648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.738550:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784496896 00010000:00010000:2.0:1713481296.738554:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.738555:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468992 00000100:00100000:1.0:1713481296.738556:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468992 00010000:00010000:2.0:1713481296.738558:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f394d80/0xdfc0fb1488022ab lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629a0 expref: 20831 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.738561:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469056 00000100:00100000:0.0:1713481296.738562:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469056 00000100:00100000:1.0:1713481296.738563:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469184 00000100:00100000:1.0:1713481296.738564:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469184 00010000:00010000:2.0:1713481296.738565:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f394d80/0xdfc0fb1488022ab lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629a0 expref: 20832 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.738565:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+135:3492:x1796714784494592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5314us (5344us total) trans 4296040797 rc 0/0 00000100:00100000:0.0:1713481296.738570:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469248 00000100:00100000:0.0:1713481296.738572:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469248 00000100:00100000:3.0:1713481296.738572:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563022 00000100:00100000:1.0:1713481296.738573:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469312 00000100:00100000:1.0:1713481296.738575:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469312 00000100:00100000:0.0:1713481296.738583:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563040 00010000:00010000:2.0:1713481296.738583:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.738584:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.738587:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16866:18836:x1796714882468288:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.738587:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.738590:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563041 00000100:00100000:1.0:1713481296.738594:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2740:3491:x1796714784496768:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.738594:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.738595:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.738595:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563042 00000100:00100000:3.0:1713481296.738600:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:11388:x1796714882468608:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.738605:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091dbaf40/0xdfc0fb148a3a662 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494b4 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738605:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1713481296.738606:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43294 count 1 00010000:00010000:3.0:1713481296.738609:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.738617:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738618:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20833:1959:x1796714882467648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (615us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.738619:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a670 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494bb expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.738621:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012251b600/0xdfc0fb14891e762 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb524 expref: 20833 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738624:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820264 00010000:00010000:0.0:1713481296.738627:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.738627:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148688d6a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aae expref: 26921 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.738628:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.738632:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dbaf40/0xdfc0fb148a3a662 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494b4 expref: 16867 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738633:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738634:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.738635:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e347840/0xdfc0fb148942404 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03aa expref: 24481 pid: 16531 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.738637:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738642:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98352 00010000:00010000:3.0:1713481296.738642:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.738644:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.738646:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:1958:x1796714882468416:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:3.0:1713481296.738647:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a670 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494bb expref: 26921 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.738649:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012251b600/0xdfc0fb14891e762 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb524 expref: 20832 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738653:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148688d6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aae expref: 26921 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.738653:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.738659:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148688d6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aae expref: 26921 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.738675:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012251b600/0xdfc0fb14891e762 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb524 expref: 20832 pid: 16515 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.738680:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086964e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784497088:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.738680:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e347840/0xdfc0fb148942404 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03aa expref: 24481 pid: 16531 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.738681:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6640/0xdfc0fb148a3a37c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa493b1 expref: 2797 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738686:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784497024:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.738690:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e347840/0xdfc0fb148942404 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03aa expref: 24481 pid: 16531 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738692:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092a4fe40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.738696:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff880091605b00) 00000100:00100000:0.0:1713481296.738699:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007aba30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.738701:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784497152:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.738706:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563043 00010000:00010000:2.0:1713481296.738708:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.738709:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:15045:x1796714882468736:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.738713:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563044 00010000:00010000:1.0:1713481296.738714:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.738716:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2740:3493:x1796714784496896:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.738719:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88c00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.738722:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801206ce400/0xdfc0fb148a3a677 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494c9 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738725:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:1958:x1796714882468416:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 77us (609us total) trans 0 rc 0/0 00002000:00080000:0.0:1713481296.738726:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43296 count 1 00000100:00100000:2.0:1713481296.738731:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98352 00002000:00010000:1.0:1713481296.738732:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.738733:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738740:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.738741:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801241946c0/0xdfc0fb148688d78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aca expref: 26921 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.738742:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.738744:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.738745:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738745:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801206ce400/0xdfc0fb148a3a677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494c9 expref: 24482 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.738747:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738748:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008324fa80/0xdfc0fb14880229d lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962984 expref: 20832 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.738750:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820265 00010000:00010000:1.0:1713481296.738755:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801206ce400/0xdfc0fb148a3a677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494c9 expref: 24482 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738755:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1959:x1796714882467776:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.738757:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801241946c0/0xdfc0fb148688d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aca expref: 26921 pid: 15558 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.738760:0:16460:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16460:1796714784494912:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.738762:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801241946c0/0xdfc0fb148688d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aca expref: 26921 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.738762:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.738763:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801206ce400, rc 0) 00010000:00010000:2.0:1713481296.738766:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa640/0xdfc0fb148688d55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a84 expref: 26921 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.738772:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784497216:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.738774:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa640/0xdfc0fb148688d55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a84 expref: 26921 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738776:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:15045:x1796714882468736:12345-192.168.202.24@tcp:101:dd.0 Request processed in 66us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.738780:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.738782:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563043 00010000:00010000:3.0:1713481296.738787:0:16460:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738791:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.738792:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.738795:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738795:0:16460:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738799:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784496320:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.738801:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563045 00010000:00010000:2.0:1713481296.738801:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738801:0:16460:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.738804:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007852d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:18844:x1796714882468992:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.738808:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.738809:0:16460:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.738812:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.738813:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.738815:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801206cf180/0xdfc0fb148a3a685 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494d7 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.738816:0:16460:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738819:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1957:x1796714882466496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2578us (2726us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.738822:0:16460:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738823:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820251 00002000:00010000:1.0:1713481296.738823:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.738826:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26921:1959:x1796714882467776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (801us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.738827:0:16460:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fdfe400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.738829:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738830:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.738830:0:16460:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738832:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801206cf180/0xdfc0fb148a3a685 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494d7 expref: 16868 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.738832:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820265 00010000:00010000:3.0:1713481296.738837:0:16460:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738838:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801206cf180/0xdfc0fb148a3a685 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494d7 expref: 16868 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.738840:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820266 00010000:00010000:1.0:1713481296.738842:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801206cf180, rc 0) 00000100:00100000:0.0:1713481296.738845:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20831:1959:x1796714882467968:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.738849:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820267 00010000:00010000:3.0:1713481296.738850:0:16460:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.738852:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.738852:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007852d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16868:18844:x1796714882468992:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 48us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.738854:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1959:x1796714882468160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.738855:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563045 00010000:00010000:3.0:1713481296.738857:0:16460:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fdfe400/0xdfc0fb148a3a590 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738860:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.738865:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563046 00010000:00010000:2.0:1713481296.738865:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ff9c6c0/0xdfc0fb148688d63 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aa0 expref: 26920 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738867:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007852e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20831:17924:x1796714882469056:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.738870:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.738872:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ff9c6c0/0xdfc0fb148688d63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aa0 expref: 26920 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.738875:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801206cf3c0/0xdfc0fb148a3a68c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494de expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738884:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081e53180/0xdfc0fb148a15fcc lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3981a expref: 20832 pid: 16517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.738885:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738887:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.738887:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738888:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738890:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801206cf3c0/0xdfc0fb148a3a68c lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494de expref: 20832 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738890:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738897:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738900:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081e53180/0xdfc0fb148a15fcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3981a expref: 20832 pid: 16517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.738905:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081e53180/0xdfc0fb148a15fcc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3981a expref: 20832 pid: 16517 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.738909:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.738914:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086965f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784497280:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.738922:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1959:x1796714882468160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.738927:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820267 00000100:00100000:1.0:1713481296.738928:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084b34d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.738939:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a655d40/0xdfc0fb1488022b2 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ae expref: 20832 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.738943:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820268 00000100:00100000:2.0:1713481296.738947:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20832:1958:x1796714882468032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.738948:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a655d40/0xdfc0fb1488022b2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ae expref: 20832 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.738953:0:6936:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6936:1796714784495680:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.738954:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.738958:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0240/0xdfc0fb1488022b9 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629bc expref: 20832 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.738963:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.738965:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.738967:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738967:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0240/0xdfc0fb1488022b9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629bc expref: 20832 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.738973:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738979:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.738980:0:6936:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 34 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738980:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.738982:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+135:3492:x1796714784494656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5621us (5694us total) trans 4296040798 rc 0/0 00010000:00010000:2.0:1713481296.738983:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738985:0:6936:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:1.0:1713481296.738986:0:6936:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.738989:0:6936:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 34 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.738989:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563023 00010000:00010000:0.0:1713481296.738991:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.738993:0:6936:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 34 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.738994:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.738997:0:6936:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086aff3c0, rc 0) 00010000:00010000:2.0:1713481296.739005:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.739006:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20832:1959:x1796714882467968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 159us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.739013:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820266 00000100:00100000:3.0:1713481296.739013:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563047 00000100:00100000:2.0:1713481296.739017:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20832:1958:x1796714882468032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.739018:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26919:17935:x1796714882469184:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.739019:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+34:15514:x1796714784495424:12345-0@lo:101:mdt_io00_009.0 Request processed in 4863us (4929us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.739023:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82893 00000100:00100000:2.0:1713481296.739023:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820268 00010000:00010000:3.0:1713481296.739027:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.739033:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820269 00000100:00100000:2.0:1713481296.739037:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820270 00000100:00100000:0.0:1713481296.739038:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4018450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1958:x1796714882468224:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.739038:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012052c240/0xdfc0fb148a3a693 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494e5 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.739041:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2017:1958:x1796714882467712:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.739045:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.739046:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784496384:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.739048:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.739050:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f397cc0/0xdfc0fb1488022c0 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ca expref: 20830 pid: 16538 timeout: 815 lvb_type: 1 00002000:00010000:3.0:1713481296.739051:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb791:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.739052:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2017 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.739057:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.739058:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f397cc0/0xdfc0fb1488022c0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ca expref: 20830 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.739060:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2017 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.739061:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.739063:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.739065:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1957:x1796714882466112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2794us (2928us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.739068:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012052c240/0xdfc0fb148a3a693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494e5 expref: 26920 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.739069:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820252 00010000:00010000:2.0:1713481296.739072:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2e0d80/0xdfc0fb148a37a5c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47932 expref: 2017 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.739074:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.739075:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.739078:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739078:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012052c240/0xdfc0fb148a3a693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494e5 expref: 26920 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.739081:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820271 00000100:00100000:1.0:1713481296.739084:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:1958:x1796714882468096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.739085:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739086:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012052c240, rc 0) 00010000:00010000:2.0:1713481296.739087:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:1.0:1713481296.739089:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.739092:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007952dd40/0xdfc0fb148688d5c lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a92 expref: 26920 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.739092:0:15550:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 33 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.739097:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.739098:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007952dd40/0xdfc0fb148688d5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a92 expref: 26920 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.739099:0:15550:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 33 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.739103:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26920:17935:x1796714882469184:12345-192.168.202.24@tcp:101:dd.0 Request processed in 84us (720us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.739108:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.739109:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.739109:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.739109:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563047 00010000:00010000:1.0:1713481296.739111:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739112:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4018450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1958:x1796714882468224:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (1055us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.739115:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739135:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820269 00000100:00100000:2.0:1713481296.739139:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2016:1958:x1796714882467712:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (1070us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.739140:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.739145:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820270 00000100:00100000:1.0:1713481296.739148:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26919:1958:x1796714882468096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.739154:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820271 00000100:00100000:3.0:1713481296.739155:0:16460:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563048 00000100:00100000:3.0:1713481296.739160:0:16460:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20829:18792:x1796714882469248:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.739162:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820272 00000100:00100000:1.0:1713481296.739166:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98353 00000100:00100000:2.0:1713481296.739167:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086966a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:1957:x1796714882469120:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.739169:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:1958:x1796714882468352:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:3.0:1713481296.739169:0:16460:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.739173:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.739175:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.739179:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb1488e7e4c lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54f4 expref: 16867 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.739180:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134e92880/0xdfc0fb148a37014 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47596 expref: 2795 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739181:0:16460:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012052d440/0xdfc0fb148a3a69a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc511:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494ec expref: -99 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739187:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb1488e7e4c lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54f4 expref: 16867 pid: 16467 timeout: 815 lvb_type: 1 00002000:00010000:3.0:1713481296.739192:0:16460:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc511:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.739195:0:14813:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880083719d00) 00010000:00010000:2.0:1713481296.739201:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb1488e7e4c lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54f4 expref: 16867 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.739202:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.739203:0:16460:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.739208:0:16460:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012052d440/0xdfc0fb148a3a69a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494ec expref: 20830 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739210:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.739212:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.739213:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.739216:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086afc900/0xdfc0fb148a3a607 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4948a expref: 16866 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739217:0:16460:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012052d440/0xdfc0fb148a3a69a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc511:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494ec expref: 20830 pid: 16460 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.739222:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:1958:x1796714882468352:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 51us (1082us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.739223:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086afc900/0xdfc0fb148a3a607 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4948a expref: 16866 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739224:0:16460:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012052d440, rc 0) 00000100:00100000:1.0:1713481296.739228:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98353 00010000:00010000:2.0:1713481296.739240:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880086afc900/0xdfc0fb148a3a607 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4948a expref: 16866 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.739240:0:16460:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:18792:x1796714882469248:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 79us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.739247:0:16460:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563048 00000100:00100000:2.0:1713481296.739249:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784497344:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.739254:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563049 00010000:00010000:1.0:1713481296.739255:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739259:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16866:17009:x1796714882469312:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.739260:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739264:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.739266:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964180 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.739267:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.739268:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739272:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739275:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cce2400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.739277:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc4480/0xdfc0fb148a3a6a1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494f3 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739277:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739282:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.739289:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.739289:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0d80/0xdfc0fb1488022a4 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962992 expref: 20829 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.739291:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739294:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cce2400/0xdfc0fb148a3a597 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.739298:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.739299:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.739300:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784495040:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.739303:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc4480/0xdfc0fb148a3a6a1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494f3 expref: 16867 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.739307:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784496640:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.739313:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086bc4480/0xdfc0fb148a3a6a1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494f3 expref: 16867 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.739320:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086bc4480, rc 0) 00010000:00010000:2.0:1713481296.739325:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008af8e880/0xdfc0fb148a3a646 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494ad expref: 16867 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739331:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739332:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:17009:x1796714882469312:12345-192.168.202.24@tcp:101:dd.0 Request processed in 73us (890us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.739334:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008af8e880, rc 0) 00000100:00100000:0.0:1713481296.739337:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563049 00010000:00010000:3.0:1713481296.739339:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.739343:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dcdb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784495424:0@lo:101:mdt_io00_009.0 00010000:00010000:3.0:1713481296.739345:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.739347:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:11552:x1796714882467200:12345-192.168.202.24@tcp:101:dd.0 Request processed in 2336us (2379us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.739351:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.739352:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563038 00010000:00010000:3.0:1713481296.739353:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.739356:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739360:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739366:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739372:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073542d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.739375:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.739378:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099844e00/2, rc 0, transno 1073502 00010000:00010000:3.0:1713481296.739382:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739384:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494656:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.739384:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800803806c0/0xdfc0fb14893ab7c lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3e7 expref: 26918 pid: 15499 timeout: 815 lvb_type: 1 00000004:00080000:0.0:1713481296.739392:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099844000/2, rc 0, transno 1073501 00000100:00100000:2.0:1713481296.739394:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784493504:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.739395:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494592:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.739397:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739404:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800916d1200/0xdfc0fb14891d429 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6e5 expref: 24479 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.739408:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073542d00/0xdfc0fb148a3a59e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.739415:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784493632:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.739427:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784497408:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.739441:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084b96640/0xdfc0fb148a3a504 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4944b expref: 24478 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739448:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.739449:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b96640, rc 0) 00000100:00100000:2.0:1713481296.739464:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a11ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:10409:x1796714882464704:12345-192.168.202.24@tcp:101:dd.0 Request processed in 7867us (8348us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.739470:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563012 00000100:00100000:0.0:1713481296.739482:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784497472:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.739486:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784497408 00000100:00100000:2.0:1713481296.739489:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784497408 00000100:00100000:0.0:1713481296.739500:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.739505:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784497472 00000100:00100000:2.0:1713481296.739507:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784497472 00000100:00100000:2.0:1713481296.739519:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563050 00000004:00080000:0.0:1713481296.739524:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a49880/2, rc 0, transno 993384 00000100:00100000:2.0:1713481296.739524:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+137:3493:x1796714784497408:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.739531:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784493888:0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.739535:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9951 count 1 00010000:00010000:2.0:1713481296.739545:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.739547:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+137:3491:x1796714784494848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6068us (6116us total) trans 4296040799 rc 0/0 00000100:00100000:0.0:1713481296.739553:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563051 00010000:00010000:2.0:1713481296.739556:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a6573c0/0xdfc0fb1488022c7 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629d8 expref: 20828 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.739558:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+137:3490:x1796714784497472:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.739559:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563025 00010000:00010000:2.0:1713481296.739562:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.739563:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.739566:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.739570:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9952 count 1 00010000:00010000:0.0:1713481296.739581:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739581:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a6573c0/0xdfc0fb1488022c7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629d8 expref: 20828 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.739589:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a6573c0/0xdfc0fb1488022c7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629d8 expref: 20828 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.739592:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083ba5d40/0xdfc0fb1488022ce lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629e6 expref: 20828 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.739598:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.739599:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.739599:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784497536:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.739599:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f394d80/0xdfc0fb1488022ab lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629a0 expref: 20828 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.739602:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.739613:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784495360:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.739616:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.739617:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083ba5d40/0xdfc0fb1488022ce lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629e6 expref: 20827 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.739625:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083ba5d40/0xdfc0fb1488022ce lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629e6 expref: 20827 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.739634:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784497600:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.739638:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739640:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a655d40/0xdfc0fb1488022b2 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ae expref: 20827 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.739645:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739647:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c88c840 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.739652:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.739655:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784495744:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.739660:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739681:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739686:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739692:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784497664:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.739693:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739695:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739699:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073540900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.739701:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739702:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739708:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739708:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739709:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.739714:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739721:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739723:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739726:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009227a880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.739729:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739729:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073540900/0xdfc0fb148a3a5a5 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.739733:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120552680/2, rc 0, transno 1073503 00000100:00100000:0.0:1713481296.739737:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784494848:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.739740:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739749:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784497664 00000100:00100000:0.0:1713481296.739751:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784497664 00010000:00010000:2.0:1713481296.739755:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739761:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563052 00010000:00010000:2.0:1713481296.739762:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a5c1 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739764:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2741:3491:x1796714784497664:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.739771:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43297 count 1 00010000:00010000:0.0:1713481296.739779:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.739785:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124195d40/0xdfc0fb148688d7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ad8 expref: 26917 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.739789:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.739790:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.739791:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.739800:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124195d40/0xdfc0fb148688d7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ad8 expref: 26917 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.739805:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124195d40/0xdfc0fb148688d7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ad8 expref: 26917 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.739811:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784497728:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.739824:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090997d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.739862:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713481296.739869:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784497792:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.739869:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+138:3491:x1796714784495232:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5881us (5919us total) trans 4296040800 rc 0/0 00000100:00100000:3.0:1713481296.739875:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563026 00000100:00100000:0.0:1713481296.739890:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.739897:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784497792 00000100:00100000:3.0:1713481296.739901:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784497792 00000100:00100000:2.0:1713481296.739907:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+138:3493:x1796714784495616:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5590us (5631us total) trans 4296040801 rc 0/0 00000100:00100000:2.0:1713481296.739914:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563028 00000004:00080000:0.0:1713481296.739918:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c70e00/2, rc 0, transno 1073505 00000100:00100000:3.0:1713481296.739919:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563053 00000100:00100000:3.0:1713481296.739923:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+138:3493:x1796714784497792:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.739924:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784495616:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.739936:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9953 count 1 00010000:00010000:2.0:1713481296.739947:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa640/0xdfc0fb148688d55 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a84 expref: 26917 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.739948:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739955:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.739961:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784497856:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.739961:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e405880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784495488:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.739963:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a656f40/0xdfc0fb1488022d5 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629f4 expref: 20826 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.739969:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.739971:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.739973:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.739980:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.739980:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.739988:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739989:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a656f40/0xdfc0fb1488022d5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629f4 expref: 20826 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.739994:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.739998:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a656f40/0xdfc0fb1488022d5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629f4 expref: 20826 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.740005:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784497856 00010000:00010000:2.0:1713481296.740006:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.740008:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784497920:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.740009:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784497856 00010000:00010000:2.0:1713481296.740012:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740018:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740023:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092279d40 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.740025:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880088150900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.740026:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563054 00010000:00010000:2.0:1713481296.740026:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.740030:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+138:3492:x1796714784497856:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.740032:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.740040:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9954 count 1 00010000:00010000:2.0:1713481296.740045:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740049:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.740050:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468672 00010000:00010000:2.0:1713481296.740052:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092279d40/0xdfc0fb148a3a5ba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa91b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.740053:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468672 00010000:00010000:0.0:1713481296.740058:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f396f40/0xdfc0fb1488022dc lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a02 expref: 20826 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.740063:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.740065:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.740067:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.740069:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468800 00000100:00100000:3.0:1713481296.740072:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468800 00010000:00010000:0.0:1713481296.740081:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f396f40/0xdfc0fb1488022dc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a02 expref: 20826 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.740083:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882468928 00000100:00100000:3.0:1713481296.740085:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882468928 00010000:00010000:0.0:1713481296.740090:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f396f40/0xdfc0fb1488022dc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a02 expref: 20826 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.740099:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485806 00000100:00100000:0.0:1713481296.740100:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077152a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784497984:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.740105:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2193:18893:x1796714882468672:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.740112:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.740116:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.740142:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a6cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x38b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494c2 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.740169:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092915180/2, rc 0, transno 1073504 00010000:00010000:3.0:1713481296.740170:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x38b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494c2 expref: 2194 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.740176:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784495232:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.740180:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6e6ac0/0xdfc0fb148a3a6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x38b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494c2 expref: 2194 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740192:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b5:0x0].0x0 (ffff880096325c00) 00010000:00010000:3.0:1713481296.740194:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713481296.740197:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a6e6ac0, rc 0) 00000100:00100000:2.0:1713481296.740208:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2742:3492:x1796714784495296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6045us (6166us total) trans 4295960681 rc 0/0 00000100:00100000:3.0:1713481296.740212:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2194:18893:x1796714882468672:12345-192.168.202.24@tcp:101:touch.0 Request processed in 107us (1991us total) trans 0 rc 0/0 00000004:00080000:0.0:1713481296.740215:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092915500/2, rc 0, transno 993385 00000100:00100000:2.0:1713481296.740216:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563027 00000100:00100000:3.0:1713481296.740219:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485806 00000100:00100000:0.0:1713481296.740221:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784495296:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.740237:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485807 00000100:00100000:3.0:1713481296.740242:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2017:18919:x1796714882468800:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:0.0:1713481296.740244:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784498048:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.740249:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.740251:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc89500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784496512:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.740256:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013449d8c0/0xdfc0fb148a3a6d2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494d0 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.740263:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.740267:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.740282:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.740284:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26916:1957:x1796714882466432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3905us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.740287:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784498112:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.740290:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820254 00000100:00100000:0.0:1713481296.740303:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.740316:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498048 00010000:00010000:3.0:1713481296.740316:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.740319:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498048 00010000:00010000:3.0:1713481296.740325:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.740332:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.740335:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498112 00000100:00100000:2.0:1713481296.740337:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498112 00000100:00100000:0.0:1713481296.740338:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563055 00010000:00010000:3.0:1713481296.740342:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.740343:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+139:3490:x1796714784498048:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.740348:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.740349:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563056 00000100:00100000:2.0:1713481296.740353:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+2742:3490:x1796714784498112:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.740354:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00002000:00080000:0.0:1713481296.740355:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9955 count 1 00002000:00080000:2.0:1713481296.740363:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43298 count 1 00010000:00010000:0.0:1713481296.740365:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740373:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740375:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083ba4fc0/0xdfc0fb1488022e3 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a10 expref: 20826 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.740380:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.740382:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.740383:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124197180/0xdfc0fb148688d86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ae6 expref: 26915 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.740384:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740389:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.740390:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.740393:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740393:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c43180/0xdfc0fb148a3a6f5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.740400:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078c43180/0xdfc0fb148a3a6f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.740403:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083ba4fc0/0xdfc0fb1488022e3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a10 expref: 20826 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.740405:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078c43180/0xdfc0fb148a3a6f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.740407:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124197180/0xdfc0fb148688d86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ae6 expref: 26915 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.740411:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083ba4fc0/0xdfc0fb1488022e3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a10 expref: 20826 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.740416:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124197180/0xdfc0fb148688d86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ae6 expref: 26915 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.740418:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d254700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784498176:192.168.202.24@tcp:104: 00000004:00200000:3.0:1713481296.740425:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c6f:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.740428:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713481296.740430:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.740430:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784498240:192.168.202.24@tcp:104: 00000004:00010000:3.0:1713481296.740437:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880078c43180/0xdfc0fb148a3a6f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.740445:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.740446:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800979649c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.740450:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.740455:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.740461:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.740465:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078c41440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.740468:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.740470:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.740471:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007952dd40/0xdfc0fb148688d5c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a92 expref: 26915 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.740473:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.740481:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2371:18729:x1796714882466560:12345-192.168.202.24@tcp:37:rm.0 Request processed in 3658us (4285us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.740481:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.740483:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.740485:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784496000:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.740485:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.740486:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125673 00010000:00010000:3.0:1713481296.740490:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078c41440/0xdfc0fb148a3a6d9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.740492:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.740500:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.740502:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.740503:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.740506:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740509:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.740512:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740514:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.740515:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469376 00000100:00100000:0.0:1713481296.740517:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469376 00010000:00010000:2.0:1713481296.740519:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740519:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078c40b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.740522:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.740525:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740526:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.740527:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469440 00000100:00100000:0.0:1713481296.740528:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469440 00000100:00100000:1.0:1713481296.740531:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469632 00010000:00010000:2.0:1713481296.740531:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740532:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88009c9ead00) 00000100:00100000:1.0:1713481296.740534:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469632 00010000:00010000:3.0:1713481296.740534:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.740535:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563057 00010000:00010000:2.0:1713481296.740537:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009227a1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.740537:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.740538:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20827:10479:x1796714882469376:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.740541:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740542:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.740542:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078c40b40/0xdfc0fb148a3a6e0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.740547:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740549:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097631440/0xdfc0fb148a3a6fc lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa494fa expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.740554:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485808 00010000:00010000:0.0:1713481296.740559:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e66640/0xdfc0fb148916d91 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6568 expref: 20828 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.740559:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007852fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2018:18905:x1796714882468928:12345-192.168.202.24@tcp:36:mkdir.0 00010000:00010000:2.0:1713481296.740559:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740563:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.740565:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.740565:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a5cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa91c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740566:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097631440/0xdfc0fb148a3a6fc lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494fa expref: 20828 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740576:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e66640/0xdfc0fb148916d91 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6568 expref: 20828 pid: 15547 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.740578:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.740579:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013449d8c0/0xdfc0fb148a3a6d2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494d0 expref: 2019 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740581:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e66640/0xdfc0fb148916d91 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6568 expref: 20828 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.740587:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784498304:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.740589:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124abcb40/0xdfc0fb148a3a5f9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49475 expref: 2018 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.740596:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880078c43180/0xdfc0fb148a3a6f5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494d0 expref: 2018 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.740597:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.740602:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff88009c9ea400) 00010000:00010000:1.0:1713481296.740604:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff880136196c00) 00010000:00010000:3.0:1713481296.740604:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.740606:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880078c43180, rc 0) 00010000:00010000:1.0:1713481296.740610:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.740615:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485809 00000100:00100000:0.0:1713481296.740618:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2194:18904:x1796714882469632:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:3.0:1713481296.740623:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2017:18919:x1796714882468800:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 380us (2381us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.740626:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.740630:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:3.0:1713481296.740630:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485807 00010000:00010000:0.0:1713481296.740632:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097633840/0xdfc0fb148a3a70a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49508 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.740635:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740639:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740646:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ced00/0xdfc0fb148a3a711 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c39:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.740649:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ced00/0xdfc0fb148a3a711 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740652:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ced00/0xdfc0fb148a3a711 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.740690:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740696:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740700:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.740704:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2743:3490:x1796714784495872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5921us (5962us total) trans 4295960682 rc 0/0 00010000:00010000:0.0:1713481296.740708:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.740710:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563030 00010000:00010000:0.0:1713481296.740714:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740717:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.740728:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563058 00000100:00100000:2.0:1713481296.740732:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009421ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16866:18817:x1796714882469440:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.740738:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.740747:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800821a5f80/0xdfc0fb148a3a726 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49501 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713481296.740751:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51a8:0x0]: returning size 4096 00010000:00010000:2.0:1713481296.740762:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083549d40/0xdfc0fb1489cf832 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22193 expref: 20828 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740767:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.740768:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.740771:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800821a5f80/0xdfc0fb148a3a726 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49501 expref: 16867 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740775:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740778:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740781:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740784:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.740785:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083549d40/0xdfc0fb1489cf832 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22193 expref: 20828 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740787:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800976318c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.740788:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740791:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.740792:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083549d40/0xdfc0fb1489cf832 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22193 expref: 20828 pid: 16481 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.740796:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:0.0:1713481296.740797:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.740799:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.740801:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784498368:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.740802:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800976318c0/0xdfc0fb148a3a718 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740815:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.740816:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081d24b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.740818:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740821:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740824:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a26d7600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.740825:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740828:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740831:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff88007ab6ad00) 00010000:00010000:0.0:1713481296.740832:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.740833:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.740836:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a71f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.740849:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f397cc0/0xdfc0fb1488022c0 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629ca expref: 20828 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.740861:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784496256:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.740865:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097633840/0xdfc0fb148a3a70a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49508 expref: 2196 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740869:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097633840/0xdfc0fb148a3a70a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49508 expref: 2196 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740875:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740881:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.740882:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097633840, rc 0) 00010000:00010000:2.0:1713481296.740887:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.740893:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2195:18904:x1796714882469632:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 274us (424us total) trans 4295105910 rc 301/301 00010000:00010000:2.0:1713481296.740894:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.740897:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485809 00010000:00010000:2.0:1713481296.740905:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740911:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.740916:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009227ba80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.740918:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ce880/0xdfc0fb148a3a734 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.740919:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.740925:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ce880/0xdfc0fb148a3a734 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.740925:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.740926:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083b84380/2, rc 0, transno 993386 00000100:00100000:0.0:1713481296.740930:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784495872:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.740932:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ce880/0xdfc0fb148a3a734 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.740937:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.740942:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007852fb80 reply state ffff880120f35000 transno 4295107578 ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ce880/0xdfc0fb148a3a734 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.740943:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009227ba80/0xdfc0fb148a3a5dd lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.740949:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ce880/0xdfc0fb148a3a734 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.740951:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713481296.740955:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cba:0x0].0x0 (ffff88009c144600) 00000100:00100000:0.0:1713481296.740957:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784498432:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.740957:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.740959:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1713481296.740961:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cba:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.740966:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740970:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740973:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740975:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.740976:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.740978:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206cef40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.740980:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740983:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740987:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff880134408300) 00010000:00010000:1.0:1713481296.740988:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.740989:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.740992:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801206cef40/0xdfc0fb148a3a703 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.741002:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498432 00000100:00100000:0.0:1713481296.741005:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498432 00000004:00010000:1.0:1713481296.741011:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007852fb80 reply state ffff880120f35000 transno 4295107578 ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ced00/0xdfc0fb148a3a711 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.741018:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801206ced00/0xdfc0fb148a3a711 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.741021:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563059 00010000:00010000:1.0:1713481296.741022:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x35 (ffff88009c144f00) 00010000:00010000:1.0:1713481296.741023:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.741024:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1713481296.741025:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009421b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2743:3493:x1796714784498432:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.741036:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43299 count 1 00000100:00100000:1.0:1713481296.741044:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007852fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2018:18905:x1796714882468928:12345-192.168.202.24@tcp:36:mkdir.0 Request processed in 485us (2794us total) trans 4295107578 rc 0/0 00010000:00010000:0.0:1713481296.741045:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.741048:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485808 00010000:00010000:0.0:1713481296.741056:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124195b00/0xdfc0fb148688d8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2af4 expref: 26914 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.741059:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+140:3492:x1796714784496128:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5764us (5882us total) trans 4296040802 rc 0/0 00010000:00010000:0.0:1713481296.741062:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.741063:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.741066:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.741066:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563032 00010000:00010000:1.0:1713481296.741081:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0d0240/0xdfc0fb1488022b9 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629bc expref: 20827 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.741082:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124195b00/0xdfc0fb148688d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2af4 expref: 26914 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.741089:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784495936:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.741091:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124195b00/0xdfc0fb148688d8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2af4 expref: 26914 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.741101:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784498496:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.741103:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784496576:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.741105:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741105:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148688d47 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa919:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2a61 expref: 26914 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.741112:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.741115:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e404e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784494336:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.741116:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801329bbd80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.741139:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.741143:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.741146:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741151:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741153:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741156:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.741159:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083b85500/2, rc 0, transno 1073506 00010000:00010000:2.0:1713481296.741160:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.741163:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1957:x1796714882466304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4798us (5004us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.741164:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741164:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.741165:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784496128:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.741167:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741170:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086afdd40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.741171:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.741171:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820253 00010000:00010000:1.0:1713481296.741172:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741174:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084b95200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.741176:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741176:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741180:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741185:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741189:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086afdd40/0xdfc0fb148a3a5c8 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741189:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.741191:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784498560:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.741196:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a57b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.741209:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.741232:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498560 00000100:00100000:0.0:1713481296.741234:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498560 00000100:00100000:0.0:1713481296.741250:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563060 00000100:00100000:0.0:1713481296.741254:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+141:3493:x1796714784498560:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.741263:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9956 count 1 00010000:00010000:0.0:1713481296.741272:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.741282:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a657a80/0xdfc0fb1488022ea lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a1e expref: 20826 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.741282:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+141:3490:x1796714784495808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6577us (6721us total) trans 4296040803 rc 0/0 00000100:00100000:1.0:1713481296.741287:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563029 00010000:00010000:0.0:1713481296.741288:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.741289:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.741292:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.741306:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007da25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2744:3492:x1796714784494144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8273us (8303us total) trans 4295960683 rc 0/0 00010000:00010000:0.0:1713481296.741307:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a657a80/0xdfc0fb1488022ea lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a1e expref: 20826 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.741312:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563020 00010000:00010000:1.0:1713481296.741317:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9c6c0/0xdfc0fb148688d63 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aa0 expref: 26913 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.741320:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a657a80/0xdfc0fb1488022ea lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a1e expref: 20826 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.741327:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784496192:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.741329:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784498624:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.741340:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.741345:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009693cd80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.741348:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741352:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.741354:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.741355:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741359:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741362:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.741363:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+141:3490:x1796714784494528:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7997us (8025us total) trans 4296040804 rc 0/0 00010000:00010000:1.0:1713481296.741365:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086aff840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.741367:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.741368:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563024 00000004:00080000:0.0:1713481296.741370:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007da26a00/2, rc 0, transno 993387 00010000:00010000:1.0:1713481296.741371:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.741375:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.741377:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007da26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784494144:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.741379:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741383:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a5d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa91d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.741388:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.741398:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469952 00000100:00100000:2.0:1713481296.741400:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469952 00000100:00100000:0.0:1713481296.741403:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.741409:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784498688:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.741416:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485810 00000100:00100000:2.0:1713481296.741421:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2018:18678:x1796714882469952:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:0.0:1713481296.741428:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.741438:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713481296.741446:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800735406c0/0xdfc0fb148a3a63f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4947c expref: 2018 pid: 15484 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.741463:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083b84a80/2, rc 0, transno 1073507 00010000:00010000:2.0:1713481296.741464:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008af54900/0xdfc0fb148a3049e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2ca6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa43371 expref: 2017 pid: 6932 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.741470:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784495808:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.741476:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2744:3493:x1796714784496064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6203us (6509us total) trans 4295960684 rc 0/0 00010000:00010000:2.0:1713481296.741478:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca6:0x0].0x0 (ffff88009a48ae00) 00000004:00080000:0.0:1713481296.741480:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099847480/2, rc 0, transno 1073508 00000100:00100000:1.0:1713481296.741480:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563031 00000100:00100000:0.0:1713481296.741483:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784494528:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.741489:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.741493:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498688 00000100:00100000:1.0:1713481296.741495:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498688 00010000:00010000:2.0:1713481296.741498:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.741503:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.741505:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563061 00010000:00010000:2.0:1713481296.741507:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.741508:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009421a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2744:3491:x1796714784498688:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.741513:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85b840/0xdfc0fb148a3a750 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1cd:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00002000:00080000:1.0:1713481296.741515:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43300 count 1 00010000:00010000:2.0:1713481296.741516:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85b840/0xdfc0fb148a3a750 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741520:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85b840/0xdfc0fb148a3a750 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.741522:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.741523:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083b87800/2, rc 0, transno 993388 00000100:00100000:0.0:1713481296.741528:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784496064:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.741529:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c66f600/0xdfc0fb148688d94 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b02 expref: 26912 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.741532:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713481296.741533:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.741534:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.741536:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.741538:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784498816:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.741543:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.741546:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c66f600/0xdfc0fb148688d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b02 expref: 26912 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.741547:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.741550:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c66f600/0xdfc0fb148688d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b02 expref: 26912 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.741550:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.741556:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.741556:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086965c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784498880:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.741568:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.741580:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498816 00000100:00100000:1.0:1713481296.741582:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498816 00000100:00100000:0.0:1713481296.741592:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.741592:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563062 00000100:00100000:1.0:1713481296.741594:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+141:3493:x1796714784498816:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.741598:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784498944:0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.741601:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9958 count 1 00010000:00010000:1.0:1713481296.741608:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.741614:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb1488022f8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a3a expref: 20826 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.741616:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.741618:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.741619:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.741620:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1713481296.741627:0:15479:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31884, 64 off2048768 00010000:00010000:1.0:1713481296.741629:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb1488022f8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a3a expref: 20826 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.741633:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb1488022f8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a3a expref: 20826 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.741633:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498944 00000100:00100000:0.0:1713481296.741635:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784498752:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.741636:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498944 00000100:00100000:1.0:1713481296.741639:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086966300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784499008:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.741648:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59900 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.741650:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713481296.741650:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563063 00000100:00100000:3.0:1713481296.741653:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2745:3492:x1796714784498944:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.741655:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741659:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.741661:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469760 00000100:00100000:1.0:1713481296.741662:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469760 00010000:00010000:2.0:1713481296.741662:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15479 initiator: MDT1 00002000:00080000:3.0:1713481296.741662:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43301 count 1 00000100:00100000:0.0:1713481296.741679:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.741683:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741687:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741689:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741690:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741692:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011f87df80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.741694:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125676 00010000:00010000:2.0:1713481296.741694:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741697:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741697:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9d8c0/0xdfc0fb148688d9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b10 expref: 26912 pid: 15558 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.741698:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2195:18578:x1796714882469760:12345-192.168.202.24@tcp:35:rm.0 00010000:00010000:2.0:1713481296.741701:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca6:0x0].0x0 (ffff8800907b5600) 00010000:00010000:3.0:1713481296.741702:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.741703:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.741703:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.741704:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 3/0,0 mode: --/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741705:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741707:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a76c lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2ca6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741717:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ff9d8c0/0xdfc0fb148688d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b10 expref: 26912 pid: 15558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.741722:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741722:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ff9d8c0/0xdfc0fb148688d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b10 expref: 26912 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.741725:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741728:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.741729:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784499072:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.741731:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f85a400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.741732:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.741734:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.741738:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741741:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca6:0x0].0x0 (ffff8800907b5600) 00010000:00010000:2.0:1713481296.741742:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1713481296.741742:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011dafccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.741743:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741746:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a75e lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2ca6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.741756:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469504 00000100:00100000:3.0:1713481296.741758:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469504 00000100:00100000:1.0:1713481296.741766:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2196:18578:x1796714882469760:12345-192.168.202.24@tcp:35:rm.0 Request processed in 66us (411us total) trans 4295105911 rc 0/0 00000100:00100000:1.0:1713481296.741772:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125676 00000100:00100000:3.0:1713481296.741772:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882469888 00000100:00100000:3.0:1713481296.741773:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882469888 00010000:00010000:3.0:1713481296.741779:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007df5b180/0xdfc0fb148959bfe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebbb expref: 16868 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.741792:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820273 00000100:00100000:3.0:1713481296.741795:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16868:1959:x1796714882469888:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.741801:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.741806:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.741808:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081566a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784496704:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.741810:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007df5b180/0xdfc0fb148959bfe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebbb expref: 16868 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.741816:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007df5b180/0xdfc0fb148959bfe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebbb expref: 16868 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.741820:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.741820:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741823:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741826:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.741829:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:1959:x1796714882467008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4441us (4582us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.741829:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741830:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007df5b180/0xdfc0fb148959bfe lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebbb expref: 16868 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.741831:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096ca7cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.741832:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:1.0:1713481296.741834:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820257 00010000:00010000:2.0:1713481296.741835:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741839:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x0 (ffff8801205cde00) 00010000:00010000:2.0:1713481296.741840:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.741841:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741841:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.741842:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.741845:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a749 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.741845:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008af8e880/0xdfc0fb148a3a646 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494ad expref: 16867 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.741850:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008af8e880/0xdfc0fb148a3a646 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494ad expref: 16867 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.741860:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008af8e880/0xdfc0fb148a3a646 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494ad expref: 16867 pid: 16532 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.741861:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007dc8a300 reply state ffff880098d94000 transno 4295107579 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85b840/0xdfc0fb148a3a750 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.741865:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85b840/0xdfc0fb148a3a750 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1cd:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.741865:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784499136:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.741868:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x3331 (ffff8801205cdf00) 00010000:00010000:2.0:1713481296.741870:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.741871:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713481296.741882:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011dafc300 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.741884:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98354 00000100:00100000:1.0:1713481296.741887:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2019:1957:x1796714882469504:12345-192.168.202.24@tcp:103:rm.0 00000100:00100000:2.0:1713481296.741890:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2019:18678:x1796714882469952:12345-192.168.202.24@tcp:36:rm.0 Request processed in 469us (502us total) trans 4295107579 rc 0/0 00010000:00010000:1.0:1713481296.741892:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.741893:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784498752 00000100:00100000:2.0:1713481296.741894:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485810 00000100:00100000:3.0:1713481296.741896:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784498752 00010000:00010000:1.0:1713481296.741900:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fb840/0xdfc0fb148a37515 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47772 expref: 2019 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.741904:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470016 00000100:00100000:3.0:1713481296.741906:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470016 00010000:00010000:1.0:1713481296.741914:0:9218:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88009de91e00) 00000100:00100000:3.0:1713481296.741915:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563064 00000100:00100000:3.0:1713481296.741918:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800842c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+142:3491:x1796714784498752:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.741921:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.741922:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563065 00000100:00100000:2.0:1713481296.741926:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20827:14753:x1796714882470016:12345-192.168.202.24@tcp:101:dd.0 00002000:00080000:3.0:1713481296.741926:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9957 count 1 00010000:00010000:2.0:1713481296.741931:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.741934:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.741935:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2017:1957:x1796714882469504:12345-192.168.202.24@tcp:103:rm.0 Request processed in 46us (559us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.741938:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f86e1c0/0xdfc0fb148a3a781 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4950f expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.741940:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98354 00010000:00010000:3.0:1713481296.741942:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083ba58c0/0xdfc0fb1488022f1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a2c expref: 20827 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.741946:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.741947:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.741948:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133a87840/0xdfc0fb148a13e5b lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fb6 expref: 20828 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.741948:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.741952:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.741953:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.741955:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f86e1c0/0xdfc0fb148a3a781 lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4950f expref: 20828 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.741957:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083ba58c0/0xdfc0fb1488022f1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a2c expref: 20828 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.741962:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083ba58c0/0xdfc0fb1488022f1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a2c expref: 20828 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.741968:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784499200:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.741969:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133a87840/0xdfc0fb148a13e5b lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fb6 expref: 20828 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.741976:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133a87840/0xdfc0fb148a13e5b lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fb6 expref: 20828 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.741981:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800985c7840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.741982:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15560:1796714784499264:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.741994:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096cab780 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.742795:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784496960:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.742819:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.742826:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086964e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784497088:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.742841:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.742862:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784497024:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.742877:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091dbaf40/0xdfc0fb148a3a662 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494b4 expref: 16867 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.742884:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dbaf40, rc 0) 00000100:00100000:0.0:1713481296.742906:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:18836:x1796714882468288:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4318us (4810us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.742910:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563040 00000100:00100000:2.0:1713481296.742966:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.742994:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470208 00000100:00100000:1.0:1713481296.742997:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470208 00000100:00100000:1.0:1713481296.743012:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26104 00000100:00100000:1.0:1713481296.743015:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2371:18874:x1796714882470208:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:3.0:1713481296.743018:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784497152:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.743028:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713481296.743037:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084abeac0/0xdfc0fb148a37cee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a4a expref: 2371 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.743042:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a670 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494bb expref: 26912 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.743052:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134f5e1c0, rc 0) 00010000:00010000:1.0:1713481296.743056:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a711f80/0xdfc0fb148a3714f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4760d expref: 2370 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.743070:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784497216:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.743070:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880096358c00) 00010000:00010000:1.0:1713481296.743078:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.743083:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:11388:x1796714882468608:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4482us (4872us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.743085:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.743090:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563042 00010000:00010000:1.0:1713481296.743095:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.743099:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.743103:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.743109:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086964e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784499328:0@lo:101:mdt_io00_014.0 00000100:00100000:2.0:1713481296.743110:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784497344:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.743143:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.743148:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.743156:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086965f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784497280:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.743158:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092a4fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.743164:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086966a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16866:1957:x1796714882469120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3997us (4848us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.743169:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820272 00000100:00100000:1.0:1713481296.743172:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784499328 00000100:00100000:1.0:1713481296.743174:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784499328 00000100:00100000:1.0:1713481296.743186:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82894 00000100:00100000:1.0:1713481296.743189:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784499328:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.743194:0:6936:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.743200:0:6936:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a788 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743208:0:6936:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 2/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.743212:0:6936:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 13 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743218:0:6936:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.743227:0:6936:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 13 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743231:0:6936:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88008fe2ab00) 00010000:00010000:1.0:1713481296.743232:0:6936:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.743234:0:6936:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 13 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743238:0:6936:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801206cd440, rc 0) 00000100:00100000:1.0:1713481296.743252:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:15793:x1796714784499328:12345-0@lo:101:mdt_io00_014.0 Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.743256:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82894 00000100:00100000:1.0:1713481296.743277:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086964e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784499328:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.743284:0:15793:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743288:0:15793:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.743321:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784497536:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.743322:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801206cf3c0/0xdfc0fb148a3a68c lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494de expref: 20828 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.743331:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801206cf3c0, rc 0) 00010000:00010000:2.0:1713481296.743336:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.743338:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.743352:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470656 00000100:00100000:3.0:1713481296.743355:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470656 00000100:00100000:3.0:1713481296.743374:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563066 00000100:00100000:3.0:1713481296.743379:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16866:17935:x1796714882470656:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.743386:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.743398:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095c91f80/0xdfc0fb148a3a796 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49516 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.743402:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007852e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20828:17924:x1796714882469056:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4531us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.743408:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563046 00002000:00010000:3.0:1713481296.743411:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.743420:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784497600:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.743420:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.743422:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.743426:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095c91f80/0xdfc0fb148a3a796 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49516 expref: 16867 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743436:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.743437:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095c91f80/0xdfc0fb148a3a796 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49516 expref: 16867 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.743445:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095c91f80, rc 0) 00000100:00100000:3.0:1713481296.743481:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:17935:x1796714882470656:12345-192.168.202.24@tcp:101:dd.0 Request processed in 101us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.743486:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.743488:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563066 00000100:00100000:1.0:1713481296.743503:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470720 00000100:00100000:1.0:1713481296.743506:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470720 00000100:00100000:1.0:1713481296.743535:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563067 00000100:00100000:1.0:1713481296.743541:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20828:18792:x1796714882470720:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.743544:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784497728:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.743548:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.743558:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801206cfa80/0xdfc0fb148a3a79d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc512:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4951d expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.743559:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.743568:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc512:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.743574:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.743576:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.743579:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801206cfa80/0xdfc0fb148a3a79d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4951d expref: 20829 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743585:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801206cfa80/0xdfc0fb148a3a79d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc512:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4951d expref: 20829 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.743590:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801206cfa80, rc 0) 00000100:00100000:1.0:1713481296.743615:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20829:18792:x1796714882470720:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.743619:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563067 00000100:00100000:3.0:1713481296.743643:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784497920:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.743661:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.745174:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.745191:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470912 00000100:00100000:1.0:1713481296.745194:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470912 00000100:00100000:1.0:1713481296.745221:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563068 00000100:00100000:1.0:1713481296.745226:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:17009:x1796714882470912:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.745233:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.745243:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a949680/0xdfc0fb148a3a7a4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49524 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.745252:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.745260:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.745261:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.745265:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a949680/0xdfc0fb148a3a7a4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49524 expref: 16868 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745273:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007a949680/0xdfc0fb148a3a7a4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49524 expref: 16868 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745280:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a949680, rc 0) 00000100:00100000:1.0:1713481296.745304:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16868:17009:x1796714882470912:12345-192.168.202.24@tcp:101:dd.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.745309:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563068 00000100:00100000:2.0:1713481296.745357:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.745389:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784498240:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.745407:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.745412:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086965c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784498880:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.745419:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d254700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784498176:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.745424:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472704 00010000:00010000:1.0:1713481296.745427:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.745427:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472704 00010000:00010000:0.0:1713481296.745433:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.745442:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485811 00000100:00100000:2.0:1713481296.745445:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2196:18904:x1796714882472704:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:1.0:1713481296.745448:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086966300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784499008:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.745455:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.745460:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745461:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86c480/0xdfc0fb148a3a7ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49555 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745505:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713481296.745505:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784499072:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.745508:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.745511:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.745515:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.745519:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471424 00000100:00100000:0.0:1713481296.745520:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009421b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784498496:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.745521:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471424 00010000:00010000:2.0:1713481296.745521:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.745525:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.745525:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745528:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.745533:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563069 00010000:00010000:0.0:1713481296.745535:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.745536:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:10409:x1796714882471424:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.745540:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.745546:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a948240/0xdfc0fb148a3a7c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4952b expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.745550:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784498624:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.745553:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784499136:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.745556:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206cc6c0/0xdfc0fb14891d158 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6ec expref: 24477 pid: 16533 timeout: 0 lvb_type: 1 00000004:00200000:2.0:1713481296.745557:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51a8:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.745561:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012050a1c0/0xdfc0fb14893ab21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3f5 expref: 26911 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.745562:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745565:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.745565:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.745567:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a948240/0xdfc0fb148a3a7c0 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4952b expref: 24477 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745569:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.745575:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077152a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784497984:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.745577:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012050a1c0/0xdfc0fb14893ab21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3f5 expref: 26911 pid: 16471 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.745581:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012050a1c0/0xdfc0fb14893ab21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3f5 expref: 26911 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.745582:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.745583:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745586:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.745588:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784499392:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.745589:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713481296.745590:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:1959:x1796714882469888:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3792us (3855us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.745592:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.745594:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f86d440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.745596:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713481296.745598:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820273 00010000:00010000:2.0:1713481296.745599:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.745604:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.745605:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801206cc6c0/0xdfc0fb14891d158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6ec expref: 24477 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.745605:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.745607:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.745610:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801206cc6c0/0xdfc0fb14891d158 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6ec expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.745610:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d440/0xdfc0fb148a3a7b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.745615:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784499456:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.745619:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.745622:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.745623:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59900 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.745625:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.745629:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009421bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784498304:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.745630:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f86d680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.745631:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.745634:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.745637:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3531 (ffff880097338100) 00010000:00010000:2.0:1713481296.745639:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.745640:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.745641:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097631440/0xdfc0fb148a3a6fc lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494fa expref: 20828 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745642:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d680/0xdfc0fb148a3a7b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.745648:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097631440, rc 0) 00000100:00100000:1.0:1713481296.745649:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.745660:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20828:10479:x1796714882469376:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5122us (5168us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.745660:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.745678:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563057 00000100:00100000:1.0:1713481296.745686:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471616 00010000:00010000:2.0:1713481296.745686:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86c480/0xdfc0fb148a3a7ab lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49555 expref: 2198 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.745687:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471808 00000100:00100000:1.0:1713481296.745688:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471616 00000100:00100000:3.0:1713481296.745690:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471808 00010000:00010000:2.0:1713481296.745691:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86c480/0xdfc0fb148a3a7ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49555 expref: 2198 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745701:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f86c480, rc 0) 00010000:00010000:1.0:1713481296.745702:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f396f40/0xdfc0fb1488022dc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a02 expref: 20829 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.745704:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e66640/0xdfc0fb148916d91 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6568 expref: 20829 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.745715:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820274 00000100:00100000:1.0:1713481296.745718:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20829:1958:x1796714882471616:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.745720:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820275 00010000:00010000:1.0:1713481296.745723:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.745724:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2197:18904:x1796714882472704:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 278us (371us total) trans 4295105912 rc 301/301 00000100:00100000:3.0:1713481296.745724:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20829:1958:x1796714882471808:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.745726:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.745726:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f396f40/0xdfc0fb1488022dc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a02 expref: 20829 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.745729:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485811 00010000:00010000:3.0:1713481296.745729:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.745733:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f396f40/0xdfc0fb1488022dc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a02 expref: 20829 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.745738:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e66640/0xdfc0fb148916d91 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6568 expref: 20829 pid: 15547 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.745745:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e66640/0xdfc0fb148916d91 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6568 expref: 20829 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.745747:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.745753:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f396f40/0xdfc0fb1488022dc lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a02 expref: 20829 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.745756:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471744 00000100:00100000:2.0:1713481296.745756:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784498368:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.745757:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e66640/0xdfc0fb148916d91 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6568 expref: 20829 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.745758:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471744 00010000:00010000:1.0:1713481296.745764:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.745765:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.745768:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.745770:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563070 00010000:00010000:2.0:1713481296.745771:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800821a5f80/0xdfc0fb148a3a726 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49501 expref: 16866 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745772:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.745773:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009421bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:1958:x1796714882471744:12345-192.168.202.24@tcp:2:touch.0 00010000:00010000:3.0:1713481296.745773:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.745775:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745776:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097631440/0xdfc0fb148a3a6fc lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494fa expref: 20827 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745782:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800821a5f80, rc 0) 00010000:00010000:3.0:1713481296.745782:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097631440/0xdfc0fb148a3a6fc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494fa expref: 20827 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745793:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.745793:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009421ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16866:18817:x1796714882469440:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 5061us (5290us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.745794:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097631440/0xdfc0fb148a3a6fc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494fa expref: 20827 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.745798:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563058 00000100:00100000:3.0:1713481296.745800:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784499520:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.745812:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20827:1958:x1796714882471616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.745816:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.745818:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820274 00000100:00100000:2.0:1713481296.745820:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471488 00000100:00100000:2.0:1713481296.745822:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471488 00010000:00010000:2.0:1713481296.745829:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c66f600/0xdfc0fb148688d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b02 expref: 26914 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.745835:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784499200:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.745847:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820276 00000100:00100000:0.0:1713481296.745850:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009421bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26914:1958:x1796714882471744:12345-192.168.202.24@tcp:2:touch.0 Request processed in 76us (102us total) trans 4295960685 rc 0/0 00000100:00100000:2.0:1713481296.745850:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26914:1958:x1796714882471488:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.745851:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.745854:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563070 00010000:00010000:2.0:1713481296.745855:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.745857:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c66f600/0xdfc0fb148688d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa924:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b02 expref: 26914 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.745861:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.745863:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c66f600/0xdfc0fb148688d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa924:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b02 expref: 26913 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.745870:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745873:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c66f600/0xdfc0fb148688d94 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa924:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b02 expref: 26913 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.745874:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.745874:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471872 00010000:00010000:0.0:1713481296.745875:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.745876:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471872 00010000:00010000:0.0:1713481296.745879:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.745882:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.745883:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745883:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.745884:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.745885:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083ba58c0/0xdfc0fb1488022f1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a2c expref: 20827 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.745886:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745886:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.745892:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.745893:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc5680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.745894:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.745895:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.745899:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.745906:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.745907:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820277 00010000:00010000:0.0:1713481296.745910:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086bc5680/0xdfc0fb148a3a6c4 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.745911:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.745911:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20827:1958:x1796714882471872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.745916:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745918:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.745921:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745921:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083ba58c0/0xdfc0fb1488022f1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a2c expref: 20827 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.745925:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745927:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083ba58c0/0xdfc0fb1488022f1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a2c expref: 20827 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.745928:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:1958:x1796714882471488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.745929:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745933:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.745935:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820276 00010000:00010000:1.0:1713481296.745937:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206ce1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.745937:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083ba58c0/0xdfc0fb1488022f1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a2c expref: 20827 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.745938:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745942:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745946:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.745947:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.745949:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745950:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.745954:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206ce1c0/0xdfc0fb148a3a757 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745954:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.745958:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471936 00000100:00100000:2.0:1713481296.745961:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471936 00010000:00010000:3.0:1713481296.745965:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.745975:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485812 00000100:00100000:3.0:1713481296.745976:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20826:1958:x1796714882471872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.745980:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2197:18678:x1796714882471936:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:3.0:1713481296.745980:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820277 00010000:00010000:2.0:1713481296.745987:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.745996:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86fa80/0xdfc0fb148a3a7ce lrc: 2/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49532 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.745998:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746003:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746012:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.746013:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+143:3492:x1796714784497856:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5981us (6032us total) trans 4296040805 rc 0/0 00010000:00010000:3.0:1713481296.746016:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.746017:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563054 00010000:00010000:3.0:1713481296.746020:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746023:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008324c240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.746025:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746029:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.746030:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472000 00000100:00100000:0.0:1713481296.746032:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472000 00010000:00010000:3.0:1713481296.746035:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746039:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008324c240/0xdfc0fb148a3a77a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.746040:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472064 00010000:00010000:2.0:1713481296.746041:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.746042:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472064 00010000:00010000:2.0:1713481296.746048:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.746049:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563071 00000100:00100000:0.0:1713481296.746052:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20826:15045:x1796714882472000:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.746054:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.746057:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.746057:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009421a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2746:3491:x1796714784498688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4547us (4628us total) trans 4295960686 rc 0/0 00000100:00100000:1.0:1713481296.746061:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563061 00010000:00010000:2.0:1713481296.746063:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x230:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.746064:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a26d58c0/0xdfc0fb148a3a7e3 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49539 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746069:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746074:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563072 00002000:00010000:0.0:1713481296.746075:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.746077:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:11552:x1796714882472064:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.746078:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.746082:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.746084:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.746086:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.746088:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a94a880/0xdfc0fb148a3a7ea lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49540 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746090:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d58c0/0xdfc0fb148a3a7e3 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49539 expref: 20827 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.746098:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a0c0000/0xdfc0fb148959c21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc2 expref: 26913 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.746099:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a26d58c0/0xdfc0fb148a3a7e3 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49539 expref: 20827 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.746101:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.746101:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133b98d80/0xdfc0fb148a3a7f1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.746102:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.746104:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a94a880/0xdfc0fb148a3a7ea lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49540 expref: 26913 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746106:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133b98d80/0xdfc0fb148a3a7f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:0.0:1713481296.746107:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a26d58c0, rc 0) 00010000:00010000:2.0:1713481296.746112:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133b98d80/0xdfc0fb148a3a7f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.746114:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007a0c0000/0xdfc0fb148959c21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc2 expref: 26913 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.746136:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007a0c0000/0xdfc0fb148959c21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc2 expref: 26913 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.746140:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20827:15045:x1796714882472000:12345-192.168.202.24@tcp:101:dd.0 Request processed in 66us (236us total) trans 0 rc 0/0 00000004:00010000:2.0:1713481296.746140:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133b98d80/0xdfc0fb148a3a7f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746142:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784499584:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.746144:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563071 00010000:00010000:2.0:1713481296.746148:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.746153:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746155:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0480 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.746159:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.746164:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000100:00100000:3.0:1713481296.746167:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800842c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+143:3491:x1796714784498752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4246us (4503us total) trans 4296040806 rc 0/0 00010000:00010000:2.0:1713481296.746168:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f86d200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.746171:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00000004:00080000:0.0:1713481296.746172:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077153480/2, rc 0, transno 1073509 00000100:00100000:3.0:1713481296.746172:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563064 00010000:00010000:2.0:1713481296.746176:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.746177:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784497856:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.746178:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094218700/2, rc 0, transno 1073510 00000100:00100000:1.0:1713481296.746181:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784498752:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.746186:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff880092ca5600) 00000004:00080000:1.0:1713481296.746187:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094219880/2, rc 0, transno 993390 00010000:00010000:2.0:1713481296.746188:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.746191:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746192:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784498688:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.746195:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713481296.746195:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86d200/0xdfc0fb148a3a7d5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746200:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009421b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784499712:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.746206:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.746211:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746213:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.746216:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.746220:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800987afcc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.746222:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT0 00010000:00010000:2.0:1713481296.746227:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746228:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784499648:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.746232:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x35 (ffff88009cf16000) 00000100:00100000:0.0:1713481296.746233:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784499712 00010000:00010000:2.0:1713481296.746234:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.746236:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784499712 00010000:00010000:2.0:1713481296.746236:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 2/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.746237:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.746241:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800987afcc0/0xdfc0fb148a3a7dc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT0 00000100:00100000:0.0:1713481296.746261:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784499648 00000100:00100000:0.0:1713481296.746264:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784499648 00000100:00100000:1.0:1713481296.746264:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.746266:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563073 00000100:00100000:1.0:1713481296.746267:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784499776:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.746271:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f86fa80/0xdfc0fb148a3a7ce lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49532 expref: 2199 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.746271:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+144:3491:x1796714784499712:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.746279:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563074 00000100:00100000:1.0:1713481296.746279:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713481296.746280:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9960 count 1 00000100:00100000:0.0:1713481296.746284:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+144:3491:x1796714784499648:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.746289:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133b98d80/0xdfc0fb148a3a7f1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49532 expref: 2198 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746289:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746292:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784499776 00000100:00100000:1.0:1713481296.746294:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784499776 00010000:00010000:2.0:1713481296.746294:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88009c4f1100) 00002000:00080000:0.0:1713481296.746296:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9959 count 1 00010000:00010000:2.0:1713481296.746296:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.746297:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083639680/0xdfc0fb148802306 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a56 expref: 20826 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.746298:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133b98d80, rc 0) 00010000:00010000:3.0:1713481296.746302:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.746303:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.746304:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746305:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563075 00010000:00010000:0.0:1713481296.746306:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746308:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2746:3493:x1796714784499776:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.746312:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2198:18678:x1796714882471936:12345-192.168.202.24@tcp:101:rm.0 Request processed in 331us (436us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.746314:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083639680/0xdfc0fb148802306 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a56 expref: 20826 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.746316:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302e3840/0xdfc0fb1488022ff lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a48 expref: 20826 pid: 16538 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713481296.746316:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43302 count 1 00000100:00100000:2.0:1713481296.746317:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485812 00010000:00010000:3.0:1713481296.746320:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083639680/0xdfc0fb148802306 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a56 expref: 20826 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.746323:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.746323:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746324:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.746326:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784499840:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.746327:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.746330:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e400/0xdfc0fb148688dda lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b1e expref: 26913 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.746334:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.746335:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.746336:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.746339:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88840 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.746344:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801302e3840/0xdfc0fb1488022ff lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a48 expref: 20826 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.746346:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e400/0xdfc0fb148688dda lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b1e expref: 26913 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.746351:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e400/0xdfc0fb148688dda lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b1e expref: 26913 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.746353:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801302e3840/0xdfc0fb1488022ff lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a48 expref: 20826 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.746353:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.746356:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784499968:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.746363:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d254700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784499904:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.746368:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089874000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.746371:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.746379:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.746381:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472192 00000100:00100000:1.0:1713481296.746383:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472192 00000100:00100000:2.0:1713481296.746395:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.746397:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125677 00000100:00100000:1.0:1713481296.746400:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2370:18729:x1796714882472192:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:0.0:1713481296.746406:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472384 00000100:00100000:2.0:1713481296.746408:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.746409:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472384 00000100:00100000:2.0:1713481296.746418:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.746435:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472576 00000100:00100000:0.0:1713481296.746437:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472576 00000100:00100000:2.0:1713481296.746439:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.746442:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563076 00000100:00100000:3.0:1713481296.746447:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:18844:x1796714882472384:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.746453:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.746453:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.746455:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563077 00000100:00100000:1.0:1713481296.746459:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2371:18729:x1796714882472192:12345-192.168.202.24@tcp:35:rm.0 Request processed in 57us (106us total) trans 4295107580 rc 0/0 00000100:00100000:0.0:1713481296.746460:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16867:8499:x1796714882472576:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.746460:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095c93600/0xdfc0fb148a3a80d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49547 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746463:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125677 00000100:00100000:2.0:1713481296.746466:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.746468:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1713481296.746473:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.746478:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960ecd80/0xdfc0fb148a3a814 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4954e expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746479:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472768 00000100:00100000:1.0:1713481296.746481:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472768 00010000:00010000:3.0:1713481296.746481:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.746481:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.746483:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.746485:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095c93600/0xdfc0fb148a3a80d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49547 expref: 16869 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746490:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563078 00010000:00010000:3.0:1713481296.746491:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095c93600/0xdfc0fb148a3a80d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49547 expref: 16869 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746492:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb1488e7ea0 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54fb expref: 16869 pid: 16467 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.746493:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26914:17935:x1796714882472768:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.746495:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.746496:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095c93600, rc 0) 00010000:00010000:1.0:1713481296.746497:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.746502:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.746502:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.746505:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960ecd80/0xdfc0fb148a3a814 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4954e expref: 16869 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.746505:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013625d680/0xdfc0fb148a3a81b lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4955c expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.746508:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16869:18844:x1796714882472384:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.746509:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.746513:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb792:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.746513:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563076 00010000:00010000:0.0:1713481296.746516:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb1488e7ea0 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54fb expref: 16869 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.746519:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.746520:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.746521:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.746522:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb1488e7ea0 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54fb expref: 16869 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.746523:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013625d680/0xdfc0fb148a3a81b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4955c expref: 26915 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.746528:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086966a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784500032:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.746529:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013625d680/0xdfc0fb148a3a81b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4955c expref: 26915 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.746533:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013625d680, rc 0) 00000100:00100000:2.0:1713481296.746533:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470272 00000100:00100000:2.0:1713481296.746536:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470272 00000100:00100000:0.0:1713481296.746539:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801329bbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.746540:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470400 00000100:00100000:1.0:1713481296.746542:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26916:17935:x1796714882472768:12345-192.168.202.24@tcp:101:dd.0 Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.746542:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470400 00000100:00100000:1.0:1713481296.746546:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563078 00010000:00010000:2.0:1713481296.746546:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942aaf40/0xdfc0fb148688d71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2abc expref: 26916 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.746551:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012251b600/0xdfc0fb14891e762 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb524 expref: 20827 pid: 16515 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.746563:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470528 00000100:00100000:3.0:1713481296.746565:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470528 00000100:00100000:0.0:1713481296.746566:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.746566:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470784 00000100:00100000:2.0:1713481296.746568:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470784 00000100:00100000:1.0:1713481296.746570:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470976 00000100:00100000:1.0:1713481296.746572:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470976 00010000:00010000:3.0:1713481296.746572:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801241946c0/0xdfc0fb148688d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aca expref: 26916 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.746576:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6573c0/0xdfc0fb1488022c7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629d8 expref: 20828 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.746578:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124195d40/0xdfc0fb148688d7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ad8 expref: 26917 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.746582:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471104 00000100:00100000:3.0:1713481296.746584:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471104 00000100:00100000:2.0:1713481296.746589:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471232 00010000:00010000:3.0:1713481296.746590:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083ba4fc0/0xdfc0fb1488022e3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a10 expref: 20829 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.746591:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.746591:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471232 00000100:00100000:1.0:1713481296.746592:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820278 00000100:00100000:1.0:1713481296.746595:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1959:x1796714882470400:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.746598:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083549d40/0xdfc0fb1489cf832 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22193 expref: 20830 pid: 16481 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.746599:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.746603:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012251b600/0xdfc0fb14891e762 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb524 expref: 20830 pid: 16515 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.746604:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471360 00000100:00100000:3.0:1713481296.746606:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471360 00010000:00010000:1.0:1713481296.746609:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012251b600/0xdfc0fb14891e762 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb524 expref: 20831 pid: 16515 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.746613:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a657a80/0xdfc0fb1488022ea lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a1e expref: 20831 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.746618:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820279 00010000:00010000:1.0:1713481296.746619:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012251b600/0xdfc0fb14891e762 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb524 expref: 20831 pid: 16515 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.746623:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26917:1959:x1796714882470272:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.746624:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820280 00010000:00010000:1.0:1713481296.746629:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.746629:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820281 00000100:00100000:0.0:1713481296.746630:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26917:1959:x1796714882470528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.746630:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.746630:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.746633:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091dbaf40/0xdfc0fb148a3a662 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494b4 expref: 16868 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.746633:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20830:1959:x1796714882470784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.746634:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942aaf40/0xdfc0fb148688d71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2abc expref: 26917 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.746635:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.746638:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091dbaf40/0xdfc0fb148a3a662 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494b4 expref: 16868 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746638:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.746639:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801241946c0/0xdfc0fb148688d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa920:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aca expref: 26917 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.746641:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a6573c0/0xdfc0fb1488022c7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629d8 expref: 20830 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.746643:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942aaf40/0xdfc0fb148688d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2abc expref: 26917 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.746645:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801241946c0/0xdfc0fb148688d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa920:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aca expref: 26917 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.746648:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a6573c0/0xdfc0fb1488022c7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629d8 expref: 20830 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.746651:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091dbaf40/0xdfc0fb148a3a662 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494b4 expref: 16868 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746657:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784500096:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.746658:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801241946c0/0xdfc0fb148688d78 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa920:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aca expref: 26917 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.746659:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942aaf40/0xdfc0fb148688d71 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2abc expref: 26917 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.746662:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a6573c0/0xdfc0fb1488022c7 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629d8 expref: 20830 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.746681:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.746682:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.746684:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e688b40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.746684:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.746685:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746686:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.746688:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746689:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746690:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.746690:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.746693:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746698:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746700:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.746701:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746702:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820282 00000100:00100000:1.0:1713481296.746706:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26915:1959:x1796714882470976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.746711:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26915:1959:x1796714882470528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.746711:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.746711:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.746714:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124195d40/0xdfc0fb148688d7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa921:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ad8 expref: 26915 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.746715:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820280 00010000:00010000:2.0:1713481296.746717:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.746719:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124195d40/0xdfc0fb148688d7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa921:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ad8 expref: 26915 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.746721:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20829:1959:x1796714882470784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.746726:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820281 00010000:00010000:1.0:1713481296.746729:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124195d40/0xdfc0fb148688d7f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa921:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ad8 expref: 26914 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.746730:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26914:1959:x1796714882470272:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.746731:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820283 00000100:00100000:0.0:1713481296.746734:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20829:1959:x1796714882471104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.746736:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820279 00010000:00010000:1.0:1713481296.746738:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.746739:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.746739:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.746742:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746743:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083ba4fc0/0xdfc0fb1488022e3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a10 expref: 20828 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.746745:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820284 00010000:00010000:0.0:1713481296.746749:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083ba4fc0/0xdfc0fb1488022e3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a10 expref: 20828 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.746749:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.746749:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086966300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20828:1959:x1796714882471232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.746752:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820285 00010000:00010000:3.0:1713481296.746754:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.746757:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20828:1959:x1796714882471360:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.746757:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083549d40/0xdfc0fb1489cf832 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22193 expref: 20828 pid: 16481 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.746758:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083ba4fc0/0xdfc0fb1488022e3 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a10 expref: 20828 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.746763:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.746764:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083549d40/0xdfc0fb1489cf832 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22193 expref: 20827 pid: 16481 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.746767:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.746768:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.746768:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a657a80/0xdfc0fb1488022ea lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a1e expref: 20827 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.746770:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.746772:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.746774:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746777:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083549d40/0xdfc0fb1489cf832 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22193 expref: 20827 pid: 16481 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.746778:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a657a80/0xdfc0fb1488022ea lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a1e expref: 20827 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.746781:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.746785:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:1959:x1796714882470976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 77us (274us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.746785:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.746786:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.746788:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20826:1959:x1796714882471104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (267us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.746789:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800821a5f80/0xdfc0fb148a3a726 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49501 expref: 16868 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746790:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820282 00010000:00010000:2.0:1713481296.746792:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a657a80/0xdfc0fb1488022ea lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a1e expref: 20826 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.746793:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820283 00010000:00010000:3.0:1713481296.746794:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800821a5f80/0xdfc0fb148a3a726 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49501 expref: 16868 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746804:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.746804:0:16553:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800821a5f80/0xdfc0fb148a3a726 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49501 expref: 16868 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746805:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.746807:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746810:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.746810:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784500160:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.746814:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746814:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472320 00010000:00010000:2.0:1713481296.746814:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746817:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472320 00010000:00010000:0.0:1713481296.746818:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746822:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.746823:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800985c7840 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.746826:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746827:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.746830:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472512 00010000:00010000:0.0:1713481296.746832:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc5f80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.746832:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472512 00010000:00010000:0.0:1713481296.746834:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746838:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.746839:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20824:1959:x1796714882471360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (246us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.746844:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.746844:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820285 00000100:00100000:1.0:1713481296.746845:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485813 00010000:00010000:0.0:1713481296.746848:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880086bc5f80/0xdfc0fb148a3a67e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746850:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2198:18919:x1796714882472320:12345-192.168.202.24@tcp:36:lfs.0 00000100:00100000:3.0:1713481296.746853:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485814 00000100:00100000:3.0:1713481296.746857:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2017:18920:x1796714882472512:12345-192.168.202.24@tcp:36:mkdir.0 00010000:00010000:2.0:1713481296.746864:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746871:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746878:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746881:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784500224:0@lo:1000:mdt00_029.0 00010000:00010000:2.0:1713481296.746885:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746891:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746896:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801346b3cc0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.746898:0:15642:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.746899:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.746900:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.746905:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746906:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008987ba80 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.746907:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.746912:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.746919:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a829 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.746921:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500224 00000100:00100000:1.0:1713481296.746922:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500224 00010000:00010000:3.0:1713481296.746923:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a829 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.746927:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a829 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.746930:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.746937:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3a65b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa91f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746938:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82895 00000100:00100000:1.0:1713481296.746941:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+34:15642:x1796714784500224:12345-0@lo:1000:mdt00_029.0 00000100:00100000:0.0:1713481296.746943:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2747:3493:x1796714784496896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8225us (8696us total) trans 4295960687 rc 0/0 00000100:00100000:0.0:1713481296.746947:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563044 00010000:00010000:0.0:1713481296.746962:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746967:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746971:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746974:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746979:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746982:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc46c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.746984:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.746987:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746992:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+34:15642:x1796714784500224:12345-0@lo:1000:mdt00_029.0 Request processed in 50us (93us total) trans 0 rc 1/1 00010000:00010000:0.0:1713481296.746996:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.746996:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82895 00010000:00010000:0.0:1713481296.746999:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3a6b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.747021:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787c5c00/2, rc 0, transno 993391 00000100:00100000:1.0:1713481296.747024:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784496896:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.747047:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784500288:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.747059:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.747069:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2748:3491:x1796714784496832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8886us (8994us total) trans 4295960688 rc 0/0 00000100:00100000:2.0:1713481296.747076:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563039 00000100:00100000:0.0:1713481296.747081:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2748:3491:x1796714784497664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7315us (7371us total) trans 4295960689 rc 0/0 00000004:00080000:1.0:1713481296.747082:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0e0e00/2, rc 0, transno 993393 00000100:00100000:0.0:1713481296.747085:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563052 00000100:00100000:1.0:1713481296.747086:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784497664:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.747091:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787c5880/2, rc 0, transno 993392 00000100:00100000:1.0:1713481296.747093:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784496832:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.747095:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500288 00000100:00100000:2.0:1713481296.747098:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500288 00010000:00010000:0.0:1713481296.747101:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747105:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747109:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.747111:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563079 00000100:00100000:1.0:1713481296.747112:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784500416:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.747114:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.747115:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2747:3493:x1796714784500288:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.747118:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747136:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a26d5f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.747138:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747140:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.747142:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.747144:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43303 count 1 00010000:00010000:0.0:1713481296.747150:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747150:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.747152:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784500352:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.747153:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3a742 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.747154:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747162:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.747165:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091728900/0xdfc0fb148688de1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b2c expref: 26911 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.747165:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a837 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.747171:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.747171:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a837 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.747172:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.747174:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500416 00000100:00100000:1.0:1713481296.747175:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500416 00010000:00010000:2.0:1713481296.747175:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747175:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a837 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00010000:3.0:1713481296.747182:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007dc88700 reply state ffff880124cbf000 transno 4295107581 ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a837 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.747184:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500352 00000100:00100000:1.0:1713481296.747185:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500352 00010000:00010000:3.0:1713481296.747187:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f58c0/0xdfc0fb148a3a837 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.747189:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091728900/0xdfc0fb148688de1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b2c expref: 26911 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.747192:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbb:0x0].0x0 (ffff88008ad2f600) 00000100:00100000:1.0:1713481296.747194:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563080 00010000:00010000:3.0:1713481296.747194:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.747195:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713481296.747196:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2749:3491:x1796714784500416:12345-0@lo:6:osp-syn-1-1.0 00000004:00200000:3.0:1713481296.747197:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cbb:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.747201:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.747202:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091728900/0xdfc0fb148688de1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b2c expref: 26911 pid: 16537 timeout: 815 lvb_type: 1 00002000:00080000:1.0:1713481296.747204:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43305 count 1 00010000:00010000:3.0:1713481296.747204:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.747207:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.747211:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.747211:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e406680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784500480:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.747211:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.747214:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801346b2400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.747216:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.747218:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303df600/0xdfc0fb148688def lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b48 expref: 26911 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.747219:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.747222:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.747222:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.747223:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.747223:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.747225:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.747225:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081d24b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.747225:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.747228:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a822 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.747234:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303df600/0xdfc0fb148688def lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b48 expref: 26911 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.747240:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303df600/0xdfc0fb148688def lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b48 expref: 26911 pid: 16503 timeout: 815 lvb_type: 1 00000004:00010000:3.0:1713481296.747240:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007dc88700 reply state ffff880124cbf000 transno 4295107581 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a829 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.747243:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563081 00000100:00100000:1.0:1713481296.747245:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784500544:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.747247:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2749:3491:x1796714784500352:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.747248:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8d6400/0xdfc0fb148a3a829 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.747251:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+145:3493:x1796714784498560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5997us (6041us total) trans 4296040807 rc 0/0 00010000:00010000:3.0:1713481296.747251:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff8801314b4900) 00010000:00010000:3.0:1713481296.747252:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.747254:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1713481296.747255:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.747256:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563060 00002000:00080000:2.0:1713481296.747257:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43304 count 1 00010000:00010000:2.0:1713481296.747266:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.747272:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094218380/2, rc 0, transno 1073511 00010000:00010000:2.0:1713481296.747275:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303ded00/0xdfc0fb148688de8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b3a expref: 26911 pid: 16503 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.747277:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784498560:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.747278:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2019:18920:x1796714882472512:12345-192.168.202.24@tcp:36:mkdir.0 Request processed in 420us (869us total) trans 4295107581 rc 0/0 00010000:00010000:2.0:1713481296.747280:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.747282:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.747283:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485814 00010000:00010000:2.0:1713481296.747284:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747293:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784500224:0@lo:1000:mdt00_029.0 00000100:00100000:0.0:1713481296.747294:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784500608:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.747297:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303ded00/0xdfc0fb148688de8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b3a expref: 26911 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.747304:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303ded00/0xdfc0fb148688de8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b3a expref: 26911 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.747306:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.747318:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e406300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784500672:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.747322:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747328:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2198:18919:x1796714882472320:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 478us (957us total) trans 0 rc -17/-17 00000100:00100000:2.0:1713481296.747329:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134300300 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.747330:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747332:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485813 00010000:00010000:0.0:1713481296.747335:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747338:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747342:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747345:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc5b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.747346:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747350:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747355:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500608 00000100:00100000:1.0:1713481296.747357:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500608 00010000:00010000:0.0:1713481296.747358:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747363:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3a6e7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747367:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563082 00000100:00100000:1.0:1713481296.747369:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+145:3492:x1796714784500608:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.747376:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9961 count 1 00010000:00010000:1.0:1713481296.747383:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.747389:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a654b40/0xdfc0fb14880230d lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a64 expref: 20823 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.747393:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.747394:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.747396:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.747406:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a654b40/0xdfc0fb14880230d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a64 expref: 20823 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.747411:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a654b40/0xdfc0fb14880230d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a64 expref: 20823 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.747416:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784500736:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.747425:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.747445:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+146:3490:x1796714784498048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7102us (7181us total) trans 4296040808 rc 0/0 00000100:00100000:0.0:1713481296.747450:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563055 00000004:00080000:0.0:1713481296.747470:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081ec6680/2, rc 0, transno 1073512 00000100:00100000:0.0:1713481296.747475:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784498048:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.747501:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.747506:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784500800:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.747518:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.747533:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500800 00000100:00100000:1.0:1713481296.747536:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500800 00000100:00100000:1.0:1713481296.747553:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563083 00000100:00100000:1.0:1713481296.747557:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+146:3492:x1796714784500800:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.747568:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9962 count 1 00010000:00010000:3.0:1713481296.747568:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747573:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747578:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.747579:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747582:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747585:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.747588:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302e1b00/0xdfc0fb148802314 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a72 expref: 20823 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.747589:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800821a4480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.747591:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.747594:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.747595:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.747598:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747599:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747609:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.747610:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801302e1b00/0xdfc0fb148802314 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a72 expref: 20823 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.747612:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800821a4480/0xdfc0fb148a3a6a8 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.747619:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801302e1b00/0xdfc0fb148802314 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a72 expref: 20823 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.747626:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784500864:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.747633:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.747644:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f5ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.747672:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472896 00000100:00100000:0.0:1713481296.747675:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472896 00000100:00100000:0.0:1713481296.747695:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485815 00000100:00100000:0.0:1713481296.747698:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2198:18578:x1796714882472896:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:0.0:1713481296.747714:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713481296.747723:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0dcfc0/0xdfc0fb148a3a654 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x385d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49491 expref: 2198 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.747737:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079920900/0xdfc0fb148a382d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x385d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c2d expref: 2197 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.747739:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+147:3493:x1796714784497408:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8214us (8289us total) trans 4296040809 rc 0/0 00000100:00100000:3.0:1713481296.747744:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563050 00010000:00010000:0.0:1713481296.747791:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff88011f854800) 00010000:00010000:0.0:1713481296.747804:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.747818:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.747822:0:15642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15642 initiator: MDT0 00000100:00100000:1.0:1713481296.747824:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.747826:0:15642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.747833:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784500928:0@lo:101:mdt00_029.0 00000100:00100000:0.0:1713481296.747850:0:15642:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.747851:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.747868:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.747868:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471680 00000100:00100000:1.0:1713481296.747871:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500928 00000100:00100000:2.0:1713481296.747871:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471680 00000100:00100000:1.0:1713481296.747873:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500928 00000100:00100000:3.0:1713481296.747873:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470144 00000100:00100000:3.0:1713481296.747877:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470144 00010000:00010000:2.0:1713481296.747884:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff9d8c0/0xdfc0fb148688d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b10 expref: 26912 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.747885:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82896 00000004:00080000:0.0:1713481296.747888:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0e0380/2, rc 0, transno 1073513 00000100:00100000:1.0:1713481296.747890:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+34:15642:x1796714784500928:12345-0@lo:101:mdt00_029.0 00000100:00100000:0.0:1713481296.747892:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784497408:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.747893:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880135440240/0xdfc0fb148a32d9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44a62 expref: 2019 pid: 15577 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.747897:0:6936:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.747901:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820286 00000100:00100000:2.0:1713481296.747906:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26912:1959:x1796714882471680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.747907:0:6936:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a85a expref: -99 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.747912:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713481296.747913:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.747916:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784500992:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.747917:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ff9d8c0/0xdfc0fb148688d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa925:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b10 expref: 26912 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.747919:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820287 00010000:00010000:1.0:1713481296.747921:0:6936:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4af40/0xdfc0fb148a37b9e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479b0 expref: 2019 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.747924:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2019:1959:x1796714882470144:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.747925:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ff9d8c0/0xdfc0fb148688d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa925:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b10 expref: 26912 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.747928:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.747930:0:6936:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747932:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.747937:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880135440240/0xdfc0fb148a32d9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44a62 expref: 2019 pid: 15577 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.747940:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9d8c0/0xdfc0fb148688d9b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa925:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b10 expref: 26912 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.747945:0:6936:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4af40/0xdfc0fb148a37b9e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479b0 expref: 2019 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747947:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880135440240/0xdfc0fb148a32d9b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44a62 expref: 2019 pid: 15577 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.747953:0:6936:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4af40/0xdfc0fb148a37b9e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479b0 expref: 2019 pid: 15576 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.747953:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.747954:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.747957:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747965:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880135440240/0xdfc0fb148a32d9b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3474:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44a62 expref: 2019 pid: 15577 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.747967:0:6936:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7bb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6936:1796714784501056:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.747969:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.747984:0:14813:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00010000:00010000:2.0:1713481296.747985:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.747990:0:14813:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.747991:0:6936:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008987ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.748000:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26911:1959:x1796714882471680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 93us (175us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.748000:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748006:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820286 00010000:00010000:3.0:1713481296.748007:0:14813:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748018:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.748024:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748029:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470336 00000100:00100000:2.0:1713481296.748032:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470336 00000100:00100000:3.0:1713481296.748033:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:14813:1796714784501120:0@lo:105: 00010000:00010000:2.0:1713481296.748039:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148688d6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aae expref: 26911 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.748053:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820288 00000100:00100000:2.0:1713481296.748057:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26911:1959:x1796714882470336:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.748058:0:14813:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.748063:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.748066:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148688d6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aae expref: 26911 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.748074:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148688d6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aae expref: 26911 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.748080:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011dafc300 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.748090:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148688d6a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2aae expref: 26911 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.748092:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.748095:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748100:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.748102:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.748103:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748104:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748107:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.748111:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748111:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748117:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.748144:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470464 00000100:00100000:0.0:1713481296.748147:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470464 00010000:00010000:1.0:1713481296.748147:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748147:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.748148:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748152:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748155:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748156:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748160:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748161:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350f4900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.748163:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748164:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748164:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26910:1959:x1796714882470336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.748168:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206cf600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.748169:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748170:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820288 00010000:00010000:3.0:1713481296.748171:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748173:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748183:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748183:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470592 00000100:00100000:2.0:1713481296.748185:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470592 00010000:00010000:3.0:1713481296.748186:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748188:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206cf600/0xdfc0fb148a3a669 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa91e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748193:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081e53180/0xdfc0fb148a15fcc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3981a expref: 20824 pid: 16517 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.748193:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3a773 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748204:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882470848 00000100:00100000:2.0:1713481296.748206:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882470848 00010000:00010000:2.0:1713481296.748213:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083ba5d40/0xdfc0fb1488022ce lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629e6 expref: 20825 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.748224:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820289 00000100:00100000:2.0:1713481296.748228:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20825:1959:x1796714882470592:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.748229:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e347840/0xdfc0fb148942404 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03aa expref: 24478 pid: 16531 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.748234:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.748237:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081e53180/0xdfc0fb148a15fcc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3981a expref: 20825 pid: 16517 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.748245:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081e53180/0xdfc0fb148a15fcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3981a expref: 20825 pid: 16517 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.748249:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820290 00000100:00100000:0.0:1713481296.748253:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20825:1959:x1796714882470848:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.748259:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081e53180/0xdfc0fb148a15fcc lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3981a expref: 20825 pid: 16517 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.748260:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.748264:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083ba5d40/0xdfc0fb1488022ce lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629e6 expref: 20825 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.748269:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083ba5d40/0xdfc0fb1488022ce lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629e6 expref: 20824 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.748270:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.748271:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.748275:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801206cf3c0/0xdfc0fb148a3a68c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494de expref: 20824 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748280:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2751:3491:x1796714784496768:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9686us (10160us total) trans 4295960690 rc 0/0 00010000:00010000:2.0:1713481296.748282:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801206cf3c0/0xdfc0fb148a3a68c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494de expref: 20824 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.748283:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083ba5d40/0xdfc0fb1488022ce lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629e6 expref: 20824 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.748285:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563041 00010000:00010000:0.0:1713481296.748292:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.748293:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.748295:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748297:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801206cf3c0/0xdfc0fb148a3a68c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494de expref: 20823 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748299:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784500992 00010000:00010000:0.0:1713481296.748300:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748301:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784500992 00000100:00100000:2.0:1713481296.748305:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076af5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784501184:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.748312:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563084 00000100:00100000:1.0:1713481296.748314:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+147:3491:x1796714784500992:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.748320:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800979649c0 going to sleep for 11 seconds 00002000:00080000:1.0:1713481296.748322:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9963 count 1 00010000:00010000:1.0:1713481296.748329:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748336:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c110fc0/0xdfc0fb14880231b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a80 expref: 20823 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.748336:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820291 00010000:00010000:1.0:1713481296.748340:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.748341:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.748341:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1959:x1796714882470464:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.748342:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748347:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.748349:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2750:3492:x1796714784498944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6693us (6731us total) trans 4295960691 rc 0/0 00010000:00010000:2.0:1713481296.748351:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e347840/0xdfc0fb148942404 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03aa expref: 24478 pid: 16531 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.748352:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c110fc0/0xdfc0fb14880231b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a80 expref: 20823 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.748356:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563063 00010000:00010000:2.0:1713481296.748359:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e347840/0xdfc0fb148942404 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03aa expref: 24478 pid: 16531 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.748360:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.748361:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c110fc0/0xdfc0fb14880231b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a80 expref: 20823 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.748367:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784501248:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.748378:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e347840/0xdfc0fb148942404 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03aa expref: 24478 pid: 16531 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.748383:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.748386:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501120 00010000:00010000:2.0:1713481296.748387:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.748389:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.748389:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501120 00010000:00010000:2.0:1713481296.748392:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494bb expref: 26909 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748394:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748399:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494bb expref: 26909 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748401:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748408:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.748411:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20395 00000100:00100000:0.0:1713481296.748412:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20823:1959:x1796714882470848:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 157us (292us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.748413:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0xdfc0fb148a3a670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494bb expref: 26909 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748414:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.748416:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:14813:x1796714784501120:12345-0@lo:105: 00010000:00010000:1.0:1713481296.748421:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748421:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076af6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784501312:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.748426:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc58c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.748426:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748428:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748433:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.748433:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748434:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748441:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.748444:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820290 00010000:00010000:1.0:1713481296.748447:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748449:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748452:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3a6af lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.748455:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15560:1796714784499264:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.748455:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748463:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748473:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f86e1c0/0xdfc0fb148a3a781 lrc: 3/0,0 mode: --/PW res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4950f expref: 20822 pid: 15560 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.748482:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787c7800/2, rc 0, transno 993394 00010000:00010000:2.0:1713481296.748482:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f86e1c0, rc 0) 00010000:00010000:3.0:1713481296.748483:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88009cce0b40) 00000100:00100000:2.0:1713481296.748495:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007720ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20822:14753:x1796714882470016:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6568us (6688us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.748501:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563065 00000100:00100000:3.0:1713481296.748514:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:14813:x1796714784501120:12345-0@lo:105: Request processed in 97us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.748521:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20395 00000100:00100000:0.0:1713481296.748537:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784496768:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.748543:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.748560:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:14813:1796714784501120:0@lo:105: 00000100:00100000:1.0:1713481296.748573:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+148:3490:x1796714784497472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9013us (9070us total) trans 4296040810 rc 0/0 00010000:00010000:3.0:1713481296.748577:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.748579:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563051 00000100:00100000:2.0:1713481296.748581:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.748597:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2018:1959:x1796714882470144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 672us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.748604:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820287 00000100:00100000:1.0:1713481296.748605:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471040 00000100:00100000:1.0:1713481296.748607:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471040 00000100:00100000:2.0:1713481296.748614:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.748618:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a656f40/0xdfc0fb1488022d5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629f4 expref: 20822 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.748622:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471168 00000004:00080000:0.0:1713481296.748626:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0e3480/2, rc 0, transno 1073514 00000100:00100000:3.0:1713481296.748626:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471168 00000100:00100000:0.0:1713481296.748631:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784497472:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.748634:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713481296.748636:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124197180/0xdfc0fb148688d86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ae6 expref: 26910 pid: 15558 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.748639:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784501376:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.748641:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471296 00000100:00100000:1.0:1713481296.748644:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471296 00000100:00100000:2.0:1713481296.748647:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820292 00000100:00100000:2.0:1713481296.748652:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20822:1959:x1796714882471040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.748654:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124195b00/0xdfc0fb148688d8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2af4 expref: 26911 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.748656:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.748659:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.748662:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820293 00010000:00010000:2.0:1713481296.748680:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a656f40/0xdfc0fb1488022d5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629f4 expref: 20822 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.748682:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007dc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26911:1959:x1796714882471168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.748690:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820294 00010000:00010000:2.0:1713481296.748690:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a656f40/0xdfc0fb1488022d5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629f4 expref: 20822 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.748690:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.748695:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26911:1959:x1796714882471296:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.748695:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124197180/0xdfc0fb148688d86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa922:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ae6 expref: 26911 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.748702:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.748703:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a656f40/0xdfc0fb1488022d5 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9629f4 expref: 20822 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.748704:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124197180/0xdfc0fb148688d86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa922:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ae6 expref: 26911 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.748705:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124195b00/0xdfc0fb148688d8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa923:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2af4 expref: 26911 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.748711:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124195b00/0xdfc0fb148688d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa923:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2af4 expref: 26911 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.748714:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784501440:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.748717:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.748718:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.748721:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748722:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124195b00/0xdfc0fb148688d8d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa923:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2af4 expref: 26911 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.748722:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124197180/0xdfc0fb148688d86 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa922:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ae6 expref: 26911 pid: 15558 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.748728:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748729:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.748730:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.748731:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.748731:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748733:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.748735:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.748736:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748738:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748742:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.748745:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748747:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1713481296.748755:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078396a00/2, rc 0, transno 993395 00000100:00100000:2.0:1713481296.748759:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20821:1959:x1796714882471040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.748761:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26909:1959:x1796714882471296:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.748762:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784498944:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.748764:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.748765:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820292 00000100:00100000:1.0:1713481296.748768:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820294 00010000:00010000:0.0:1713481296.748777:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.748783:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1959:x1796714882471168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 101us (201us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.748784:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748786:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501376 00010000:00010000:2.0:1713481296.748787:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748789:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501376 00000100:00100000:3.0:1713481296.748790:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820293 00010000:00010000:2.0:1713481296.748794:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.748795:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748797:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501440 00000100:00100000:1.0:1713481296.748799:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501440 00010000:00010000:0.0:1713481296.748801:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748801:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.748807:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748807:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563085 00010000:00010000:2.0:1713481296.748807:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748809:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2750:3490:x1796714784501376:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.748813:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a26d7180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.748814:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.748816:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748816:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.748817:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43306 count 1 00010000:00010000:2.0:1713481296.748820:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800821a4240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.748822:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748823:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748824:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748825:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748829:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748831:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff78b40/0xdfc0fb148688df6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b56 expref: 26907 pid: 16451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.748833:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.748835:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748839:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.748839:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.748840:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748840:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748841:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.748842:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3a73b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.748846:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3a6ee lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748847:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748851:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff78b40/0xdfc0fb148688df6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b56 expref: 26907 pid: 16451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.748853:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012052c900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.748855:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff78b40/0xdfc0fb148688df6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b56 expref: 26907 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.748856:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748861:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784501504:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.748862:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.748874:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.748875:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800975b4e40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.748879:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012052c900/0xdfc0fb148a3a6bd lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748887:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.748892:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.748909:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000404:0x3474:0x0] 00010000:00010000:1.0:1713481296.748920:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.748924:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.748927:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713481296.748936:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784501568:0@lo:101:mdt_io00_009.0 00000100:00100000:2.0:1713481296.748939:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.748952:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.748960:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.748972:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563086 00000100:00100000:1.0:1713481296.748975:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+149:3492:x1796714784501440:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.748983:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9964 count 1 00000100:00100000:0.0:1713481296.748989:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009421b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2752:3493:x1796714784498432:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7962us (8011us total) trans 4295960692 rc 0/0 00010000:00010000:1.0:1713481296.748989:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.748995:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563059 00010000:00010000:1.0:1713481296.748996:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a654240/0xdfc0fb148802322 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a8e expref: 20820 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.748999:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.749000:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.749002:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.749002:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+2752:3490:x1796714784498112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8648us (8698us total) trans 4295960693 rc 0/0 00000100:00100000:2.0:1713481296.749009:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563056 00010000:00010000:1.0:1713481296.749011:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a654240/0xdfc0fb148802322 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a8e expref: 20820 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.749016:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a654240/0xdfc0fb148802322 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a8e expref: 20820 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.749021:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784501632:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.749021:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+149:3493:x1796714784497792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9094us (9128us total) trans 4296040811 rc 0/0 00000100:00100000:3.0:1713481296.749028:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563053 00000100:00100000:1.0:1713481296.749030:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.749030:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882471552 00000100:00100000:2.0:1713481296.749033:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882471552 00000004:00080000:0.0:1713481296.749043:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081ec5f80/2, rc 0, transno 993397 00000100:00100000:1.0:1713481296.749043:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501568 00010000:00010000:2.0:1713481296.749043:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb1488022f8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a3a expref: 20821 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.749045:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501568 00000100:00100000:0.0:1713481296.749048:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784498112:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.749056:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82897 00000100:00100000:1.0:1713481296.749058:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784501568:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.749062:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.749070:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3a884 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a876 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.749071:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820295 00000100:00100000:2.0:1713481296.749076:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20821:1959:x1796714882471552:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.749079:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3a884 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a876 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.749081:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007712bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784501760:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.749082:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.749084:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3a884 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a876 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.749086:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb1488022f8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a3a expref: 20821 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.749088:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff8801354b6a00) 00010000:00010000:1.0:1713481296.749090:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.749091:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133a7f600, rc 0) 00010000:00010000:2.0:1713481296.749094:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb1488022f8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a3a expref: 20821 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.749097:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.749107:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784501568:12345-0@lo:101:mdt_io00_009.0 Request processed in 48us (154us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.749109:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb1488022f8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a3a expref: 20821 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.749110:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82897 00000100:00100000:3.0:1713481296.749137:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501760 00010000:00010000:2.0:1713481296.749140:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.749141:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.749141:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501760 00000100:00100000:0.0:1713481296.749142:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713481296.749144:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.749146:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784501696:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.749153:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784501568:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.749156:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.749161:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.749162:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.749162:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563087 00010000:00010000:1.0:1713481296.749167:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.749167:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2751:3490:x1796714784501760:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.749169:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1713481296.749180:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43308 count 1 00000100:00100000:2.0:1713481296.749181:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20820:1959:x1796714882471552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 104us (242us total) trans 0 rc 0/0 00000004:00080000:0.0:1713481296.749183:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094218000/2, rc 0, transno 993396 00000100:00100000:0.0:1713481296.749186:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784498432:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.749187:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820295 00010000:00010000:1.0:1713481296.749189:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.749192:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.749195:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00000004:00080000:0.0:1713481296.749196:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0e1180/2, rc 0, transno 1073515 00000100:00100000:0.0:1713481296.749199:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784497792:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.749202:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.749202:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e880/0xdfc0fb148688e04 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b72 expref: 26907 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.749209:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.749210:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.749213:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.749222:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007712b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784501824:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.749227:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784501952:0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.749230:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e880/0xdfc0fb148688e04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b72 expref: 26907 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.749231:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.749233:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713481296.749237:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007712aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784501888:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.749239:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e880/0xdfc0fb148688e04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b72 expref: 26907 pid: 16530 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.749246:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.749250:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784502016:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.749251:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.749255:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.749266:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.749271:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011dafc300 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.749275:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501696 00000100:00100000:2.0:1713481296.749278:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501696 00000100:00100000:1.0:1713481296.749279:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501952 00000100:00100000:1.0:1713481296.749282:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501952 00000100:00100000:0.0:1713481296.749284:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473024 00000100:00100000:0.0:1713481296.749287:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473024 00000100:00100000:2.0:1713481296.749291:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501824 00000100:00100000:2.0:1713481296.749293:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501824 00000100:00100000:1.0:1713481296.749297:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82898 00000100:00100000:1.0:1713481296.749300:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784501952:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.749301:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784501888 00000100:00100000:0.0:1713481296.749303:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784501888 00000100:00100000:2.0:1713481296.749304:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563088 00000100:00100000:2.0:1713481296.749309:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+2753:3492:x1796714784501696:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.749311:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563089 00000100:00100000:3.0:1713481296.749315:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20820:18792:x1796714882473024:12345-192.168.202.24@tcp:101:dir_create.sh.0 00002000:00080000:2.0:1713481296.749320:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43307 count 1 00000100:00100000:0.0:1713481296.749321:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563090 00010000:00010000:3.0:1713481296.749323:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.749326:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+149:3491:x1796714784501824:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.749329:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.749331:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a8a0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc513:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49563 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.749333:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784501952:12345-0@lo:1000:mdt_io00_009.0 Request processed in 32us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.749336:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82898 00002000:00080000:0.0:1713481296.749337:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9965 count 1 00010000:00010000:2.0:1713481296.749339:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091728240/0xdfc0fb148688dfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b64 expref: 26907 pid: 16537 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1713481296.749341:0:16463:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc513:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.749345:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.749347:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.749348:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.749348:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.749349:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.749349:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.749352:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49563 expref: 20821 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.749356:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563091 00010000:00010000:0.0:1713481296.749358:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148802329 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a9c expref: 20821 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.749359:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2753:3493:x1796714784501888:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.749359:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350f61c0/0xdfc0fb148a3a8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc513:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49563 expref: 20821 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.749364:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350f61c0, rc 0) 00002000:00080000:1.0:1713481296.749366:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43309 count 1 00010000:00010000:2.0:1713481296.749368:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091728240/0xdfc0fb148688dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b64 expref: 26907 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.749369:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.749370:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.749373:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.749374:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.749376:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20821:18792:x1796714882473024:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 60us (145us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.749377:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091728240/0xdfc0fb148688dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b64 expref: 26907 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.749382:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303dd680/0xdfc0fb148688e0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b80 expref: 26907 pid: 16503 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.749382:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563089 00010000:00010000:0.0:1713481296.749386:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148802329 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a9c expref: 20821 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.749386:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.749387:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.749387:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007796ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784502080:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.749389:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.749394:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148802329 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a9c expref: 20821 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.749401:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.749402:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077129500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784502144:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.749402:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303dd680/0xdfc0fb148688e0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b80 expref: 26907 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.749408:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303dd680/0xdfc0fb148688e0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b80 expref: 26907 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.749414:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784502208:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.749416:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.749426:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e003e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.749441:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784501952:0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.749441:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.749491:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784499392:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.749500:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784499456:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.749520:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a948240/0xdfc0fb148a3a7c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4952b expref: 24477 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.749522:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.749530:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a948240, rc 0) 00000100:00100000:0.0:1713481296.749543:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:10409:x1796714882471424:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4006us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.749547:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563069 00000100:00100000:2.0:1713481296.749547:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.749561:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473088 00000100:00100000:0.0:1713481296.749563:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473088 00000100:00100000:2.0:1713481296.749569:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.749587:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.749615:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882472960 00000100:00100000:3.0:1713481296.749619:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882472960 00000100:00100000:0.0:1713481296.749624:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563092 00000100:00100000:0.0:1713481296.749627:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16869:17009:x1796714882473088:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.749632:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133a87840/0xdfc0fb148a13e5b lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fb6 expref: 20821 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.749634:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.749644:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009654f180/0xdfc0fb148a3a8b5 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4956a expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.749656:0:16512:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.749660:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473216 00000100:00100000:3.0:1713481296.749663:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473216 00010000:00010000:0.0:1713481296.749677:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.749679:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.749684:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009654f180/0xdfc0fb148a3a8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4956a expref: 16870 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.749687:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801206cc6c0/0xdfc0fb14891d158 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6ec expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.749693:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009654f180/0xdfc0fb148a3a8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4956a expref: 16870 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.749695:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473152 00000100:00100000:2.0:1713481296.749698:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473152 00010000:00010000:0.0:1713481296.749700:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009654f180, rc 0) 00000100:00100000:3.0:1713481296.749708:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820296 00010000:00010000:2.0:1713481296.749709:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012050a1c0/0xdfc0fb14893ab21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3f5 expref: 26908 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.749713:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20821:1959:x1796714882472960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.749719:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16870:17009:x1796714882473088:12345-192.168.202.24@tcp:101:dd.0 Request processed in 89us (196us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.749721:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.749725:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563092 00000100:00100000:2.0:1713481296.749725:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820297 00000100:00100000:2.0:1713481296.749730:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1957:x1796714882473216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.749734:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133a87840/0xdfc0fb148a13e5b lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc176:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fb6 expref: 20821 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.749736:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.749741:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801206cc6c0/0xdfc0fb14891d158 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6ec expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.749743:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133a87840/0xdfc0fb148a13e5b lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc176:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fb6 expref: 20821 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.749750:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801206cc6c0/0xdfc0fb14891d158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6ec expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.749762:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206cc6c0/0xdfc0fb14891d158 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6ec expref: 24477 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.749765:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133a87840/0xdfc0fb148a13e5b lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc176:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fb6 expref: 20821 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.749776:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.749778:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.749779:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.749783:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f86e1c0/0xdfc0fb148a3a781 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4950f expref: 20820 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.749789:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f86e1c0/0xdfc0fb148a3a781 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4950f expref: 20820 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.749790:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:1957:x1796714882473216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.749796:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820297 00000100:00100000:2.0:1713481296.749810:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820298 00010000:00010000:3.0:1713481296.749811:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f86e1c0/0xdfc0fb148a3a781 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4950f expref: 20820 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.749814:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1957:x1796714882473152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.749819:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.749820:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784502272:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.749823:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012050a1c0/0xdfc0fb14893ab21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3f5 expref: 26908 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.749831:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012050a1c0/0xdfc0fb14893ab21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3f5 expref: 26908 pid: 16471 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.749839:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880088150900 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.749843:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012050a1c0/0xdfc0fb14893ab21 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db3f5 expref: 26908 pid: 16471 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.749856:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.749857:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.749860:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a948240/0xdfc0fb148a3a7c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4952b expref: 24475 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.749868:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784502336:0@lo:403:mdt_io00_009.0 00010000:00010000:2.0:1713481296.749868:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a948240/0xdfc0fb148a3a7c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4952b expref: 24475 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.749868:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784499520:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.749884:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007a948240/0xdfc0fb148a3a7c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4952b expref: 24475 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.749887:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.749889:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.749893:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a002a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784502400:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.749905:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.749906:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20820:1958:x1796714882471808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4180us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.749908:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.749914:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820275 00000100:00100000:0.0:1713481296.749929:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784502336 00010000:00010000:1.0:1713481296.749931:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.749933:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784502336 00010000:00010000:1.0:1713481296.749936:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.749943:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.749949:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.749954:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82899 00010000:00010000:1.0:1713481296.749955:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.749959:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+37:15514:x1796714784502336:12345-0@lo:403:mdt_io00_009.0 00010000:00010000:1.0:1713481296.749962:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206cc240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.749964:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.749970:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.749979:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.749985:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.749992:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801206cc240/0xdfc0fb148a3a765 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.750038:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784499840:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.750042:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784499584:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.750052:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.750060:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a94a880/0xdfc0fb148a3a7ea lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49540 expref: 26907 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750061:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.750065:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474112 00010000:00010000:1.0:1713481296.750066:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a94a880, rc 0) 00000100:00100000:2.0:1713481296.750067:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474112 00000100:00100000:1.0:1713481296.750076:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26907:11552:x1796714882472064:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3999us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.750080:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563072 00000100:00100000:2.0:1713481296.750088:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474176 00000100:00100000:2.0:1713481296.750089:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474176 00000100:00100000:1.0:1713481296.750097:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473344 00000100:00100000:1.0:1713481296.750100:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473344 00000100:00100000:3.0:1713481296.750100:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485816 00000100:00100000:2.0:1713481296.750105:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485817 00000100:00100000:3.0:1713481296.750106:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2018:18920:x1796714882474112:12345-192.168.202.24@tcp:101:mkdir.0 00000100:00100000:2.0:1713481296.750110:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2371:18729:x1796714882474176:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:1.0:1713481296.750115:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125678 00010000:00010000:2.0:1713481296.750134:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.750137:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2197:18904:x1796714882473344:12345-192.168.202.24@tcp:35:lfs.0 00010000:00010000:2.0:1713481296.750142:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080156d00/0xdfc0fb148a3a8bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49594 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750149:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.750159:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a8c3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4958d expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.750201:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080154000/0xdfc0fb148a3a8ca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x34c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00000100:00100000:1.0:1713481296.750203:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2198:18904:x1796714882473344:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 82us (614us total) trans 4295105913 rc 0/0 00000100:00100000:1.0:1713481296.750209:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125678 00010000:00010000:2.0:1713481296.750209:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880080154000/0xdfc0fb148a3a8ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x34c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.750216:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080154000/0xdfc0fb148a3a8ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x34c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00200000:2.0:1713481296.750222:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c1:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.750224:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.750230:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750235:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750240:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.750244:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750248:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.750256:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784499968:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.750269:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.750270:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080156d00/0xdfc0fb148a3a8bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49594 expref: 2374 pid: 15484 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.750280:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cbb:0x0]: returning size 4096 00010000:00010000:2.0:1713481296.750284:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880080154000/0xdfc0fb148a3a8ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x34c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49594 expref: 2373 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.750290:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c1:0x0].0x0 (ffff88009a9e1d00) 00010000:00010000:2.0:1713481296.750293:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713481296.750295:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080154000, rc 0) 00000100:00100000:1.0:1713481296.750298:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.750305:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473408 00000100:00100000:1.0:1713481296.750307:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473408 00000100:00100000:2.0:1713481296.750309:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2373:18729:x1796714882474176:12345-192.168.202.24@tcp:101:rm.0 Request processed in 198us (257us total) trans 4295107582 rc 0/0 00010000:00010000:3.0:1713481296.750312:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.750314:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485817 00010000:00010000:3.0:1713481296.750316:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.750319:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563093 00010000:00010000:3.0:1713481296.750320:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.750321:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24476:15045:x1796714882473408:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.750323:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750325:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096ca7cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.750326:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.750327:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750330:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.750333:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aa98d80/0xdfc0fb148a3a8ed lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49571 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750335:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.750337:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.750338:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00002000:00010000:1.0:1713481296.750341:0:16490:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.750341:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3a8d1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.750347:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.750348:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.750349:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.750350:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa98d80/0xdfc0fb148a3a8ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49571 expref: 24477 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750355:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.750356:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aa98d80/0xdfc0fb148a3a8ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49571 expref: 24477 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750358:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750360:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f85a400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.750361:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa98d80, rc 0) 00010000:00010000:3.0:1713481296.750362:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.750364:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.750364:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750368:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff8801314b4900) 00010000:00010000:3.0:1713481296.750369:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.750370:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:15045:x1796714882473408:12345-192.168.202.24@tcp:101:dd.0 Request processed in 48us (72us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.750370:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750373:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3a8df lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.750374:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563093 00000100:00100000:1.0:1713481296.750384:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473536 00000100:00100000:1.0:1713481296.750386:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473536 00000100:00100000:1.0:1713481296.750395:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563094 00010000:00010000:3.0:1713481296.750395:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a8c3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4958d expref: 2020 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.750397:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:10479:x1796714882473536:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.750399:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3a8c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4958d expref: 2020 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.750401:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.750406:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aa98900/0xdfc0fb148a3a8f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49578 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750406:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350f6400, rc 0) 00010000:00010000:1.0:1713481296.750414:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007995c6c0/0xdfc0fb148916d98 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c656f expref: 24478 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.750418:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.750419:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.750420:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2019:18920:x1796714882474112:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 314us (442us total) trans 4295107583 rc 301/301 00010000:00010000:1.0:1713481296.750421:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa98900/0xdfc0fb148a3a8f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49578 expref: 24478 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.750424:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485816 00010000:00010000:1.0:1713481296.750430:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007995c6c0/0xdfc0fb148916d98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c656f expref: 24478 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.750435:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007995c6c0/0xdfc0fb148916d98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c656f expref: 24478 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.750440:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784502464:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.750449:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.750450:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008324a300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.750468:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473664 00000100:00100000:3.0:1713481296.750471:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473664 00000100:00100000:3.0:1713481296.750483:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485818 00000100:00100000:3.0:1713481296.750486:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2019:18678:x1796714882473664:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.750491:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.750498:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a8fb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4957f expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750545:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a902 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.750550:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a902 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.750554:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a902 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00200000:3.0:1713481296.750569:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c36:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.750571:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713481296.750587:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3a8fb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4957f expref: 2021 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750596:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a902 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4957f expref: 2020 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.750600:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88008ad2f200) 00010000:00010000:3.0:1713481296.750602:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.750603:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b95200, rc 0) 00000100:00100000:3.0:1713481296.750632:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2020:18678:x1796714882473664:12345-192.168.202.24@tcp:101:rm.0 Request processed in 145us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.750638:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485818 00000100:00100000:2.0:1713481296.750771:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.750779:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+150:3493:x1796714784498816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9182us (9222us total) trans 4296040812 rc 0/0 00000100:00100000:3.0:1713481296.750785:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563062 00000100:00100000:2.0:1713481296.750788:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.750805:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.750814:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473600 00000100:00100000:2.0:1713481296.750817:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473600 00010000:00010000:2.0:1713481296.750828:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083639680/0xdfc0fb148802306 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a56 expref: 20820 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.750841:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473856 00000100:00100000:2.0:1713481296.750843:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473856 00010000:00010000:2.0:1713481296.750849:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb1488e7ea0 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0x8e96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54fb expref: 16870 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.750860:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473792 00000100:00100000:2.0:1713481296.750861:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473792 00010000:00010000:2.0:1713481296.750867:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e3840/0xdfc0fb1488022ff lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a48 expref: 20821 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.750879:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820299 00000100:00100000:2.0:1713481296.750884:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013499c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20821:1957:x1796714882473600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.750890:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.750893:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083639680/0xdfc0fb148802306 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a56 expref: 20821 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.750902:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083639680/0xdfc0fb148802306 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a56 expref: 20821 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.750917:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083639680/0xdfc0fb148802306 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a56 expref: 20821 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.750930:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.750932:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.750935:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.750942:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.750957:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.750978:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013499c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20820:1957:x1796714882473600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 94us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.750984:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820299 00000100:00100000:2.0:1713481296.750997:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820300 00000100:00100000:2.0:1713481296.751001:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013499ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16870:1957:x1796714882473856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.751007:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.751010:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb1488e7ea0 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0x8e96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54fb expref: 16870 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.751016:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.751018:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb1488e7ea0 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54fb expref: 16870 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.751030:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.751031:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.751035:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960ecd80/0xdfc0fb148a3a814 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4954e expref: 16870 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.751043:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960ecd80/0xdfc0fb148a3a814 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8e96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4954e expref: 16870 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.751057:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800960ecd80/0xdfc0fb148a3a814 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8e96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4954e expref: 16870 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.751066:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.751067:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013499ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784502528:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.751068:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473472 00000100:00100000:3.0:1713481296.751072:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473472 00000100:00100000:1.0:1713481296.751077:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.751085:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0840 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.751085:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007a0c0000/0xdfc0fb148959c21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc2 expref: 26907 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.751099:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473728 00000100:00100000:2.0:1713481296.751101:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473728 00000100:00100000:3.0:1713481296.751108:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820301 00010000:00010000:2.0:1713481296.751110:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e400/0xdfc0fb148688dda lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b1e expref: 26908 pid: 16530 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.751114:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20819:1959:x1796714882473792:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.751143:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.751150:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820302 00010000:00010000:3.0:1713481296.751150:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801302e3840/0xdfc0fb1488022ff lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a48 expref: 20819 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.751155:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1957:x1796714882473472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.751159:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820303 00010000:00010000:3.0:1713481296.751161:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801302e3840/0xdfc0fb1488022ff lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a48 expref: 20819 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.751162:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.751163:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1957:x1796714882473728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.751168:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.751172:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e400/0xdfc0fb148688dda lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa926:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b1e expref: 26908 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.751173:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007a0c0000/0xdfc0fb148959c21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc2 expref: 26908 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.751178:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e400/0xdfc0fb148688dda lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa926:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b1e expref: 26908 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.751179:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.751181:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.751183:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007a0c0000/0xdfc0fb148959c21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc2 expref: 26908 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.751184:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751189:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e400/0xdfc0fb148688dda lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa926:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b1e expref: 26908 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.751192:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751199:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.751200:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.751202:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.751202:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a0c0000/0xdfc0fb148959c21 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc2 expref: 26907 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.751206:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751208:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.751211:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.751213:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.751216:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a94a880/0xdfc0fb148a3a7ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49540 expref: 26906 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751218:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.751224:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a94a880/0xdfc0fb148a3a7ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49540 expref: 26906 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.751228:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20819:1959:x1796714882473792:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 113us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.751232:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26906:1957:x1796714882473728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.751236:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820301 00000100:00100000:1.0:1713481296.751239:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820303 00010000:00010000:2.0:1713481296.751239:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007a94a880/0xdfc0fb148a3a7ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49540 expref: 26906 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.751247:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075440380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784502592:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.751256:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751260:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751261:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.751263:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff880132ad23c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.751265:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751268:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751269:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751272:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751275:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a949f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.751276:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751277:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751281:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751283:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751288:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751290:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751292:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3a806 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751296:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095c918c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.751299:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751306:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751319:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.751331:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095c918c0/0xdfc0fb148a3a7f8 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.751337:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e406300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784500672:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.751354:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.751400:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2754:3493:x1796714784499776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5090us (5120us total) trans 4295960694 rc 0/0 00000100:00100000:1.0:1713481296.751404:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563075 00000100:00100000:1.0:1713481296.751415:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882473920 00000100:00100000:1.0:1713481296.751417:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882473920 00000100:00100000:1.0:1713481296.751427:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563095 00000100:00100000:1.0:1713481296.751430:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16871:17935:x1796714882473920:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.751434:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.751442:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d0f4fc0/0xdfc0fb148a3a909 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49586 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.751450:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.751457:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.751458:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.751460:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d0f4fc0/0xdfc0fb148a3a909 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49586 expref: 16872 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751466:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d0f4fc0/0xdfc0fb148a3a909 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49586 expref: 16872 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751470:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d0f4fc0, rc 0) 00000100:00100000:3.0:1713481296.751473:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+150:3491:x1796714784499712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5200us (5257us total) trans 4296040813 rc 0/0 00000100:00100000:3.0:1713481296.751480:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563073 00000004:00080000:2.0:1713481296.751483:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009421b480/2, rc 0, transno 1073517 00000100:00100000:1.0:1713481296.751485:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16872:17935:x1796714882473920:12345-192.168.202.24@tcp:101:dd.0 Request processed in 54us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.751489:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563095 00000100:00100000:2.0:1713481296.751491:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009421b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784499712:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.751517:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784500096:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.751517:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.751517:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16553:1796714784500160:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.751523:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784502656:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.751535:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.751535:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.751542:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.751545:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20818:1959:x1796714882470400:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4950us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.751550:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820278 00000100:00100000:3.0:1713481296.751555:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086966300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20818:1959:x1796714882471232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4804us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.751561:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820284 00000100:00100000:2.0:1713481296.751600:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e406680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784500480:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.751610:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784500736:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.751615:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751631:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.751640:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784502656 00000100:00100000:1.0:1713481296.751642:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784502656 00000100:00100000:1.0:1713481296.751656:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563096 00000100:00100000:1.0:1713481296.751659:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+150:3492:x1796714784502656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.751684:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9966 count 1 00010000:00010000:1.0:1713481296.751695:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.751697:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ae8e00/2, rc 0, transno 993398 00010000:00010000:1.0:1713481296.751704:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c111f80/0xdfc0fb148802330 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962aaa expref: 20816 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.751708:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784499776:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.751710:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.751712:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.751714:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751729:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c111f80/0xdfc0fb148802330 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962aaa expref: 20816 pid: 16529 timeout: 0 lvb_type: 1 00000004:00080000:3.0:1713481296.751729:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009421a680/2, rc 0, transno 1073516 00010000:00010000:1.0:1713481296.751741:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c111f80/0xdfc0fb148802330 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962aaa expref: 20816 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.751745:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009421a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784498816:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.751748:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784502720:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.751763:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d4f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.751768:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713481296.751775:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784502784:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.751780:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784500864:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.751792:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.751800:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.751815:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784502784 00000100:00100000:2.0:1713481296.751818:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784502848:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.751818:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784502784 00000100:00100000:1.0:1713481296.751821:0:6936:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7bb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6936:1796714784501056:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.751832:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.751839:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784502848 00000100:00100000:3.0:1713481296.751841:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784502848 00010000:00010000:1.0:1713481296.751843:0:6936:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 37 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.751850:0:6936:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x0 (ffff880083123100) 00010000:00010000:1.0:1713481296.751853:0:6936:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.751857:0:6936:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 37 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.751858:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563097 00000100:00100000:3.0:1713481296.751862:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+151:3491:x1796714784502784:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.751863:0:6936:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801304b0d80, rc 0) 00000100:00100000:2.0:1713481296.751873:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00080000:3.0:1713481296.751875:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9967 count 1 00010000:00010000:3.0:1713481296.751886:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.751888:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+37:15642:x1796714784500928:12345-0@lo:101:mdt00_029.0 Request processed in 3997us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.751893:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82896 00010000:00010000:3.0:1713481296.751902:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099bedf80/0xdfc0fb148802337 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ab8 expref: 20816 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.751909:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.751910:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.751913:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.751920:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.751922:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784500544:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.751930:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099bedf80/0xdfc0fb148802337 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ab8 expref: 20816 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.751934:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.751940:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099bedf80/0xdfc0fb148802337 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ab8 expref: 20816 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.751942:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.751948:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.751952:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784502912:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.751955:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474368 00000100:00100000:1.0:1713481296.751957:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474368 00000100:00100000:2.0:1713481296.751959:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.751969:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125679 00000100:00100000:1.0:1713481296.751971:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2198:18893:x1796714882474368:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:3.0:1713481296.751975:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800985c7840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.751978:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.751994:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474240 00000100:00100000:3.0:1713481296.751997:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474240 00000100:00100000:3.0:1713481296.752014:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474816 00000100:00100000:3.0:1713481296.752016:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474816 00000100:00100000:2.0:1713481296.752020:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.752033:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474880 00000100:00100000:2.0:1713481296.752035:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.752035:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474880 00000100:00100000:3.0:1713481296.752048:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563098 00000100:00100000:3.0:1713481296.752053:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2754:3491:x1796714784502848:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.752055:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2199:18893:x1796714882474368:12345-192.168.202.24@tcp:35:touch.0 Request processed in 82us (135us total) trans 4295105914 rc 0/0 00000100:00100000:1.0:1713481296.752059:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125679 00000100:00100000:2.0:1713481296.752059:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00080000:3.0:1713481296.752064:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43310 count 1 00000100:00100000:2.0:1713481296.752070:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474432 00000100:00100000:2.0:1713481296.752073:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474432 00010000:00010000:3.0:1713481296.752076:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752083:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474688 00010000:00010000:2.0:1713481296.752084:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303ded00/0xdfc0fb148688de8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b3a expref: 26907 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.752085:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474688 00010000:00010000:1.0:1713481296.752091:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e1b00/0xdfc0fb148802314 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a72 expref: 20817 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.752092:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9f180/0xdfc0fb148688e19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b95 expref: 26907 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.752096:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474560 00000100:00100000:2.0:1713481296.752098:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474560 00010000:00010000:3.0:1713481296.752100:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.752102:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.752103:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474624 00000100:00100000:1.0:1713481296.752104:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474624 00010000:00010000:3.0:1713481296.752104:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752106:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091728900/0xdfc0fb148688de1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b2c expref: 26908 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.752110:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303df600/0xdfc0fb148688def lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b48 expref: 26909 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.752116:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474496 00000100:00100000:1.0:1713481296.752117:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474496 00000100:00100000:2.0:1713481296.752134:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820304 00010000:00010000:1.0:1713481296.752137:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a654b40/0xdfc0fb14880230d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a64 expref: 20818 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.752139:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26909:1960:x1796714882474432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.752146:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820305 00010000:00010000:2.0:1713481296.752146:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.752148:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ff9f180/0xdfc0fb148688e19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b95 expref: 26909 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.752149:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20818:1960:x1796714882474688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.752150:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303ded00/0xdfc0fb148688de8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa928:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b3a expref: 26909 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.752153:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.752155:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801302e1b00/0xdfc0fb148802314 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a72 expref: 20818 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.752157:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ff9f180/0xdfc0fb148688e19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b95 expref: 26909 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.752159:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303ded00/0xdfc0fb148688de8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa928:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b3a expref: 26909 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.752161:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801302e1b00/0xdfc0fb148802314 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a72 expref: 20818 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.752168:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784502976:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.752172:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801302e1b00/0xdfc0fb148802314 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a72 expref: 20818 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.752175:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303ded00/0xdfc0fb148688de8 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa928:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b3a expref: 26909 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.752179:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.752180:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.752182:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752186:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752186:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.752187:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.752189:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94e40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.752190:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752197:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.752197:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752210:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20817:1960:x1796714882474688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.752214:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820305 00000100:00100000:3.0:1713481296.752214:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563099 00010000:00010000:2.0:1713481296.752216:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.752219:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ded3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:18817:x1796714882474240:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713481296.752227:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820306 00010000:00010000:3.0:1713481296.752227:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.752230:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1960:x1796714882474560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.752232:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1960:x1796714882474432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (296us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.752234:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.752237:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091728900/0xdfc0fb148688de1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa927:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b2c expref: 26908 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.752237:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a925 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4959b expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752238:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820304 00010000:00010000:1.0:1713481296.752246:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091728900/0xdfc0fb148688de1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa927:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b2c expref: 26909 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.752253:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d28240/0xdfc0fb1489cf951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa221f5 expref: 24478 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752254:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820307 00010000:00010000:1.0:1713481296.752256:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091728900/0xdfc0fb148688de1 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa927:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b2c expref: 26908 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.752258:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26908:1957:x1796714882474624:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.752264:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.752265:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.752265:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.752266:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.752266:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.752268:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752269:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303df600/0xdfc0fb148688def lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa929:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b48 expref: 26907 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.752270:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a925 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4959b expref: 26907 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752272:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752278:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303df600/0xdfc0fb148688def lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa929:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b48 expref: 26907 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.752280:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.752286:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d28240/0xdfc0fb1489cf951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa221f5 expref: 24478 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752290:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26907:1960:x1796714882474560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (331us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.752290:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303df600/0xdfc0fb148688def lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa929:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b48 expref: 26907 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.752294:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820306 00010000:00010000:3.0:1713481296.752295:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d28240/0xdfc0fb1489cf951 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa221f5 expref: 24478 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.752298:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.752300:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.752302:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.752305:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784503040:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.752306:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820308 00000100:00100000:1.0:1713481296.752308:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20816:1957:x1796714882474496:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.752309:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752312:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.752315:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a654b40/0xdfc0fb14880230d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a64 expref: 20816 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.752319:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a654b40/0xdfc0fb14880230d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a64 expref: 20816 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.752321:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.752325:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.752328:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a654b40/0xdfc0fb14880230d lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a64 expref: 20816 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.752336:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26905:1957:x1796714882474624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (300us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.752338:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.752339:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.752340:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752342:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820307 00000100:00100000:3.0:1713481296.752343:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563100 00010000:00010000:1.0:1713481296.752344:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.752348:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16873:18836:x1796714882474816:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.752353:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.752355:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.752362:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20815:1957:x1796714882474496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (304us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.752363:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752365:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092279d40/0xdfc0fb148a3a92c lrc: 2/0,0 mode: --/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495a2 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752366:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820308 00010000:00010000:2.0:1713481296.752370:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752377:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752379:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752380:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081d6bcc0/0xdfc0fb14891e865 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb563 expref: 20814 pid: 16500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752384:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752384:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752387:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.752388:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752388:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.752390:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752391:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092279d40/0xdfc0fb148a3a92c lrc: 4/0,0 mode: --/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495a2 expref: 16874 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752392:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752396:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133b99680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.752398:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752399:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752403:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013625cb40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.752404:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752405:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752408:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752408:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081d6bcc0/0xdfc0fb14891e865 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb563 expref: 20814 pid: 16500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752416:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752416:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752417:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081d6bcc0/0xdfc0fb14891e865 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb563 expref: 20814 pid: 16500 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.752420:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3a84c lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752426:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133b99680/0xdfc0fb148a3a830 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.752426:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784503104:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.752442:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.752462:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563101 00000100:00100000:3.0:1713481296.752467:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16874:18844:x1796714882474880:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.752474:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.752485:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a933 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495a9 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.752498:0:16541:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.752508:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.752510:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.752514:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a933 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495a9 expref: 16875 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752525:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009227a880/0xdfc0fb148a3a933 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495a9 expref: 16875 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752531:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+152:3492:x1796714784500608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5158us (5221us total) trans 4296040814 rc 0/0 00010000:00010000:3.0:1713481296.752533:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009227a880, rc 0) 00000100:00100000:1.0:1713481296.752537:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563082 00000100:00100000:2.0:1713481296.752538:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2755:3493:x1796714784500288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5422us (5476us total) trans 4295960695 rc 0/0 00000100:00100000:2.0:1713481296.752544:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563079 00000100:00100000:3.0:1713481296.752548:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16875:18844:x1796714882474880:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 80us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.752555:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563101 00010000:00010000:1.0:1713481296.752563:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752570:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752577:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.752579:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086965f80/2, rc 0, transno 1073518 00010000:00010000:1.0:1713481296.752584:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752585:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784500608:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.752589:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752593:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801304b2f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.752594:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752598:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.752607:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752609:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784503168:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.752611:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3a853 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752626:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.752649:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784503168 00000100:00100000:3.0:1713481296.752654:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784503168 00010000:00010000:2.0:1713481296.752657:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752676:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.752683:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.752689:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563102 00010000:00010000:2.0:1713481296.752690:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.752694:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+153:3492:x1796714784503168:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.752696:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.752703:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784502336:12345-0@lo:403:mdt_io00_009.0 Request processed in 2743us (2813us total) trans 0 rc 0/0 00002000:00080000:3.0:1713481296.752706:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9968 count 1 00010000:00010000:2.0:1713481296.752707:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013625e400 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.752710:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82899 00010000:00010000:2.0:1713481296.752710:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752714:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+153:3492:x1796714784500800:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5156us (5194us total) trans 4296040815 rc 0/0 00010000:00010000:2.0:1713481296.752717:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752717:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752719:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563083 00010000:00010000:3.0:1713481296.752727:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077239440/0xdfc0fb14880233e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ac6 expref: 20814 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.752729:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752733:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.752735:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013625e400/0xdfc0fb148a3a83e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.752735:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.752737:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.752749:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784502336:0@lo:403:mdt_io00_009.0 00010000:00010000:3.0:1713481296.752753:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077239440/0xdfc0fb14880233e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ac6 expref: 20814 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.752761:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077239440/0xdfc0fb14880233e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ac6 expref: 20814 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.752769:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784503232:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.752777:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb1488e7ea0 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b54fb expref: 16874 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.752782:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.752790:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086966a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784500032:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.752805:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960ecd80/0xdfc0fb148a3a814 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8e96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4954e expref: 16873 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.752813:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960ecd80, rc 0) 00000100:00100000:0.0:1713481296.752827:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007dc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16873:8499:x1796714882472576:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6366us (6407us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.752833:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563077 00000100:00100000:2.0:1713481296.752839:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2755:3491:x1796714784500416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5641us (5697us total) trans 4295960696 rc 0/0 00000100:00100000:2.0:1713481296.752845:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563080 00010000:00010000:0.0:1713481296.752866:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801302e3840/0xdfc0fb1488022ff lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a48 expref: 20814 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.752872:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fe7b800/2, rc 0, transno 993400 00000100:00100000:0.0:1713481296.752878:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d254700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784499904:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.752887:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784500416:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.752892:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.752899:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.752905:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.752907:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fe79500/2, rc 0, transno 1073519 00010000:00010000:0.0:1713481296.752912:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752912:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784500800:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.752916:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.752922:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784503296:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.752924:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.752938:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.752970:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784503360:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.752985:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.753014:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.753014:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fe7b480/2, rc 0, transno 993399 00010000:00010000:0.0:1713481296.753021:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a26d4fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.753025:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753028:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784500288:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.753032:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753039:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784503296 00000100:00100000:2.0:1713481296.753042:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784503296 00010000:00010000:0.0:1713481296.753044:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.753050:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3a7ff lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753057:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784503360 00000100:00100000:2.0:1713481296.753059:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784503360 00000100:00100000:3.0:1713481296.753069:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563103 00000100:00100000:2.0:1713481296.753075:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563104 00000100:00100000:3.0:1713481296.753076:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2755:3492:x1796714784503296:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.753079:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+153:3490:x1796714784503360:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.753087:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43311 count 1 00002000:00080000:2.0:1713481296.753090:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9969 count 1 00010000:00010000:2.0:1713481296.753099:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.753099:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.753109:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303de1c0/0xdfc0fb148688e3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ba3 expref: 26904 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.753110:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c111440/0xdfc0fb148802345 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ad4 expref: 20813 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.753115:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.753116:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.753117:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.753133:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.753136:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.753140:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753152:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c111440/0xdfc0fb148802345 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ad4 expref: 20813 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.753156:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303de1c0/0xdfc0fb148688e3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ba3 expref: 26904 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.753161:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c111440/0xdfc0fb148802345 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ad4 expref: 20813 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.753165:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303de1c0/0xdfc0fb148688e3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ba3 expref: 26904 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.753170:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784503488:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.753175:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784503552:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.753184:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081d246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.753194:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.753196:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753203:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753210:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753216:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.753220:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+154:3491:x1796714784499648:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6934us (6980us total) trans 4296040816 rc 0/0 00010000:00010000:2.0:1713481296.753222:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.753227:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563074 00010000:00010000:2.0:1713481296.753228:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133b9b180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.753230:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753237:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753249:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753255:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133b9b180/0xdfc0fb148a3a845 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753363:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2756:3491:x1796714784500352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6115us (6199us total) trans 4295960697 rc 0/0 00000100:00100000:2.0:1713481296.753370:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563081 00000100:00100000:3.0:1713481296.753381:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.753389:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784503424:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.753409:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.753422:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.753446:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784503424 00000100:00100000:2.0:1713481296.753449:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784503424 00000004:00080000:3.0:1713481296.753453:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fe7a300/2, rc 0, transno 993401 00000100:00100000:3.0:1713481296.753457:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784500352:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.753458:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474752 00000100:00100000:0.0:1713481296.753462:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474752 00000100:00100000:2.0:1713481296.753463:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563105 00000100:00100000:2.0:1713481296.753467:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2756:3490:x1796714784503424:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.753468:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094218a80/2, rc 0, transno 1073520 00000100:00100000:3.0:1713481296.753472:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784499648:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.753473:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4af40/0xdfc0fb148a37b9e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479b0 expref: 2020 pid: 15576 timeout: 815 lvb_type: 0 00002000:00080000:2.0:1713481296.753478:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43312 count 1 00010000:00010000:2.0:1713481296.753487:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.753492:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820309 00000100:00100000:0.0:1713481296.753496:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2020:1957:x1796714882474752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.753497:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff7a400/0xdfc0fb148688e43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa930:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bb1 expref: 26904 pid: 16451 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.753497:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.753502:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784503616:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.753503:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.753503:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.753504:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.753506:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4af40/0xdfc0fb148a37b9e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479b0 expref: 2020 pid: 15576 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.753507:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.753513:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4af40/0xdfc0fb148a37b9e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479b0 expref: 2020 pid: 15576 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.753515:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.753521:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff7a400/0xdfc0fb148688e43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa930:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bb1 expref: 26904 pid: 16451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.753525:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4af40/0xdfc0fb148a37b9e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa479b0 expref: 2020 pid: 15576 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.753529:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff7a400/0xdfc0fb148688e43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa930:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bb1 expref: 26904 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.753539:0:16568:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x0 (ffff880083123100) 00010000:00010000:0.0:1713481296.753543:0:16568:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753544:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784503680:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.753551:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.753556:0:16568:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753557:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081d24600 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.753570:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 35 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.753577:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d254700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001_UUID:16568:1796714784503744:0@lo:105: 00000100:00100000:3.0:1713481296.753595:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784503808:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.753597:0:16568:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.753623:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089874000 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.753626:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.753641:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.753643:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784503616 00000100:00100000:0.0:1713481296.753647:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784503616 00000100:00100000:3.0:1713481296.753653:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784503744 00000100:00100000:3.0:1713481296.753655:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784503744 00000100:00100000:0.0:1713481296.753681:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784503808 00000100:00100000:3.0:1713481296.753681:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20396 00000100:00100000:0.0:1713481296.753684:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784503808 00000100:00100000:3.0:1713481296.753685:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16568:x1796714784503744:12345-0@lo:105: 00000100:00100000:2.0:1713481296.753689:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563106 00010000:00010000:3.0:1713481296.753691:0:6917:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 4/0,1 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753694:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2757:3493:x1796714784503616:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.753697:0:6917:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 4/0,1 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.753701:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563107 00010000:00010000:3.0:1713481296.753701:0:6917:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 4/0,1 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.753705:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+154:3493:x1796714784503808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.753705:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43313 count 1 00010000:00010000:3.0:1713481296.753705:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.753709:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.753713:0:6917:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753714:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.753715:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9970 count 1 00010000:00010000:0.0:1713481296.753724:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753724:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135480000/0xdfc0fb148688e4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bbf expref: 26904 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.753729:0:6917:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800960ef600) 00010000:00010000:2.0:1713481296.753731:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.753732:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.753733:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099bef600/0xdfc0fb14880234c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ae2 expref: 20813 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.753734:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.753739:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.753740:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.753743:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753748:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135480000/0xdfc0fb148688e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bbf expref: 26904 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.753752:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16568:x1796714784503744:12345-0@lo:105: Request processed in 66us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.753756:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099bef600/0xdfc0fb14880234c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ae2 expref: 20813 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.753756:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135480000/0xdfc0fb148688e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bbf expref: 26904 pid: 16530 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.753756:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20396 00010000:00010000:0.0:1713481296.753763:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099bef600/0xdfc0fb14880234c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ae2 expref: 20813 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.753765:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784503872:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.753771:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784503936:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.753778:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081d24b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.753790:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d254700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001_UUID:16568:1796714784503744:0@lo:105: 00000100:00100000:0.0:1713481296.753795:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.753806:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.753811:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476160 00000100:00100000:0.0:1713481296.753814:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476160 00000100:00100000:2.0:1713481296.753820:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076af5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784501184:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.753821:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2020:1957:x1796714882474752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 324us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.753826:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820309 00000100:00100000:0.0:1713481296.753834:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485819 00010000:00010000:2.0:1713481296.753838:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.753839:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2019:18678:x1796714882476160:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:0.0:1713481296.753850:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.753850:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20813:1959:x1796714882470592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5621us (5741us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.753857:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009654f840/0xdfc0fb148a3a964 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495da expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.753857:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820289 00010000:00010000:1.0:1713481296.753886:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.753894:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.753897:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.753899:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.753900:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079bceac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.753901:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.753904:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.753909:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff8801354b6300) 00010000:00010000:1.0:1713481296.753911:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.753912:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.753915:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079bceac0/0xdfc0fb148a3a88b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000004:00200000:0.0:1713481296.753920:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c36:0x0]: returning size 4096 00000100:00100000:3.0:1713481296.753921:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476032 00000100:00100000:3.0:1713481296.753924:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476032 00010000:00010000:1.0:1713481296.753929:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753933:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753937:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.753945:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485820 00010000:00010000:1.0:1713481296.753947:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1713481296.753948:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2022:18913:x1796714882476032:12345-192.168.202.24@tcp:101:lfs.0 00000004:00080000:1.0:1713481296.753949:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000404:0x3474:0x0] 00010000:00010000:1.0:1713481296.753952:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.753955:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.753956:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753956:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.753959:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.753961:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a972 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495d3 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753962:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753965:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713481296.753968:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133a7db00 already unused, calling callback (ffffffffa0efd520) 00000004:00080000:1.0:1713481296.753969:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:0.0:1713481296.753970:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009654f840/0xdfc0fb148a3a964 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495da expref: 2023 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753971:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753972:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753975:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.753978:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009654f840/0xdfc0fb148a3a964 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495da expref: 2023 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753978:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.753979:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753983:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1713481296.753985:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:1.0:1713481296.753986:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.753990:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.753991:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009654f840, rc 0) 00010000:00010000:1.0:1713481296.753993:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.753996:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754001:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1713481296.754001:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.754003:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.754006:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2022:18678:x1796714882476160:12345-192.168.202.24@tcp:101:rm.0 Request processed in 166us (365us total) trans 4295107584 rc 301/301 00010000:00010000:1.0:1713481296.754006:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.754009:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.754011:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009670aac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.754012:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.754012:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 1/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.754013:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485819 00010000:00010000:1.0:1713481296.754015:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.754015:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.754018:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880133a7db00/0xdfc0fb148a3a876 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a884 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754021:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88008fe2ab00) 00010000:00010000:3.0:1713481296.754021:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.754023:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.754026:0:15514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 12 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754027:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.754032:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 12 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754033:0:15565:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1713481296.754035:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.754036:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1713481296.754037:0:15565:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754038:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 12 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.754039:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754042:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.754044:0:15565:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cce0b40 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:3.0:1713481296.754045:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.754047:0:15565:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.754048:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009670a880 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.754051:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.754054:0:15565:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754054:0:15514:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 12 pid: 6936 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.754057:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.754067:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.754068:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d11f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15514:1796714784504064:0@lo:105: 00010000:00010000:2.0:1713481296.754072:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713481296.754074:0:15565:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.754076:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.754077:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2caf:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.754080:0:15565:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.754081:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009670a880/0xdfc0fb148a3a4a9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a4b7 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754092:0:15565:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 1/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.754095:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.754099:0:15565:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009cce0b40/0xdfc0fb148a3a5ac lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a5b3 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.754102:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713481296.754102:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.754105:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754105:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.754106:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085d9f6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.754109:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.754110:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f875200 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:3.0:1713481296.754112:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.754113:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754115:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086afdd40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.754116:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000004:00010000:2.0:1713481296.754135:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754140:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.754141:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.754142:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.754143:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784501248:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.754144:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.754145:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.754147:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.754148:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.754149:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.754152:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713481296.754152:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086afdd40/0xdfc0fb148a3a979 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.754155:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.754158:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.754159:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784504192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.754160:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754164:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.754166:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009f875200/0xdfc0fb148a3a551 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a558 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754167:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.754170:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.754173:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801346b2400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.754174:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.754176:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784500928:0@lo:101:mdt00_029.0 00010000:00010000:3.0:1713481296.754177:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.754180:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff880089167000) 00010000:00010000:3.0:1713481296.754181:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.754183:0:15642:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754183:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.754184:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.754184:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.754185:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.754185:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b2400/0xdfc0fb148a3a980 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.754187:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1713481296.754192:0:15642:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x1d3:0x0] 00010000:00010000:2.0:1713481296.754192:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.754195:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.754202:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.754202:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504192 00000100:00100000:2.0:1713481296.754204:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504192 00000100:00100000:0.0:1713481296.754205:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008409d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784504256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.754206:0:15642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.754210:0:15642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.754214:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a972 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495d3 expref: 2022 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.754217:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db800 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784504320:0@lo:101:mdt00_029.0 00010000:00010000:3.0:1713481296.754218:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff840/0xdfc0fb148a3a972 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495d3 expref: 2022 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.754219:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.754220:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98355 00000100:00100000:2.0:1713481296.754224:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+36:3493:x1796714784504192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.754225:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086aff840, rc 0) 00010000:00010000:2.0:1713481296.754230:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.754233:0:15642:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.754238:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2021:18913:x1796714882476032:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 288us (339us total) trans 4295107585 rc 301/301 00010000:00010000:2.0:1713481296.754239:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086aff3c0/0xdfc0fb148a3a5b3 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a5ac expref: 36 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.754242:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085d9f900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.754244:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485820 00000100:00100000:0.0:1713481296.754247:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504256 00000100:00100000:0.0:1713481296.754250:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504256 00000100:00100000:1.0:1713481296.754251:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504320 00010000:00010000:2.0:1713481296.754252:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009bd22300) 00000100:00100000:1.0:1713481296.754253:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504320 00010000:00010000:2.0:1713481296.754263:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.754267:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82900 00000100:00100000:1.0:1713481296.754270:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+37:15642:x1796714784504320:12345-0@lo:101:mdt00_029.0 00000100:00100000:3.0:1713481296.754270:0:6916:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1713481296.754271:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98356 00000100:00100000:0.0:1713481296.754275:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+37:3493:x1796714784504256:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.754275:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504064 00010000:00010000:1.0:1713481296.754276:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.754278:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504064 00010000:00010000:0.0:1713481296.754281:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.754283:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009430d440/0xdfc0fb148a3a995 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a98e expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.754287:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+37:3493:x1796714784504192:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.754290:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20397 00010000:00010000:0.0:1713481296.754292:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009f877600/0xdfc0fb148a3a558 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a551 expref: 38 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754292:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009430d440/0xdfc0fb148a3a995 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a98e expref: 38 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.754293:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98355 00000100:00100000:3.0:1713481296.754294:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15514:x1796714784504064:12345-0@lo:105: 00010000:00010000:1.0:1713481296.754298:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009430d440/0xdfc0fb148a3a995 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a98e expref: 37 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754299:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754302:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880079a55700) 00010000:00010000:1.0:1713481296.754302:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x37 (ffff880096325400) 00010000:00010000:1.0:1713481296.754303:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.754304:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009430d440, rc 0) 00010000:00010000:3.0:1713481296.754304:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754309:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754311:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.754312:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754316:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.754320:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784504192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.754320:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.754322:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:15642:x1796714784504320:12345-0@lo:101:mdt00_029.0 Request processed in 51us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.754326:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82900 00010000:00010000:3.0:1713481296.754331:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8801206cdd40) 00000100:00100000:0.0:1713481296.754337:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+35:3493:x1796714784504256:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.754337:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008409d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784504256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.754342:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98356 00010000:00010000:1.0:1713481296.754342:0:15793:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754347:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.754355:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15514:x1796714784504064:12345-0@lo:105: Request processed in 60us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.754359:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20397 00000004:00080000:1.0:1713481296.754360:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1713481296.754430:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.754451:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.754454:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.754458:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.754466:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504384:0@lo:101:mdt_io00_014.0 00000100:00100000:3.0:1713481296.754474:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784504000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.754490:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.754491:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784501632:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.754494:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.754495:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.754498:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085d9fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.754509:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.754512:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784504128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.754513:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.754514:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db800 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784504320:0@lo:101:mdt00_029.0 00010000:00010000:1.0:1713481296.754522:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.754523:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.754526:0:15642:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.754536:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076af6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784501312:192.168.202.24@tcp:105: 00000004:00080000:1.0:1713481296.754537:0:15642:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x1d3:0x0] 00000100:00100000:0.0:1713481296.754539:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504000 00000100:00100000:0.0:1713481296.754542:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504000 00000100:00100000:1.0:1713481296.754548:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081564e00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784504448:0@lo:1000:mdt00_029.0 00010000:00010000:2.0:1713481296.754551:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.754552:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476864 00000100:00100000:3.0:1713481296.754554:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476864 00000100:00100000:0.0:1713481296.754559:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504128 00000100:00100000:0.0:1713481296.754562:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504128 00000100:00100000:1.0:1713481296.754562:0:15642:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.754564:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1959:x1796714882470464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6222us (6470us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.754566:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485821 00000100:00100000:1.0:1713481296.754568:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.754569:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008409d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2021:18952:x1796714882476864:12345-192.168.202.24@tcp:101:touch.0 00000100:00100000:2.0:1713481296.754570:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820291 00010000:00010000:3.0:1713481296.754575:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.754576:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504384 00010000:00010000:3.0:1713481296.754576:0:15475:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1713481296.754578:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504384 00000100:00100000:0.0:1713481296.754580:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98357 00010000:00010000:3.0:1713481296.754584:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078c43180/0xdfc0fb148a3a6f5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa494d0 expref: 2021 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.754585:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+36:3490:x1796714784504000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.754587:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504448 00000100:00100000:1.0:1713481296.754588:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504448 00010000:00010000:0.0:1713481296.754591:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.754594:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82901 00000100:00100000:1.0:1713481296.754597:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15793:x1796714784504384:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.754597:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff88009c9ea400) 00010000:00010000:0.0:1713481296.754599:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3a884 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3899:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a876 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754601:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.754607:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3a9a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a99c expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.754607:0:15475:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.754612:0:14813:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3899:0x0].0x0 (ffff8801354b6a00) 00010000:00010000:3.0:1713481296.754612:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880083549d40/0xdfc0fb148a3a9aa lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49604 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754615:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3a9a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a99c expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754618:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.754618:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98358 00010000:00010000:1.0:1713481296.754621:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3a9a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a99c expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.754622:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+36:3490:x1796714784504128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.754625:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.754627:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.754628:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa2ac0, rc 0) 00010000:00010000:2.0:1713481296.754628:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.754637:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009670b3c0/0xdfc0fb148a3a4b7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a4a9 expref: 36 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.754649:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:15793:x1796714784504384:12345-0@lo:101:mdt_io00_014.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.754650:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+35:3490:x1796714784504000:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.754650:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:1.0:1713481296.754652:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82901 00010000:00010000:2.0:1713481296.754653:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.754656:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98357 00000100:00100000:1.0:1713481296.754684:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82902 00000100:00100000:1.0:1713481296.754687:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+35:15642:x1796714784504448:12345-0@lo:1000:mdt00_029.0 00010000:00010000:3.0:1713481296.754690:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.754691:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+35:3490:x1796714784504128:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (166us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.754696:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.754697:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98358 00010000:00010000:3.0:1713481296.754700:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.754707:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097633840/0xdfc0fb148a3a9b8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c6f:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.754713:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097633840/0xdfc0fb148a3a9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c6f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.754714:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882474944 00000100:00100000:0.0:1713481296.754717:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882474944 00010000:00010000:3.0:1713481296.754717:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097633840/0xdfc0fb148a3a9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c6f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.754721:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+33:15642:x1796714784504448:12345-0@lo:1000:mdt00_029.0 Request processed in 33us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.754725:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82902 00000100:00100000:0.0:1713481296.754732:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563108 00000100:00100000:0.0:1713481296.754737:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008409c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:17924:x1796714882474944:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.754746:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.754746:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007dc8a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504384:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.754753:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754755:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009654d8c0/0xdfc0fb148a3a9bf lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495b0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754758:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.754762:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086965500 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784504512:0@lo:1000:mdt00_011.0 00000004:00080000:1.0:1713481296.754768:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713481296.754769:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800977b0b40/0xdfc0fb148a16250 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39821 expref: 24479 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.754774:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.754776:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.754777:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.754779:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009654d8c0/0xdfc0fb148a3a9bf lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495b0 expref: 24479 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.754780:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.754784:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.754792:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007796ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784502080:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.754794:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800977b0b40/0xdfc0fb148a16250 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39821 expref: 24479 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.754794:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504576:0@lo:101:mdt_io00_014.0 00010000:00010000:0.0:1713481296.754802:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800977b0b40/0xdfc0fb148a16250 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39821 expref: 24479 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.754805:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.754808:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.754811:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784504640:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.754811:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.754828:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784501504:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.754829:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.754839:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.754843:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.754855:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941d900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.754858:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504576 00000100:00100000:0.0:1713481296.754861:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504576 00000100:00100000:1.0:1713481296.754861:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504512 00000100:00100000:1.0:1713481296.754863:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504512 00000100:00100000:0.0:1713481296.754881:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82903 00000100:00100000:3.0:1713481296.754881:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784504128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.754885:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784504576:12345-0@lo:101:mdt_io00_014.0 00000100:00100000:3.0:1713481296.754888:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784504000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.754891:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82904 00010000:00010000:0.0:1713481296.754892:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.754894:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15475:x1796714784504512:12345-0@lo:1000:mdt00_011.0 00010000:00010000:0.0:1713481296.754901:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122ad3180/0xdfc0fb148a3a9cd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3a9c6 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.754916:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784502016:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.754918:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122ad3180/0xdfc0fb148a3a9cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3a9c6 expref: 16 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754926:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880122ad3180/0xdfc0fb148a3a9cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3a9c6 expref: 16 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754932:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff880081510c00) 00010000:00010000:3.0:1713481296.754932:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.754934:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.754936:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ad3180, rc 0) 00000100:00100000:0.0:1713481296.754968:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:15793:x1796714784504576:12345-0@lo:101:mdt_io00_014.0 Request processed in 81us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.754972:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.754973:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82903 00000100:00100000:0.0:1713481296.755006:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504576:0@lo:101:mdt_io00_014.0 00010000:00010000:0.0:1713481296.755016:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.755020:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15475:x1796714784504512:12345-0@lo:1000:mdt00_011.0 Request processed in 122us (178us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.755023:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.755025:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086965500 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784504512:0@lo:1000:mdt00_011.0 00000100:00100000:1.0:1713481296.755026:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82904 00000004:00080000:0.0:1713481296.755037:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:2.0:1713481296.755046:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a002a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784502400:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.755055:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504704:0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.755059:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784502208:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.755060:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.755075:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.755075:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26904:1957:x1796714882473152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5260us (5506us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.755077:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.755081:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820298 00000100:00100000:1.0:1713481296.755088:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504704 00000100:00100000:1.0:1713481296.755090:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504704 00000100:00100000:0.0:1713481296.755092:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.755105:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82905 00000100:00100000:1.0:1713481296.755108:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784504704:12345-0@lo:1000:mdt_io00_014.0 00000100:00100000:0.0:1713481296.755145:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077129500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784502144:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.755160:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.755160:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784504704:12345-0@lo:1000:mdt_io00_014.0 Request processed in 50us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.755164:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82905 00000100:00100000:2.0:1713481296.755175:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013499ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784502528:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.755187:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784502464:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.755192:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.755195:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504704:0@lo:1000:mdt_io00_014.0 00010000:00010000:1.0:1713481296.755201:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aa98900/0xdfc0fb148a3a8f4 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49578 expref: 24479 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.755204:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013499ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16872:1957:x1796714882473856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4201us (4415us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.755208:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa98900, rc 0) 00000100:00100000:2.0:1713481296.755210:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820300 00000100:00100000:1.0:1713481296.755221:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10479:x1796714882473536:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4822us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.755224:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563094 00000100:00100000:0.0:1713481296.755235:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504768:0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.755236:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475200 00000100:00100000:1.0:1713481296.755237:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475200 00000100:00100000:1.0:1713481296.755247:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563109 00000100:00100000:1.0:1713481296.755249:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20813:18792:x1796714882475200:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.755252:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.755253:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.755260:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121aa33c0/0xdfc0fb148a3a9d4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc514:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495b7 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.755267:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bb40 going to sleep for 11 seconds 00002000:00010000:1.0:1713481296.755268:0:16490:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc514:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.755274:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.755275:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.755278:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa33c0/0xdfc0fb148a3a9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495b7 expref: 20814 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.755279:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.755283:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504768 00010000:00010000:1.0:1713481296.755284:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121aa33c0/0xdfc0fb148a3a9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc514:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495b7 expref: 20814 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.755286:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504768 00010000:00010000:1.0:1713481296.755288:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa33c0, rc 0) 00000100:00100000:0.0:1713481296.755301:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82906 00000100:00100000:1.0:1713481296.755301:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20814:18792:x1796714882475200:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.755305:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784504768:12345-0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.755305:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563109 00000100:00100000:2.0:1713481296.755316:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.755317:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475520 00000100:00100000:1.0:1713481296.755318:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475520 00000100:00100000:1.0:1713481296.755327:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563110 00000100:00100000:1.0:1713481296.755329:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013499ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16872:17009:x1796714882475520:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.755333:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.755338:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121aa1b00/0xdfc0fb148a3a9db lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495be expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.755338:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:3.0:1713481296.755342:0:15475:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba51:0x0], index 1: 0 00002000:00010000:1.0:1713481296.755345:0:16490:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.755350:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.755351:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.755353:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa1b00/0xdfc0fb148a3a9db lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495be expref: 16873 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.755354:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784504768:12345-0@lo:1000:mdt_io00_014.0 Request processed in 48us (101us total) trans 0 rc 1/1 00010000:00010000:1.0:1713481296.755359:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121aa1b00/0xdfc0fb148a3a9db lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495be expref: 16873 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.755360:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82906 00000100:00100000:2.0:1713481296.755360:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.755363:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa1b00, rc 0) 00000100:00100000:1.0:1713481296.755373:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013499ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16873:17009:x1796714882475520:12345-192.168.202.24@tcp:101:dd.0 Request processed in 43us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.755377:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563110 00000100:00100000:0.0:1713481296.755379:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475712 00000100:00100000:0.0:1713481296.755381:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475712 00000100:00100000:2.0:1713481296.755381:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.755392:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475648 00000100:00100000:1.0:1713481296.755394:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475648 00000100:00100000:0.0:1713481296.755395:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563111 00000100:00100000:0.0:1713481296.755398:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20814:15045:x1796714882475712:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.755400:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800976318c0/0xdfc0fb148a3a9e2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.755401:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.755404:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.755405:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475904 00010000:00010000:3.0:1713481296.755406:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800976318c0/0xdfc0fb148a3a9e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.755407:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475904 00010000:00010000:3.0:1713481296.755411:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800976318c0/0xdfc0fb148a3a9e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.755412:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ad2f40/0xdfc0fb148a3a9e9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495c5 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.755414:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125680 00000100:00100000:1.0:1713481296.755418:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2199:18904:x1796714882475648:12345-192.168.202.24@tcp:33:lfs.0 00002000:00010000:0.0:1713481296.755422:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.755423:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.755427:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.755429:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.755430:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.755430:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.755433:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075440380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784502592:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.755433:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.755434:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ad2f40/0xdfc0fb148a3a9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495c5 expref: 20815 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.755435:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a26d7600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.755437:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.755440:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.755444:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff88008316fb00) 00010000:00010000:3.0:1713481296.755445:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.755446:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ad2f40/0xdfc0fb148a3a9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495c5 expref: 20815 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.755447:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.755448:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.755449:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a26d7600/0xdfc0fb148a3a9b1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.755453:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ad2f40, rc 0) 00000004:00200000:1.0:1713481296.755460:0:15494:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51a8:0x0]: returning size 4096 00000004:00010000:3.0:1713481296.755460:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008409d880 reply state ffff880072850000 transno 4295107586 ns: mdt-lustre-MDT0001_UUID lock: ffff880097633840/0xdfc0fb148a3a9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c6f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.755461:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26903:1957:x1796714882473472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4305us (4445us total) trans 0 rc 0/0 00000004:00200000:1.0:1713481296.755462:0:15494:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713481296.755467:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20815:15045:x1796714882475712:12345-192.168.202.24@tcp:101:dd.0 Request processed in 68us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.755467:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820302 00010000:00010000:3.0:1713481296.755467:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097633840/0xdfc0fb148a3a9b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c6f:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.755472:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563111 00010000:00010000:3.0:1713481296.755472:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x35 (ffff88008316f700) 00010000:00010000:3.0:1713481296.755475:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.755477:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.755482:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476224 00000100:00100000:0.0:1713481296.755484:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476224 00000100:00100000:1.0:1713481296.755485:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2199:18904:x1796714882475648:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 66us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.755489:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125680 00000100:00100000:0.0:1713481296.755495:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563112 00000100:00100000:0.0:1713481296.755499:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16873:11388:x1796714882476224:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.755502:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880083549d40/0xdfc0fb148a3a9aa lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2c6f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49604 expref: 2024 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.755505:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.755513:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ad18c0/0xdfc0fb148a3a9f7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495e1 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.755520:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800976318c0/0xdfc0fb148a3a9e2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49604 expref: 2023 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.755526:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095dad440/0xdfc0fb148942180 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b1 expref: 20814 pid: 15559 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.755526:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbc:0x0].0x0 (ffff8800907b5600) 00010000:00010000:3.0:1713481296.755529:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713481296.755531:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.755531:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800976318c0, rc 0) 00010000:00010000:0.0:1713481296.755533:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.755536:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ad18c0/0xdfc0fb148a3a9f7 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e1 expref: 16874 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.755540:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125681 00000100:00100000:1.0:1713481296.755543:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2024:18920:x1796714882475904:12345-192.168.202.24@tcp:35:mkdir.0 00010000:00010000:0.0:1713481296.755551:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095dad440/0xdfc0fb148942180 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b1 expref: 20814 pid: 15559 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.755557:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008409d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2024:18952:x1796714882476864:12345-192.168.202.24@tcp:101:touch.0 Request processed in 986us (1127us total) trans 4295107586 rc 0/0 00000100:00100000:3.0:1713481296.755564:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485821 00010000:00010000:0.0:1713481296.755565:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095dad440/0xdfc0fb148942180 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b1 expref: 20814 pid: 15559 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.755574:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784504832:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.755581:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475776 00000100:00100000:3.0:1713481296.755584:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475776 00000100:00100000:2.0:1713481296.755590:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.755594:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.755605:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2024:18920:x1796714882475904:12345-192.168.202.24@tcp:35:mkdir.0 Request processed in 60us (223us total) trans 4295107587 rc 0/0 00000100:00100000:1.0:1713481296.755609:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125681 00000100:00100000:3.0:1713481296.755610:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476352 00000100:00100000:3.0:1713481296.755613:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476352 00000100:00100000:2.0:1713481296.755623:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485822 00000100:00100000:0.0:1713481296.755626:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504768:0@lo:1000:mdt_io00_014.0 00000100:00100000:2.0:1713481296.755629:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2199:18828:x1796714882475776:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713481296.755636:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485823 00010000:00010000:2.0:1713481296.755637:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.755640:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2373:18729:x1796714882476352:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:1.0:1713481296.755645:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784502720:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.755645:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080155440/0xdfc0fb148a3a9fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495cc expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.755658:0:15475:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713481296.755679:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.755685:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504896:0@lo:1000:mdt_io00_014.0 00010000:00010000:3.0:1713481296.755687:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801305fba80/0xdfc0fb148a2f9b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42fe3 expref: 2373 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.755707:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.755709:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081564e00 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784504448:0@lo:1000:mdt00_029.0 00010000:00010000:3.0:1713481296.755711:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c4:0x0].0x0 (ffff88009652ea00) 00010000:00010000:2.0:1713481296.755713:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755721:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.755724:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801329bbd80 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.755728:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755728:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801305cdf80/0xdfc0fb148a383af lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47c6c expref: 2372 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.755737:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.755738:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504896 00000100:00100000:0.0:1713481296.755741:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504896 00010000:00010000:3.0:1713481296.755741:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c1:0x0].0x0 (ffff88009a9e1d00) 00010000:00010000:2.0:1713481296.755743:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755744:0:15475:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.755747:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae8700 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784504960:0@lo:1000:mdt00_029.0 00010000:00010000:2.0:1713481296.755749:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755756:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.755757:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82907 00000100:00100000:0.0:1713481296.755761:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784504896:12345-0@lo:1000:mdt_io00_014.0 00010000:00010000:3.0:1713481296.755762:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.755768:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094003180/0xdfc0fb148a3aa1a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755768:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.755774:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094003180/0xdfc0fb148a3aa1a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755779:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b90b40/0xdfc0fb148a3aa21 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x34c1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.755780:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094003180/0xdfc0fb148a3aa1a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755784:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b90b40/0xdfc0fb148a3aa21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.755789:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b90b40/0xdfc0fb148a3aa21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00010000:2.0:1713481296.755790:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094003180/0xdfc0fb148a3aa1a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755797:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755802:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755808:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.755812:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784504896:12345-0@lo:1000:mdt_io00_014.0 Request processed in 50us (105us total) trans 0 rc 1/1 00010000:00010000:2.0:1713481296.755814:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.755815:0:15642:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.755818:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82907 00010000:00010000:2.0:1713481296.755819:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080155680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.755821:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.755824:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.755826:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755827:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.755830:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784504960 00000100:00100000:0.0:1713481296.755832:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784504960 00010000:00010000:2.0:1713481296.755832:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.755834:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.755835:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.755837:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.755840:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.755842:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82908 00010000:00010000:2.0:1713481296.755842:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080155680/0xdfc0fb148a3aa05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.755843:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d11f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000_UUID:15514:1796714784504064:0@lo:105: 00000100:00100000:0.0:1713481296.755846:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15642:x1796714784504960:12345-0@lo:1000:mdt00_029.0 00010000:00010000:2.0:1713481296.755852:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755857:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.755858:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.755862:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009670aac0/0xdfc0fb148a3a4a2 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.755862:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755867:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080155d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.755869:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755877:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.755883:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff88011d25c300) 00010000:00010000:2.0:1713481296.755885:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.755887:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.755890:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18869:x1796714882464064:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 24952us (25196us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713481296.755891:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080155d40/0xdfc0fb148a3aa0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.755894:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26102 00010000:00010000:2.0:1713481296.755918:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080155440/0xdfc0fb148a3a9fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495cc expref: 2201 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.755924:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.755929:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094003180/0xdfc0fb148a3aa1a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495cc expref: 2200 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.755935:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476416 00010000:00010000:2.0:1713481296.755935:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff880131402e00) 00010000:00010000:2.0:1713481296.755936:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1713481296.755937:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476416 00010000:00010000:2.0:1713481296.755938:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094003180, rc 0) 00000100:00100000:1.0:1713481296.755947:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563113 00000100:00100000:0.0:1713481296.755950:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15642:x1796714784504960:12345-0@lo:1000:mdt00_029.0 Request processed in 102us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.755950:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10409:x1796714882476416:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.755954:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.755955:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2200:18828:x1796714882475776:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 326us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.755956:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82908 00010000:00010000:1.0:1713481296.755960:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121aa0900/0xdfc0fb148a3aa2f lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495e8 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.755960:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485822 00000040:00080000:3.0:1713481296.755962:0:15475:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31885, 64 off2048832 00010000:00010000:1.0:1713481296.755970:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008372af40/0xdfc0fb14891d437 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6f3 expref: 24480 pid: 15498 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.755976:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080382f40/0xdfc0fb14893ab83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db403 expref: 26902 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.755979:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.755980:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.755982:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa0900/0xdfc0fb148a3aa2f lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e8 expref: 24480 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.755987:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784504896:0@lo:1000:mdt_io00_014.0 00010000:00010000:1.0:1713481296.755991:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080382f40/0xdfc0fb14893ab83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db403 expref: 26902 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.755999:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080382f40/0xdfc0fb14893ab83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db403 expref: 26902 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.756004:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784505024:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.756007:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.756014:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.756020:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008372af40/0xdfc0fb14891d437 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6f3 expref: 24480 pid: 15498 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.756021:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.756024:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008372af40/0xdfc0fb14891d437 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6f3 expref: 24480 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.756026:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00000100:00100000:1.0:1713481296.756029:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784505152:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.756030:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.756032:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00010000:00010000:3.0:1713481296.756035:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.756036:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085d9f6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.756038:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00010000:00010000:3.0:1713481296.756039:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.756044:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.756048:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784505088:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.756048:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084b918c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.756051:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.756056:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae8700 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784504960:0@lo:1000:mdt00_029.0 00010000:00010000:3.0:1713481296.756057:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.756063:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c4:0x0].0x0 (ffff880091f28900) 00010000:00010000:3.0:1713481296.756065:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1713481296.756067:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.756068:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.756068:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.756073:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b918c0/0xdfc0fb148a3aa36 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x34c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.756081:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475008 00000100:00100000:2.0:1713481296.756084:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475008 00000100:00100000:0.0:1713481296.756085:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a900 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.756094:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c110fc0/0xdfc0fb14880231b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a80 expref: 20815 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.756098:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505088 00010000:00010000:3.0:1713481296.756099:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.756101:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505088 00010000:00010000:3.0:1713481296.756104:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.756109:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.756112:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820310 00010000:00010000:3.0:1713481296.756114:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084b93cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.756116:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.756117:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82909 00000100:00100000:2.0:1713481296.756117:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20815:1959:x1796714882475008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.756139:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.756144:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:15793:x1796714784505088:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:2.0:1713481296.756144:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c110fc0/0xdfc0fb14880231b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a80 expref: 20815 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.756146:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.756152:0:6936:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.756153:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c110fc0/0xdfc0fb14880231b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a80 expref: 20815 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.756153:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c4:0x0].0x0 (ffff880091f28900) 00010000:00010000:3.0:1713481296.756155:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713481296.756158:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.756162:0:6936:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013300d680/0xdfc0fb148a3aa44 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3aa3d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.756163:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b93cc0/0xdfc0fb148a3aa28 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.756170:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c110fc0/0xdfc0fb14880231b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a80 expref: 20815 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.756175:0:6936:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013300d680/0xdfc0fb148a3aa44 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3aa3d expref: 16 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756179:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.756181:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.756184:0:6936:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013300d680/0xdfc0fb148a3aa44 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3aa3d expref: 16 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756184:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.756187:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299c380 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784505216:0@lo:1000:mdt00_029.0 00010000:00010000:0.0:1713481296.756190:0:6936:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88012ba92b00) 00010000:00010000:2.0:1713481296.756191:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756192:0:6936:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.756194:0:6936:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013300d680, rc 0) 00000100:00100000:1.0:1713481296.756202:0:15642:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.756206:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.756211:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.756220:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20814:1959:x1796714882475008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 102us (153us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.756221:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.756226:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:15793:x1796714784505088:12345-0@lo:101:mdt_io00_014.0 Request processed in 81us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.756226:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.756226:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820310 00000100:00100000:0.0:1713481296.756231:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82909 00010000:00010000:1.0:1713481296.756231:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756236:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756240:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756243:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801304b2400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.756244:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.756245:0:6936:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505216 00000100:00100000:0.0:1713481296.756247:0:6936:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505216 00010000:00010000:1.0:1713481296.756248:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756260:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756263:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3a868 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.756265:0:6936:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82910 00000100:00100000:0.0:1713481296.756269:0:6936:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15642:x1796714784505216:12345-0@lo:1000:mdt00_029.0 00010000:00010000:3.0:1713481296.756273:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.756279:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.756284:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.756285:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.756289:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.756293:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084b91200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.756296:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.756297:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475136 00000100:00100000:2.0:1713481296.756299:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475136 00010000:00010000:3.0:1713481296.756302:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.756308:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff78b40/0xdfc0fb148688df6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b56 expref: 26903 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.756312:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c1:0x0].0x0 (ffff88009a9e1d00) 00000100:00100000:0.0:1713481296.756313:0:6936:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+33:15642:x1796714784505216:12345-0@lo:1000:mdt00_029.0 Request processed in 44us (109us total) trans 0 rc 1/1 00010000:00010000:3.0:1713481296.756315:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.756317:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.756318:0:6936:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82910 00000100:00100000:2.0:1713481296.756322:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820311 00010000:00010000:3.0:1713481296.756322:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b91200/0xdfc0fb148a3aa13 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x34c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.756326:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26903:1959:x1796714882475136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.756332:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1713481296.756333:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880078183800 reply state ffff88009ded0000 transno 4295107588 ns: mdt-lustre-MDT0001_UUID lock: ffff880084b90b40/0xdfc0fb148a3aa21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34c1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.756335:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff78b40/0xdfc0fb148688df6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b56 expref: 26903 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.756340:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b90b40/0xdfc0fb148a3aa21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34c1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.756343:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff78b40/0xdfc0fb148688df6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b56 expref: 26903 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.756346:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c1:0x0].0x3331 (ffff880092f52100) 00010000:00010000:3.0:1713481296.756348:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.756350:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713481296.756356:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+155:3491:x1796714784500992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8040us (8427us total) trans 4296040817 rc 0/0 00010000:00010000:2.0:1713481296.756356:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff78b40/0xdfc0fb148688df6 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b56 expref: 26903 pid: 16451 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.756360:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563084 00010000:00010000:2.0:1713481296.756367:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.756368:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.756371:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756378:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.756379:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2373:18729:x1796714882476352:12345-192.168.202.24@tcp:36:rm.0 Request processed in 736us (788us total) trans 4295107588 rc 0/0 00000100:00100000:3.0:1713481296.756386:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485823 00000004:00080000:1.0:1713481296.756391:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800785a9f80/2, rc 0, transno 1073521 00010000:00010000:2.0:1713481296.756391:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.756396:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784500992:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.756402:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1959:x1796714882475136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.756406:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756411:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.756412:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820311 00010000:00010000:1.0:1713481296.756415:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756419:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756422:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756426:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133a7c900 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.756426:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784502272:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.756427:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756431:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756439:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756443:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3a86f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa92a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.756444:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.756459:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20813:1959:x1796714882472960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6746us (7018us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.756467:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820296 00000100:00100000:2.0:1713481296.756473:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784505280:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.756490:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.756532:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784505088:0@lo:101:mdt_io00_014.0 00010000:00010000:0.0:1713481296.756542:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.756545:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.756549:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.756557:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2758:3490:x1796714784501376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7745us (7899us total) trans 4295960698 rc 0/0 00000100:00100000:1.0:1713481296.756562:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563085 00010000:00010000:0.0:1713481296.756568:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000004:00080000:2.0:1713481296.756570:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800785a8700/2, rc 0, transno 993402 00010000:00010000:0.0:1713481296.756574:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.756577:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505280 00000100:00100000:2.0:1713481296.756577:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784501376:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.756578:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505280 00010000:00010000:0.0:1713481296.756580:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.756588:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563114 00000100:00100000:1.0:1713481296.756590:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+155:3490:x1796714784505280:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.756594:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.756599:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00002000:00080000:1.0:1713481296.756599:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9971 count 1 00000100:00100000:2.0:1713481296.756601:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.756606:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784505408:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.756608:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756609:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.756616:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784505344:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.756619:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880079aaa1c0/0xdfc0fb14880235a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962af0 expref: 20812 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.756622:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.756625:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.756626:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.756629:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.756637:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.756637:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475328 00000100:00100000:3.0:1713481296.756640:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475328 00010000:00010000:1.0:1713481296.756645:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880079aaa1c0/0xdfc0fb14880235a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962af0 expref: 20812 pid: 16470 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.756649:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.756654:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880079aaa1c0/0xdfc0fb14880235a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962af0 expref: 20812 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.756657:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091728240/0xdfc0fb148688dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b64 expref: 26902 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.756661:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505408 00000100:00100000:1.0:1713481296.756676:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784505472:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.756678:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505408 00000100:00100000:2.0:1713481296.756684:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.756691:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.756694:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563115 00000100:00100000:0.0:1713481296.756698:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2758:3490:x1796714784505408:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.756702:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475456 00000100:00100000:3.0:1713481296.756705:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475456 00002000:00080000:0.0:1713481296.756708:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43314 count 1 00000100:00100000:1.0:1713481296.756712:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505344 00000100:00100000:1.0:1713481296.756714:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505344 00010000:00010000:0.0:1713481296.756716:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.756717:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820312 00010000:00010000:3.0:1713481296.756717:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303dd680/0xdfc0fb148688e0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b80 expref: 26903 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.756723:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26903:1959:x1796714882475328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.756725:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303dd440/0xdfc0fb148688e58 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bcd expref: 26903 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.756731:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.756731:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.756732:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82911 00010000:00010000:0.0:1713481296.756733:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.756735:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.756735:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:15793:x1796714784505344:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:2.0:1713481296.756735:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091728240/0xdfc0fb148688dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b64 expref: 26903 pid: 16537 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.756736:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820313 00010000:00010000:1.0:1713481296.756740:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.756742:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26903:1959:x1796714882475456:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.756745:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091728240/0xdfc0fb148688dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b64 expref: 26903 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.756747:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3aa67 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3aa52 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.756749:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.756750:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303dd440/0xdfc0fb148688e58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bcd expref: 26903 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.756753:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303dd680/0xdfc0fb148688e0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b80 expref: 26903 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.756756:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3aa67 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3aa52 expref: 17 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756759:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303dd440/0xdfc0fb148688e58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bcd expref: 26903 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.756761:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091728240/0xdfc0fb148688dfd lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b64 expref: 26903 pid: 16537 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.756762:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3aa67 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3aa52 expref: 17 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.756763:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303dd680/0xdfc0fb148688e0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b80 expref: 26903 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.756766:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff8800969b6c00) 00010000:00010000:1.0:1713481296.756767:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.756769:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa3600, rc 0) 00010000:00010000:2.0:1713481296.756772:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.756773:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784505536:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.756774:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.756776:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.756780:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303dd680/0xdfc0fb148688e0b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b80 expref: 26902 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.756783:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.756789:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008af5a900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.756790:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:15793:x1796714784505344:12345-0@lo:101:mdt_io00_014.0 Request processed in 55us (153us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.756791:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.756793:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.756794:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82911 00010000:00010000:3.0:1713481296.756797:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756801:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.756803:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.756813:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26901:1959:x1796714882475328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.756817:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820312 00000100:00100000:1.0:1713481296.756820:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784505344:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.756820:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.756827:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756831:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756831:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756837:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.756837:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26900:1959:x1796714882475456:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 94us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.756838:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756842:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.756843:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820313 00010000:00010000:1.0:1713481296.756845:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.756846:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756846:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756849:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.756850:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756853:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.756853:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756857:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080157840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.756858:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756865:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756872:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.756876:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080157840/0xdfc0fb148a3a899 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa92b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.756883:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784502912:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.756891:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756895:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756898:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756901:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa0480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.756902:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756905:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:3.0:1713481296.756906:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756909:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff88007c296300) 00010000:00010000:1.0:1713481296.756911:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.756912:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756915:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3aa6e lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756928:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756930:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756932:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756936:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756939:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756941:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079bccb40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.756944:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756946:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713481296.756948:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756949:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756951:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756955:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.756960:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756960:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1713481296.756962:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756964:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.756966:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3a8ae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa92d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756967:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756970:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300fa80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.756971:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756974:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.756975:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+2759:3492:x1796714784501696:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7665us (7813us total) trans 4295960699 rc 0/0 00010000:00010000:1.0:1713481296.756978:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88009a8a5d00) 00000100:00100000:2.0:1713481296.756979:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563088 00010000:00010000:1.0:1713481296.756980:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1713481296.756981:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.756984:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3aa4b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000004:00080000:3.0:1713481296.756990:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077129880/2, rc 0, transno 993403 00000004:00080000:1.0:1713481296.756992:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:1.0:1713481296.756994:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.756997:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.756999:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784501696:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.757001:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757014:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:1.0:1713481296.757015:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:1.0:1713481296.757017:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757017:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1713481296.757020:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757021:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757024:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300cfc0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.757025:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757027:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757031:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00010000:2.0:1713481296.757031:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757033:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.757034:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784505600:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.757039:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757042:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757042:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757046:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.757047:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1713481296.757053:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 1/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.757055:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.757059:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300cfc0/0xdfc0fb148a3aa52 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa67 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.757066:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2372:18874:x1796714882470208:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 14049us (14099us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.757070:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26104 00010000:00010000:2.0:1713481296.757079:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1713481296.757079:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713481296.757082:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.757084:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2759:3493:x1796714784501888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7722us (7827us total) trans 4295960700 rc 0/0 00000100:00100000:3.0:1713481296.757084:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784505664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.757086:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300d8c0 already unused, calling callback (ffffffffa0efd520) 00000100:00100000:0.0:1713481296.757089:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563091 00010000:00010000:2.0:1713481296.757089:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.757095:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.757101:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.757106:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1713481296.757109:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757110:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757112:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009430df80 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.757114:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757115:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00010000:1.0:1713481296.757133:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757143:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 1/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.757143:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505664 00010000:00010000:1.0:1713481296.757144:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.757146:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505664 00010000:00010000:1.0:1713481296.757148:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.757150:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013300d8c0/0xdfc0fb148a3aa3d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa44 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757153:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757156:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009430df80/0xdfc0fb148a3a99c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a9a3 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.757165:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98359 00010000:00010000:2.0:1713481296.757167:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1713481296.757169:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+17:3492:x1796714784505664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.757170:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757174:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.757175:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.757176:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.757178:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa18c0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.757179:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801206cdd40 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.757180:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757181:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.757184:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.757186:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.757186:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3aa67 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3aa52 expref: 17 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757190:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.757193:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505600 00010000:00010000:1.0:1713481296.757193:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.757199:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757200:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757202:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801206cdd40/0xdfc0fb148a3a788 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a78f expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757204:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713481296.757207:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff8800969b6c00) 00010000:00010000:2.0:1713481296.757210:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757214:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880121aa18c0/0xdfc0fb148a3a9c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a9cd expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757220:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.757221:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.757221:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.757223:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.757229:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784505792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.757230:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.757231:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.757233:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.757238:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.757240:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713481296.757246:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+16:3492:x1796714784505664:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.757247:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.757248:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784505728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.757253:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98359 00000100:00100000:3.0:1713481296.757264:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505792 00000100:00100000:3.0:1713481296.757266:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505792 00000100:00100000:0.0:1713481296.757271:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505600 00000100:00100000:2.0:1713481296.757272:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.757273:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299c380 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784505216:0@lo:1000:mdt00_029.0 00000100:00100000:3.0:1713481296.757280:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505728 00000100:00100000:3.0:1713481296.757282:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505728 00000100:00100000:0.0:1713481296.757290:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563116 00000100:00100000:3.0:1713481296.757292:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98360 00000100:00100000:0.0:1713481296.757294:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2759:3492:x1796714784505600:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.757296:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+17:3491:x1796714784505792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.757300:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.757300:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.757303:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784505920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.757304:0:15642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15642 initiator: MDT0 00002000:00080000:0.0:1713481296.757305:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43315 count 1 00010000:00010000:3.0:1713481296.757306:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3a9a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a99c expref: 17 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757308:0:15642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15642 initiator: MDT0 00000100:00100000:1.0:1713481296.757314:0:15642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299c380 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784505984:0@lo:101:mdt00_029.0 00010000:00010000:0.0:1713481296.757316:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.757316:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.757321:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.757322:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.757326:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0b40/0xdfc0fb148688e5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bdb expref: 26899 pid: 16451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.757332:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.757333:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713481296.757335:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007712aa00/2, rc 0, transno 993404 00010000:00010000:0.0:1713481296.757336:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.757338:0:15642:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.757341:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007712aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784501888:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.757346:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.757349:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784505856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.757349:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+16:3491:x1796714784505792:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (102us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.757351:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0b40/0xdfc0fb148688e5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bdb expref: 26899 pid: 16451 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.757352:0:15642:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099d5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.757354:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98360 00010000:00010000:0.0:1713481296.757359:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0b40/0xdfc0fb148688e5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bdb expref: 26899 pid: 16451 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.757361:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505920 00000100:00100000:3.0:1713481296.757363:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505920 00000100:00100000:1.0:1713481296.757366:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505984 00000100:00100000:2.0:1713481296.757366:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.757368:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784506048:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.757369:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505984 00000100:00100000:3.0:1713481296.757374:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784505856 00000100:00100000:3.0:1713481296.757376:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784505856 00000100:00100000:0.0:1713481296.757382:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081d24540 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.757383:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98361 00000100:00100000:1.0:1713481296.757388:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82912 00000100:00100000:2.0:1713481296.757388:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3490:x1796714784505728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.757391:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.757393:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.757394:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+33:15642:x1796714784505984:12345-0@lo:101:mdt00_029.0 00000100:00100000:3.0:1713481296.757394:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98362 00000100:00100000:3.0:1713481296.757397:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+17:3493:x1796714784505920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.757401:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013300d680/0xdfc0fb148a3aa44 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3aa3d expref: 17 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757402:0:15522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.757402:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.757403:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98363 00000100:00100000:0.0:1713481296.757408:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0001-mdtlov_UUID+16:3493:x1796714784505856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.757408:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122ad3180/0xdfc0fb148a3a9cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a9c6 expref: 16 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757411:0:15522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0b40/0xdfc0fb148a3aa83 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3aa75 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757412:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88012ba92b00) 00010000:00010000:0.0:1713481296.757415:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.757417:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.757424:0:15522:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0b40/0xdfc0fb148a3aa83 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3aa75 expref: 34 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.757424:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff880081510c00) 00010000:00010000:0.0:1713481296.757425:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801206cd440/0xdfc0fb148a3a78f lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a788 expref: 15 pid: 6936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757431:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0b40/0xdfc0fb148a3aa83 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3aa75 expref: 34 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.757432:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3490:x1796714784505728:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.757433:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.757435:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff880124c21f00) 00000100:00100000:2.0:1713481296.757435:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98361 00010000:00010000:1.0:1713481296.757436:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.757438:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa0b40, rc 0) 00010000:00010000:0.0:1713481296.757440:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88008fe2ab00) 00010000:00010000:0.0:1713481296.757449:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.757459:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0001-mdtlov_UUID+13:3493:x1796714784505920:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.757462:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784505728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.757465:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+34:15642:x1796714784505984:12345-0@lo:101:mdt00_029.0 Request processed in 73us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.757466:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98362 00000100:00100000:1.0:1713481296.757469:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82912 00000100:00100000:2.0:1713481296.757479:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784505856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.757480:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0001-mdtlov_UUID+12:3493:x1796714784505856:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.757485:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784505920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.757487:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98363 00000100:00100000:1.0:1713481296.757496:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784505792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.757507:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.757512:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013499c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784506112:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.757530:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.757530:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784505664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.757538:0:15642:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299c380 pname:cluuid:pid:xid:nid:opc:job mdt00_029:lustre-MDT0000-mdtlov_UUID:15642:1796714784505984:0@lo:101:mdt00_029.0 00000100:00100000:2.0:1713481296.757543:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.757545:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757550:0:15642:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.757557:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476608 00000100:00100000:2.0:1713481296.757559:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476608 00010000:00010000:1.0:1713481296.757564:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.757567:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.757569:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784506112 00000100:00100000:2.0:1713481296.757570:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784506112 00010000:00010000:1.0:1713481296.757571:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.757577:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563117 00000100:00100000:2.0:1713481296.757580:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26900:17935:x1796714882476608:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.757582:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563118 00010000:00010000:2.0:1713481296.757585:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.757586:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2760:3491:x1796714784506112:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.757593:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008698fcc0/0xdfc0fb148a3aa91 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495ef expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.757602:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb793:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000001:00080000:3.0:1713481296.757608:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040784 00010000:00010000:2.0:1713481296.757609:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.757610:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.757613:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698fcc0/0xdfc0fb148a3aa91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495ef expref: 26901 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757619:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008698fcc0/0xdfc0fb148a3aa91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495ef expref: 26901 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757623:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008698fcc0, rc 0) 00000100:00100000:2.0:1713481296.757632:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26901:17935:x1796714882476608:12345-192.168.202.24@tcp:101:dd.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.757635:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563117 00002000:00080000:0.0:1713481296.757651:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43316 count 1 00010000:00010000:0.0:1713481296.757662:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.757689:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303dc900/0xdfc0fb148688e6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2be9 expref: 26900 pid: 16503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.757694:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.757696:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.757699:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.757701:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.757714:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303dc900/0xdfc0fb148688e6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2be9 expref: 26900 pid: 16503 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.757733:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x9e:0x0].1840, 416 off1553680 00000100:00100000:2.0:1713481296.757735:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.757758:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xb7:0x0].643, 496 off639856 00000004:00080000:1.0:1713481296.757761:0:15642:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880099d5fa80 with version 16266 00002000:00080000:3.0:1713481296.757762:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56786 00000100:00100000:2.0:1713481296.757764:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.757771:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303dc900/0xdfc0fb148688e6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2be9 expref: 26900 pid: 16503 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.757775:0:8638:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88007e4bd780 version 16266 rpc_version 16266 00000100:00100000:3.0:1713481296.757778:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477760 00000100:00100000:0.0:1713481296.757780:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784506176:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.757781:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477760 00000020:00100000:2.0:1713481296.757786:0:8638:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713481296.757790:0:8638:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88007e404a80 x1796714784506304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1472/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713481296.757797:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.757799:0:8638:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784506304:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713481296.757802:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485824 00000100:00100000:1.0:1713481296.757805:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.757806:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2024:18913:x1796714882477760:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.757815:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.757817:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.757817:0:8638:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.757823:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92ac0/0xdfc0fb148a3aa9f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49619 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.757826:0:8638:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.757827:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.757831:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476544 00000100:00100000:0.0:1713481296.757834:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476544 00000100:00100000:1.0:1713481296.757836:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.757845:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099bedf80/0xdfc0fb148802337 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ab8 expref: 20813 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.757852:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476480 00000100:00100000:2.0:1713481296.757854:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476480 00000100:00100000:0.0:1713481296.757859:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475072 00000100:00100000:0.0:1713481296.757861:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475072 00010000:00010000:2.0:1713481296.757862:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c111f80/0xdfc0fb148802330 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962aaa expref: 20814 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.757868:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a654240/0xdfc0fb148802322 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a8e expref: 20815 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.757873:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475264 00000100:00100000:2.0:1713481296.757875:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475264 00000100:00100000:0.0:1713481296.757879:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475392 00010000:00010000:2.0:1713481296.757880:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e880/0xdfc0fb148688e04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b72 expref: 26901 pid: 16530 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.757881:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475392 00010000:00010000:3.0:1713481296.757885:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.757887:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148802329 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a9c expref: 20816 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.757888:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.757888:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882475584 00000100:00100000:2.0:1713481296.757889:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882475584 00010000:00010000:2.0:1713481296.757894:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007995c6c0/0xdfc0fb148916d98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c656f expref: 24481 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.757894:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00000100:00100000:1.0:1713481296.757898:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476672 00000100:00100000:0.0:1713481296.757900:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820314 00000100:00100000:1.0:1713481296.757900:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476672 00010000:00010000:3.0:1713481296.757901:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.757904:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20816:1959:x1796714882476544:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.757908:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820315 00010000:00010000:0.0:1713481296.757911:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.757911:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20816:1958:x1796714882476480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.757912:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.757913:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563119 00010000:00010000:0.0:1713481296.757915:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099bedf80/0xdfc0fb148802337 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ab8 expref: 20816 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.757915:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.757916:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16875:11552:x1796714882476672:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.757917:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c111f80/0xdfc0fb148802330 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962aaa expref: 20816 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.757918:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.757921:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.757923:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099bedf80/0xdfc0fb148802337 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ab8 expref: 20816 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.757923:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c111f80/0xdfc0fb148802330 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962aaa expref: 20816 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.757923:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.757928:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121aa2f40/0xdfc0fb148a3aab4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495f6 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757933:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c111f80/0xdfc0fb148802330 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962aaa expref: 20816 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.757938:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8846c0/0xdfc0fb148959c4b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc9 expref: 16876 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.757940:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.757941:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099bedf80/0xdfc0fb148802337 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ab8 expref: 20815 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.757941:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.757942:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.757943:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.757943:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.757945:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa2f40/0xdfc0fb148a3aab4 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495f6 expref: 16876 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757948:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.757952:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.757954:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.757955:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8846c0/0xdfc0fb148959c4b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc9 expref: 16876 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.757956:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757959:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.757960:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8846c0/0xdfc0fb148959c4b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc9 expref: 16876 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.757963:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.757964:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2caf:0x0]: returning size 4096 00000100:00100000:1.0:1713481296.757965:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083452a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784506368:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.757967:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20814:1958:x1796714882476480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.757970:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820315 00000100:00100000:1.0:1713481296.757976:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.757981:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820316 00010000:00010000:0.0:1713481296.757983:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.757983:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20813:1959:x1796714882475072:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.757986:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.757987:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.757990:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a654240/0xdfc0fb148802322 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a8e expref: 20813 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.757991:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.757992:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.757994:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a654240/0xdfc0fb148802322 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a8e expref: 20813 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.757996:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.757998:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20813:1959:x1796714882476544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 93us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.757998:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758000:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.758002:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758002:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a654240/0xdfc0fb148802322 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a8e expref: 20813 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.758003:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.758005:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820314 00010000:00010000:1.0:1713481296.758006:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758006:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084b92d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.758007:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.758009:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d0f6400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.758010:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.758010:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.758011:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758011:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758013:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758015:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758015:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:2.0:1713481296.758017:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758017:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.758018:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.758021:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92d00/0xdfc0fb148a3aaa6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.758022:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758026:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d0f6400/0xdfc0fb148a3a910 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758026:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.758029:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00000100:00100000:2.0:1713481296.758032:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20812:1959:x1796714882475072:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 48us (228us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.758032:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00000100:00100000:2.0:1713481296.758036:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820316 00010000:00010000:3.0:1713481296.758038:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.758041:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084b933c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.758043:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.758045:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00000100:00100000:2.0:1713481296.758048:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820317 00010000:00010000:3.0:1713481296.758049:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff880091f28800) 00000100:00100000:2.0:1713481296.758050:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26901:1959:x1796714882475264:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.758050:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.758051:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.758054:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.758054:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b933c0/0xdfc0fb148a3aaad lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.758056:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e880/0xdfc0fb148688e04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b72 expref: 26901 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758061:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e880/0xdfc0fb148688e04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b72 expref: 26901 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758071:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e880/0xdfc0fb148688e04 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b72 expref: 26901 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758078:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758079:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.758080:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92ac0/0xdfc0fb148a3aa9f lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49619 expref: 2026 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758081:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.758085:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820318 00010000:00010000:2.0:1713481296.758085:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758085:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92ac0/0xdfc0fb148a3aa9f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49619 expref: 2026 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758090:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b92ac0, rc 0) 00000100:00100000:0.0:1713481296.758091:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:1959:x1796714882475392:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.758094:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.758098:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.758102:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148802329 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a9c expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.758104:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2025:18913:x1796714882477760:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 297us (402us total) trans 4295107589 rc 301/301 00000100:00100000:2.0:1713481296.758106:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26900:1959:x1796714882475264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.758108:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148802329 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a9c expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.758108:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485824 00000100:00100000:2.0:1713481296.758110:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820317 00000100:00100000:2.0:1713481296.758134:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820319 00000100:00100000:2.0:1713481296.758137:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1959:x1796714882475584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.758141:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.758146:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148802329 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962a9c expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758148:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007995c6c0/0xdfc0fb148916d98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c656f expref: 24481 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758154:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007995c6c0/0xdfc0fb148916d98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c656f expref: 24481 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.758157:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.758158:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.758158:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+157:3492:x1796714784502656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6497us (6615us total) trans 4296040819 rc 0/0 00010000:00010000:0.0:1713481296.758161:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758163:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563096 00010000:00010000:2.0:1713481296.758163:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007995c6c0/0xdfc0fb148916d98 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c656f expref: 24481 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.758168:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758170:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758171:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758173:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa98900/0xdfc0fb148a3a8f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49578 expref: 24480 pid: 16490 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.758174:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880075441c00/2, rc 0, transno 1073523 00010000:00010000:2.0:1713481296.758178:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa98900/0xdfc0fb148a3a8f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49578 expref: 24480 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.758180:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784502656:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.758185:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.758187:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa98900/0xdfc0fb148a3a8f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49578 expref: 24480 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758190:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.758193:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784506432:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.758201:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20809:1959:x1796714882475392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.758202:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476736 00000100:00100000:2.0:1713481296.758203:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b7d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.758205:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476736 00000100:00100000:0.0:1713481296.758207:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820318 00000100:00100000:1.0:1713481296.758214:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563120 00000100:00100000:1.0:1713481296.758217:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:14753:x1796714882476736:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.758217:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.758218:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013499ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784506496:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.758221:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758222:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.758226:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758228:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121aa0000/0xdfc0fb148a3aac2 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa495fd expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758229:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758233:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758235:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758236:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350f4240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.758238:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133a86880/0xdfc0fb148a13e77 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fc4 expref: 24482 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.758238:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758242:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758242:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758242:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.758242:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.758243:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.758245:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa0000/0xdfc0fb148a3aac2 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495fd expref: 24482 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758248:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758252:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758254:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133a86880/0xdfc0fb148a13e77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fc4 expref: 24482 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.758255:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350f4240/0xdfc0fb148a3a892 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa92c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758259:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758259:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133a86880/0xdfc0fb148a13e77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fc4 expref: 24482 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.758264:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758265:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083451500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784506560:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.758269:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133a7fa80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.758271:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758276:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.758277:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758285:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784506496 00010000:00010000:0.0:1713481296.758286:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758287:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784506496 00010000:00010000:0.0:1713481296.758292:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3a87d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758297:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563121 00000100:00100000:1.0:1713481296.758299:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+157:3491:x1796714784506496:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.758307:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9972 count 1 00010000:00010000:1.0:1713481296.758314:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758320:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007723a880/0xdfc0fb148802353 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962afe expref: 20808 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.758324:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.758325:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.758327:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758335:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007723a880/0xdfc0fb148802353 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962afe expref: 20808 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.758340:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007723a880/0xdfc0fb148802353 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962afe expref: 20808 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.758345:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083451f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784506624:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.758356:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.758362:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2761:3490:x1796714784501760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9194us (9263us total) trans 4295960701 rc 0/0 00000100:00100000:2.0:1713481296.758366:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563087 00000004:00080000:3.0:1713481296.758373:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007712bb80/2, rc 0, transno 993405 00000100:00100000:3.0:1713481296.758381:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007712bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784501760:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.758401:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+158:3492:x1796714784501440:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9424us (9668us total) trans 4296040820 rc 0/0 00000100:00100000:0.0:1713481296.758406:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563086 00000100:00100000:3.0:1713481296.758408:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784503040:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.758433:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758437:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a925 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4959b expref: 26899 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758440:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758446:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758449:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009227a1c0, rc 0) 00010000:00010000:0.0:1713481296.758453:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758459:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758464:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880089bb0fc0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.758465:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ded3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26899:18817:x1796714882474240:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6245us (6592us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.758467:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.758470:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784503488:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.758471:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563099 00010000:00010000:0.0:1713481296.758473:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758481:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758486:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758490:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.758492:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3a8a7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.758494:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784503872:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.758504:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758506:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.758514:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.758515:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.758521:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007796f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784506688:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.758523:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784502976:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.758524:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.758534:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.758534:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.758538:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758545:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.758551:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477120 00000100:00100000:2.0:1713481296.758553:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477120 00000100:00100000:3.0:1713481296.758554:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784503232:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.758555:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.758569:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477568 00000100:00100000:2.0:1713481296.758570:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477568 00000100:00100000:1.0:1713481296.758574:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784506688 00000100:00100000:1.0:1713481296.758575:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784506688 00010000:00010000:3.0:1713481296.758575:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.758578:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563122 00000100:00100000:2.0:1713481296.758581:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16878:18844:x1796714882477120:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.758586:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.758587:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563123 00000100:00100000:1.0:1713481296.758590:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16878:8499:x1796714882477568:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.758592:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784503104:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.758593:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+158:3491:x1796714784501824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9266us (9345us total) trans 4296040821 rc 0/0 00010000:00010000:2.0:1713481296.758593:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008698db00/0xdfc0fb148a3aad0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4960b expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758595:0:16491:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.758598:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563090 00010000:00010000:1.0:1713481296.758601:0:16491:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5d40/0xdfc0fb148a3aad7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49612 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.758602:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.758607:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092279d40/0xdfc0fb148a3a92c lrc: 3/0,0 mode: --/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495a2 expref: 16880 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758609:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758610:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.758611:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c19d8c0/0xdfc0fb1488e7e5a lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5502 expref: 16880 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.758612:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563124 00010000:00010000:2.0:1713481296.758612:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008698db00/0xdfc0fb148a3aad0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4960b expref: 16880 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758616:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.758616:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.758617:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2761:3493:x1796714784506688:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.758618:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5d40/0xdfc0fb148a3aad7 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49612 expref: 16880 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758618:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008698db00/0xdfc0fb148a3aad0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4960b expref: 16880 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758621:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092279d40, rc 0) 00010000:00010000:2.0:1713481296.758623:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008698db00, rc 0) 00002000:00080000:0.0:1713481296.758626:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43317 count 1 00010000:00010000:1.0:1713481296.758627:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c19d8c0/0xdfc0fb1488e7e5a lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5502 expref: 16880 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.758631:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c19d8c0/0xdfc0fb1488e7e5a lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5502 expref: 16880 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.758634:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16880:18844:x1796714882477120:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 53us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.758635:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758637:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083450380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784506752:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.758638:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563122 00000100:00100000:3.0:1713481296.758640:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16880:18836:x1796714882474816:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6291us (6661us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.758644:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123614900/0xdfc0fb148688e9e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bf7 expref: 26898 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.758647:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563100 00000100:00100000:1.0:1713481296.758648:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099383900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.758649:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.758650:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.758653:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.758655:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476992 00000100:00100000:2.0:1713481296.758657:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476992 00010000:00010000:2.0:1713481296.758677:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff9f180/0xdfc0fb148688e19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b95 expref: 26899 pid: 16530 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.758679:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.758680:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123614900/0xdfc0fb148688e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bf7 expref: 26899 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.758687:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123614900/0xdfc0fb148688e9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bf7 expref: 26899 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.758689:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477184 00000100:00100000:2.0:1713481296.758690:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477184 00000100:00100000:3.0:1713481296.758694:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784503552:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.758695:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.758696:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784506816:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.758696:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081d6bcc0/0xdfc0fb14891e865 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb563 expref: 20809 pid: 16500 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.758704:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882476928 00000100:00100000:2.0:1713481296.758705:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882476928 00000100:00100000:1.0:1713481296.758709:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.758710:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d28240/0xdfc0fb1489cf951 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa221f5 expref: 24483 pid: 16512 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.758714:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134f80b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.758717:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.758722:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477312 00000100:00100000:2.0:1713481296.758723:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477312 00000100:00100000:1.0:1713481296.758728:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477056 00010000:00010000:2.0:1713481296.758728:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c111440/0xdfc0fb148802345 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ad4 expref: 20810 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.758730:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477056 00000100:00100000:0.0:1713481296.758731:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477440 00000100:00100000:0.0:1713481296.758733:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477440 00000100:00100000:3.0:1713481296.758734:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477248 00000100:00100000:2.0:1713481296.758735:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477376 00000100:00100000:3.0:1713481296.758736:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477248 00000100:00100000:2.0:1713481296.758737:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477376 00010000:00010000:1.0:1713481296.758738:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077239440/0xdfc0fb14880233e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ac6 expref: 20811 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758742:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff7a400/0xdfc0fb148688e43 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa930:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bb1 expref: 26902 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.758746:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135480000/0xdfc0fb148688e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bbf expref: 26902 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.758747:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303de1c0/0xdfc0fb148688e3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ba3 expref: 26902 pid: 16503 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.758750:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820320 00000100:00100000:1.0:1713481296.758754:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820321 00000100:00100000:2.0:1713481296.758754:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26902:1957:x1796714882476992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.758758:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20811:1957:x1796714882477184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.758758:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.758760:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ff9f180/0xdfc0fb148688e19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b95 expref: 26902 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.758762:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.758762:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820322 00010000:00010000:1.0:1713481296.758764:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081d6bcc0/0xdfc0fb14891e865 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb563 expref: 20811 pid: 16500 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.758765:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ff9f180/0xdfc0fb148688e19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b95 expref: 26902 pid: 16530 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.758766:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1958:x1796714882476928:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.758768:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820323 00010000:00010000:1.0:1713481296.758770:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081d6bcc0/0xdfc0fb14891e865 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb563 expref: 20811 pid: 16500 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.758772:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.758773:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20811:1957:x1796714882477312:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.758775:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9f180/0xdfc0fb148688e19 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2b95 expref: 26902 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.758775:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095d28240/0xdfc0fb1489cf951 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa221f5 expref: 24483 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.758780:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.758781:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081d6bcc0/0xdfc0fb14891e865 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb563 expref: 20811 pid: 16500 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.758782:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095d28240/0xdfc0fb1489cf951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa221f5 expref: 24483 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.758784:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c111440/0xdfc0fb148802345 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ad4 expref: 20811 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758784:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758785:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758787:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758791:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758791:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758792:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.758793:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c111440/0xdfc0fb148802345 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ad4 expref: 20810 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.758794:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092279d40/0xdfc0fb148a3a92c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495a2 expref: 16878 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758795:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d28240/0xdfc0fb1489cf951 lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa221f5 expref: 24483 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.758799:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092279d40/0xdfc0fb148a3a92c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495a2 expref: 16878 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758806:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.758808:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c111440/0xdfc0fb148802345 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ad4 expref: 20810 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.758811:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.758812:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.758814:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26901:1957:x1796714882476992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (308us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.758815:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092279d40/0xdfc0fb148a3a92c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495a2 expref: 16878 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758815:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4959b expref: 26901 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758817:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.758818:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.758818:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820320 00010000:00010000:0.0:1713481296.758820:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758820:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a925 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4959b expref: 26901 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758827:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758828:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880089a5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784506880:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.758829:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820324 00010000:00010000:3.0:1713481296.758831:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009227a1c0/0xdfc0fb148a3a925 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4959b expref: 26900 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.758832:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20809:1958:x1796714882477056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.758836:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.758836:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007796ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784506944:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.758838:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077239440/0xdfc0fb14880233e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ac6 expref: 20809 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.758840:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.758843:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c991c00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.758844:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077239440/0xdfc0fb14880233e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ac6 expref: 20809 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.758849:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.758855:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20809:1957:x1796714882477312:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (308us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.758855:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077239440/0xdfc0fb14880233e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ac6 expref: 20809 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.758860:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820323 00010000:00010000:3.0:1713481296.758861:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758862:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758863:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.758865:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820325 00010000:00010000:2.0:1713481296.758865:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758866:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758869:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758870:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26900:1958:x1796714882477376:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.758871:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.758874:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.758876:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820326 00010000:00010000:1.0:1713481296.758878:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.758878:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.758878:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.758880:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26900:1958:x1796714882477248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.758882:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff7a400/0xdfc0fb148688e43 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa930:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bb1 expref: 26900 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.758883:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009227ba80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.758885:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083453100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20807:1958:x1796714882477056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (329us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.758885:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758886:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.758889:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820324 00010000:00010000:3.0:1713481296.758889:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758890:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303de1c0/0xdfc0fb148688e3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ba3 expref: 26900 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.758891:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff7a400/0xdfc0fb148688e43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa930:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bb1 expref: 26900 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.758895:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758898:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303de1c0/0xdfc0fb148688e3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ba3 expref: 26900 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.758899:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3a91e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa92e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.758902:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820327 00010000:00010000:1.0:1713481296.758904:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.758904:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26900:1957:x1796714882477440:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.758905:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.758908:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758908:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.758910:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303de1c0/0xdfc0fb148688e3c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ba3 expref: 26900 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758910:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135480000/0xdfc0fb148688e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa931:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bbf expref: 26900 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.758914:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758916:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135480000/0xdfc0fb148688e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa931:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bbf expref: 26899 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.758918:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.758919:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.758921:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.758925:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135480000/0xdfc0fb148688e4a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa931:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bbf expref: 26899 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.758927:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.758927:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.758933:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758934:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.758935:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.758937:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.758937:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26898:1958:x1796714882477376:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (228us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.758939:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.758942:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820325 00000100:00100000:0.0:1713481296.758946:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26898:1958:x1796714882477248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (250us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.758947:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.758951:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820326 00000100:00100000:2.0:1713481296.758954:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26897:1957:x1796714882477440:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.758957:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820327 00000100:00100000:1.0:1713481296.758964:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.758969:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477504 00000100:00100000:2.0:1713481296.758970:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477504 00010000:00010000:2.0:1713481296.758976:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099bef600/0xdfc0fb14880234c lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ae2 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.758982:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.758985:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784503936:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.758985:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820328 00000100:00100000:2.0:1713481296.758988:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20807:1958:x1796714882477504:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.758990:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477632 00000100:00100000:1.0:1713481296.758992:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477632 00010000:00010000:2.0:1713481296.758992:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.758994:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099bef600/0xdfc0fb14880234c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ae2 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.758999:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099bef600/0xdfc0fb14880234c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ae2 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.759002:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125682 00010000:00010000:0.0:1713481296.759003:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.759004:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2025:18678:x1796714882477632:12345-192.168.202.24@tcp:37:rm.0 00010000:00010000:2.0:1713481296.759007:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099bef600/0xdfc0fb14880234c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ae2 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.759011:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2762:3491:x1796714784502848:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6957us (7178us total) trans 4295960702 rc 0/0 00010000:00010000:2.0:1713481296.759014:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.759015:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.759016:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.759016:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563098 00010000:00010000:2.0:1713481296.759021:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759022:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759028:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759028:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.759033:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759034:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759035:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:1958:x1796714882477504:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 47us (70us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.759037:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759039:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759041:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759041:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820328 00010000:00010000:0.0:1713481296.759044:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800942abcc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.759044:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759046:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759047:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759050:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759052:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759056:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800991dc000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.759057:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759058:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759058:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759061:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759062:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942abcc0/0xdfc0fb148a3a917 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759063:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759067:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759068:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759071:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759071:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991dc000/0xdfc0fb148a3a93a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759075:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759078:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080155b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.759080:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759083:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759091:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759095:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080155b00/0xdfc0fb148a3a948 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.759200:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+160:3492:x1796714784503168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6505us (6573us total) trans 4296040823 rc 0/0 00000100:00100000:3.0:1713481296.759204:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563102 00000100:00100000:2.0:1713481296.759214:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+159:3490:x1796714784503360:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6134us (6228us total) trans 4296040824 rc 0/0 00000100:00100000:2.0:1713481296.759219:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563104 00000004:00080000:2.0:1713481296.759243:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800823a2300/2, rc 0, transno 1073528 00000100:00100000:2.0:1713481296.759248:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784503360:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.759271:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784507008:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.759278:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759283:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.759285:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759292:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759298:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759298:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759298:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759302:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759304:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759305:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759307:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759308:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009654dd40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.759310:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759311:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759313:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759314:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759316:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759317:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080156880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.759318:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759320:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759325:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759325:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759327:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759331:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009654dd40/0xdfc0fb148a3a95d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759332:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007975a640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.759335:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759339:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759342:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080156880/0xdfc0fb148a3a956 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759342:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759354:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759360:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007975a640/0xdfc0fb148a3a941 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa92f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.759420:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.759439:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+159:3493:x1796714784503808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5732us (5810us total) trans 4296040825 rc 0/0 00000100:00100000:1.0:1713481296.759439:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.759439:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2763:3493:x1796714784503616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5743us (5922us total) trans 4295960703 rc 0/0 00000100:00100000:2.0:1713481296.759443:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563106 00000100:00100000:0.0:1713481296.759446:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563107 00000100:00100000:1.0:1713481296.759447:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477952 00000100:00100000:1.0:1713481296.759449:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477952 00000100:00100000:2.0:1713481296.759454:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507008 00000100:00100000:2.0:1713481296.759456:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507008 00000100:00100000:1.0:1713481296.759460:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125683 00000100:00100000:1.0:1713481296.759462:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2201:18904:x1796714882477952:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1713481296.759463:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882477824 00000100:00100000:0.0:1713481296.759466:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882477824 00000100:00100000:2.0:1713481296.759467:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563125 00000100:00100000:2.0:1713481296.759469:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+159:3493:x1796714784507008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.759477:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9973 count 1 00000100:00100000:0.0:1713481296.759483:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563126 00010000:00010000:2.0:1713481296.759484:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.759488:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:18792:x1796714882477824:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.759491:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b138000/0xdfc0fb148802361 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b0c expref: 20806 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.759494:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.759495:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.759495:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2762:3492:x1796714784503296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6418us (6554us total) trans 4295960704 rc 0/0 00010000:00010000:2.0:1713481296.759496:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.759497:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759502:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3aaec lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc515:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49620 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.759503:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563103 00010000:00010000:2.0:1713481296.759508:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b138000/0xdfc0fb148802361 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b0c expref: 20806 pid: 16529 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.759512:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc515:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.759513:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b138000/0xdfc0fb148802361 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b0c expref: 20806 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.759516:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18904:x1796714882477952:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 52us (77us total) trans 4295105916 rc 0/0 00000100:00100000:2.0:1713481296.759519:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784507072:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.759520:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.759520:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125683 00010000:00010000:0.0:1713481296.759522:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.759525:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3aaec lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49620 expref: 20807 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759529:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081d246c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.759533:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801304b2f40/0xdfc0fb148a3aaec lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc515:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49620 expref: 20807 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759539:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801304b2f40, rc 0) 00000004:00080000:3.0:1713481296.759551:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fe7bb80/2, rc 0, transno 993408 00000004:00080000:2.0:1713481296.759552:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800823a2d80/2, rc 0, transno 1073529 00000100:00100000:0.0:1713481296.759555:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20807:18792:x1796714882477824:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 68us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.759556:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.759557:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784503808:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.759560:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563126 00000100:00100000:3.0:1713481296.759560:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784503296:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1713481296.759563:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086966a00/2, rc 0, transno 993407 00000100:00100000:2.0:1713481296.759566:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784503616:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.759572:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:3.0:1713481296.759573:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e406680/2, rc 0, transno 1073527 00000100:00100000:0.0:1713481296.759578:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478080 00000100:00100000:3.0:1713481296.759578:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784503168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.759580:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478080 00000100:00100000:0.0:1713481296.759593:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563127 00000004:00080000:3.0:1713481296.759593:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800785a8000/2, rc 0, transno 1073524 00000100:00100000:0.0:1713481296.759597:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16879:17009:x1796714882478080:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.759597:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.759601:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784507136:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.759602:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.759603:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784501440:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.759608:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3aaf3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49627 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.759614:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:0.0:1713481296.759621:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.759628:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.759628:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.759628:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478208 00010000:00010000:0.0:1713481296.759629:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.759631:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478208 00010000:00010000:0.0:1713481296.759632:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3aaf3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49627 expref: 16880 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759633:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478272 00000100:00100000:2.0:1713481296.759635:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478272 00010000:00010000:0.0:1713481296.759640:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013625cb40/0xdfc0fb148a3aaf3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49627 expref: 16880 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759644:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507136 00010000:00010000:0.0:1713481296.759645:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013625cb40, rc 0) 00000100:00100000:2.0:1713481296.759645:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507136 00000100:00100000:1.0:1713481296.759647:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713481296.759653:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784507200:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.759653:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563128 00000100:00100000:3.0:1713481296.759653:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485825 00000100:00100000:0.0:1713481296.759655:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16880:17009:x1796714882478080:12345-192.168.202.24@tcp:101:dd.0 Request processed in 57us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.759656:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:15045:x1796714882478272:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.759658:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2027:18920:x1796714882478208:12345-192.168.202.24@tcp:36:mkdir.0 00000100:00100000:0.0:1713481296.759660:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563127 00010000:00010000:2.0:1713481296.759661:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.759683:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.759683:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008698ed00/0xdfc0fb148a3aafa lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4962e expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.759688:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507200 00000100:00100000:0.0:1713481296.759690:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507200 00002000:00010000:2.0:1713481296.759692:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.759698:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.759699:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.759702:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563129 00010000:00010000:2.0:1713481296.759702:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698ed00/0xdfc0fb148a3aafa lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4962e expref: 24484 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.759706:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563130 00000100:00100000:1.0:1713481296.759706:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+161:3490:x1796714784507136:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.759708:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008698ed00/0xdfc0fb148a3aafa lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4962e expref: 24484 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.759710:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+161:3490:x1796714784507200:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.759713:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008698ed00, rc 0) 00002000:00080000:1.0:1713481296.759714:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9974 count 1 00002000:00080000:0.0:1713481296.759718:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9975 count 1 00010000:00010000:1.0:1713481296.759722:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759726:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759726:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:15045:x1796714882478272:12345-192.168.202.24@tcp:101:dd.0 Request processed in 68us (111us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.759730:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713481296.759731:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563128 00010000:00010000:0.0:1713481296.759732:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b13aac0/0xdfc0fb148802376 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b28 expref: 20806 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.759732:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077238d80/0xdfc0fb148802368 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b1a expref: 20806 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.759736:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.759737:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.759737:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.759738:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.759739:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759739:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.759741:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.759746:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.759749:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b13aac0/0xdfc0fb148802376 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b28 expref: 20806 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.759754:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b13aac0/0xdfc0fb148802376 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b28 expref: 20806 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.759756:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478016 00010000:00010000:3.0:1713481296.759756:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3ab16 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cbb:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.759757:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077238d80/0xdfc0fb148802368 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b1a expref: 20806 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.759759:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478016 00000100:00100000:0.0:1713481296.759760:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784507328:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.759761:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3ab16 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.759766:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077238d80/0xdfc0fb148802368 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b1a expref: 20806 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.759767:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3ab16 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.759768:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800977b0b40/0xdfc0fb148a16250 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39821 expref: 24484 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.759771:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.759775:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784507392:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.759781:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820329 00000100:00100000:2.0:1713481296.759785:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1957:x1796714882478016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.759791:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.759792:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784504832:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.759794:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.759794:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800977b0b40/0xdfc0fb148a16250 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39821 expref: 24484 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.759802:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800977b0b40/0xdfc0fb148a16250 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39821 expref: 24484 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.759805:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122ad18c0/0xdfc0fb148a3a9f7 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e1 expref: 16879 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759811:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ad18c0, rc 0) 00010000:00010000:2.0:1713481296.759816:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.759818:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16879:11388:x1796714882476224:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4319us (4417us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.759818:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.759821:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009654d8c0/0xdfc0fb148a3a9bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495b0 expref: 24484 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.759822:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563112 00010000:00010000:2.0:1713481296.759828:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009654d8c0/0xdfc0fb148a3a9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495b0 expref: 24484 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759846:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009654d8c0/0xdfc0fb148a3a9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495b0 expref: 24484 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759855:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784507456:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.759861:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.759870:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800836e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.759882:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.759883:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478336 00000100:00100000:2.0:1713481296.759885:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478336 00010000:00010000:2.0:1713481296.759892:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095dad440/0xdfc0fb148942180 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b1 expref: 20807 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.759899:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800977b0b40/0xdfc0fb148a16250 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39821 expref: 24484 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.759902:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820330 00000100:00100000:2.0:1713481296.759905:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20807:1957:x1796714882478336:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.759910:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.759912:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095dad440/0xdfc0fb148942180 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6974:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b1 expref: 20807 pid: 15559 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.759914:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784504640:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.759917:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095dad440/0xdfc0fb148942180 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6974:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b1 expref: 20807 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.759928:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095dad440/0xdfc0fb148942180 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6974:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b1 expref: 20807 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.759932:0:16512:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009654d8c0/0xdfc0fb148a3a9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495b0 expref: 24483 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.759936:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.759936:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.759937:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.759940:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122ad18c0/0xdfc0fb148a3a9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e1 expref: 16878 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.759944:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ad18c0/0xdfc0fb148a3a9f7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e1 expref: 16878 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.759945:0:16512:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009654d8c0, rc 0) 00010000:00010000:2.0:1713481296.759953:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880122ad18c0/0xdfc0fb148a3a9f7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e1 expref: 16878 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.759958:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784507520:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.759959:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008409c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:17924:x1796714882474944:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5221us (5465us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.759964:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563108 00000100:00100000:1.0:1713481296.759966:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.759967:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800916e2300 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.759970:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3ab1d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.759976:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3ab1d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.759977:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713481296.759980:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3ab1d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.759981:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784507264:0@lo:6:osp-syn-0-1.0 00000004:00010000:3.0:1713481296.759987:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800881af800 reply state ffff880091d52000 transno 4295107590 ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3ab1d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.759992:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.759992:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f87df80/0xdfc0fb148a3ab1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.759996:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbd:0x0].0x0 (ffff8800941bb000) 00010000:00010000:3.0:1713481296.759997:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.759998:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1713481296.760000:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cbd:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.760003:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713481296.760005:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507264 00010000:00010000:3.0:1713481296.760006:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713481296.760007:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507264 00010000:00010000:3.0:1713481296.760009:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760013:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760015:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084b92f40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.760017:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713481296.760020:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563131 00010000:00010000:3.0:1713481296.760020:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713481296.760022:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+162:3493:x1796714784507264:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.760022:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff7a400/0xdfc0fb148688e43 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa930:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bb1 expref: 26895 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.760024:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbb:0x0].0x0 (ffff88008ad2f600) 00010000:00010000:3.0:1713481296.760025:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.760026:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.760030:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784503680:192.168.202.24@tcp:104: 00002000:00080000:1.0:1713481296.760031:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9976 count 1 00010000:00010000:3.0:1713481296.760032:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b92f40/0xdfc0fb148a3ab0f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713481296.760037:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+162:3491:x1796714784502784:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8174us (8244us total) trans 4296040822 rc 0/0 00010000:00010000:1.0:1713481296.760039:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760041:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713481296.760042:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800881af800 reply state ffff880091d52000 transno 4295107590 ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3ab16 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713481296.760044:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563097 00010000:00010000:1.0:1713481296.760045:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880079aabcc0/0xdfc0fb14880236f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b36 expref: 20806 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.760045:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760045:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095c918c0/0xdfc0fb148a3ab16 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760049:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbb:0x0].0x31 (ffff88009759f800) 00010000:00010000:1.0:1713481296.760050:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.760050:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.760050:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760050:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.760051:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1713481296.760052:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760054:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760058:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.760061:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880079aabcc0/0xdfc0fb14880236f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b36 expref: 20806 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.760061:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760065:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080157cc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.760066:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880079aabcc0/0xdfc0fb14880236f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b36 expref: 20806 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.760066:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760070:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.760071:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2029:18920:x1796714882478208:12345-192.168.202.24@tcp:36:mkdir.0 Request processed in 413us (474us total) trans 4295107590 rc 0/0 00000100:00100000:1.0:1713481296.760072:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784507584:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.760076:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485825 00010000:00010000:2.0:1713481296.760077:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760081:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080157cc0/0xdfc0fb148a3a94f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.760084:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.760090:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478400 00000100:00100000:3.0:1713481296.760092:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478400 00000100:00100000:3.0:1713481296.760103:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478656 00000100:00100000:3.0:1713481296.760105:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478656 00000100:00100000:3.0:1713481296.760111:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478528 00000100:00100000:3.0:1713481296.760113:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478528 00000100:00100000:3.0:1713481296.760141:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485826 00000100:00100000:3.0:1713481296.760144:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2372:18872:x1796714882478400:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.760150:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.760156:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3ab2b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49635 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.760168:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784506304 00000100:00100000:1.0:1713481296.760170:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784506304 00000100:00100000:1.0:1713481296.760186:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82913 00000100:00100000:1.0:1713481296.760189:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+34:8638:x1796714784506304:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713481296.760205:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713481296.760206:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2762:3490:x1796714784503424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6737us (6794us total) trans 4295960705 rc 0/0 00000100:00100000:2.0:1713481296.760212:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563105 00010000:00010000:3.0:1713481296.760213:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760217:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760223:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.760227:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760230:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.760238:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485827 00000100:00100000:2.0:1713481296.760242:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18953:x1796714882478656:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1713481296.760251:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.760253:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3ab40 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.760256:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3ab40 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.760259:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008698e640/0xdfc0fb148a3ab47 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4963c expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760260:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3ab40 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000004:00200000:3.0:1713481296.760273:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c7b:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.760275:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.760280:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3ab40 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760285:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760288:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760294:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760297:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760300:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096ca7cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.760301:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760304:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760308:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.760309:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.760311:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760313:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096ca7cc0/0xdfc0fb148a3ab32 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000004:00200000:2.0:1713481296.760315:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x38b1:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.760321:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760324:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760327:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760330:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012052c900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.760332:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760337:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760341:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88009ab92500) 00010000:00010000:3.0:1713481296.760342:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.760343:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760346:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012052c900/0xdfc0fb148a3ab39 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.760358:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698e640/0xdfc0fb148a3ab47 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4963c expref: 2204 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.760363:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+35:8638:x1796714784506304:12345-0@lo:1000:osp_up1-0.0 Request processed in 172us (2545us total) trans 4295107591 rc 0/0 00010000:00010000:3.0:1713481296.760366:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f85a400/0xdfc0fb148a3ab2b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49635 expref: 2374 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.760367:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82913 00010000:00010000:2.0:1713481296.760367:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008698e640/0xdfc0fb148a3ab47 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4963c expref: 2204 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760373:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3ab40 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49635 expref: 2373 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760377:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff880092ca5600) 00010000:00010000:3.0:1713481296.760378:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.760379:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350f6400, rc 0) 00010000:00010000:2.0:1713481296.760380:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008698e640, rc 0) 00000100:00100000:3.0:1713481296.760391:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2373:18872:x1796714882478400:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 246us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.760396:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485826 00000100:00100000:2.0:1713481296.760397:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18953:x1796714882478656:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 154us (459us total) trans 4295105917 rc 301/301 00000004:00080000:1.0:1713481296.760398:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fe79c00/2, rc 0, transno 993409 00000100:00100000:1.0:1713481296.760401:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784503424:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.760404:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485827 00000100:00100000:3.0:1713481296.760412:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485828 00000100:00100000:3.0:1713481296.760414:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2029:18952:x1796714882478528:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:3.0:1713481296.760428:0:15476:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.760434:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800976318c0/0xdfc0fb148a3a9e2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49604 expref: 2029 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.760449:0:8638:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e404a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784506304:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713481296.760452:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbc:0x0].0x0 (ffff8800907b5600) 00000004:00200000:1.0:1713481296.760461:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x385d:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.760463:0:15476:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.760470:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.760476:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.760481:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.760486:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa3180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.760489:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.760494:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.760502:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff880124c21d00) 00010000:00010000:1.0:1713481296.760505:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.760505:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3ab55 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.760507:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.760509:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3ab55 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.760512:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3180/0xdfc0fb148a3aa8a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.760513:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3ab55 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.760535:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.760541:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713481296.760542:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880096761880 reply state ffff880091d50000 transno 4295107592 ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3ab55 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.760547:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760547:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f4900/0xdfc0fb148a3ab55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.760551:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbc:0x0].0x0 (ffff88009cf16000) 00010000:00010000:3.0:1713481296.760552:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.760553:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713481296.760568:0:15642:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1713481296.760573:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2030:18952:x1796714882478528:12345-192.168.202.24@tcp:36:touch.0 Request processed in 157us (606us total) trans 4295107592 rc 0/0 00000100:00100000:3.0:1713481296.760576:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485828 00010000:00010000:0.0:1713481296.760586:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713481296.760590:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.760594:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa0240 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:0.0:1713481296.760597:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.760601:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.760613:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.760616:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713481296.760623:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 1/0,0 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.760627:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880121aa0240/0xdfc0fb148a3aa75 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3aa83 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.760631:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007796e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784507648:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.760645:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713481296.760645:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007796df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784507840:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.760646:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.760647:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.760647:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1713481296.760659:0:15642:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x1d3:0x0] 00010000:00010000:1.0:1713481296.760677:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.760678:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.760683:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.760686:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.760697:0:15642:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1713481296.760700:0:15642:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x1d3:0x0] 00010000:00010000:1.0:1713481296.760702:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.760703:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507648 00010000:00010000:2.0:1713481296.760704:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.760705:0:15642:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.760705:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507648 00010000:00010000:2.0:1713481296.760709:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760715:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800960ef600 already unused, calling callback (ffffffffa0efd520) 00000100:00100000:3.0:1713481296.760716:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507840 00000100:00100000:3.0:1713481296.760717:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507840 00010000:00010000:2.0:1713481296.760719:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.760726:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18578:x1796714882472896:12345-192.168.202.24@tcp:36:rm.0 Request processed in 13026us (13094us total) trans 4295105915 rc 0/0 00000004:00010000:2.0:1713481296.760726:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.760726:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563132 00000100:00100000:3.0:1713481296.760730:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800773c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2763:3493:x1796714784507648:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.760731:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485815 00000100:00100000:0.0:1713481296.760733:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563133 00000100:00100000:0.0:1713481296.760738:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007796c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2763:3492:x1796714784507840:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.760738:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43318 count 1 00010000:00010000:2.0:1713481296.760742:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760747:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760748:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00002000:00080000:0.0:1713481296.760752:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43320 count 1 00000100:00100000:1.0:1713481296.760753:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784507712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.760755:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123614b40/0xdfc0fb148688ea5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c05 expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.760758:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 1/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760759:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.760760:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.760762:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800960ef600/0xdfc0fb148a3a85a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a861 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.760762:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.760763:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.760767:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.760773:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099964900/0xdfc0fb148688eac lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c21 expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.760778:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713481296.760778:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123614b40/0xdfc0fb148688ea5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c05 expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.760779:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.760781:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.760781:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007796f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784507776:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.760783:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760784:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.760785:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.760786:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713481296.760788:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123614b40/0xdfc0fb148688ea5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c05 expref: 26894 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.760792:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.760797:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800773c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784507904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.760798:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.760799:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784507968:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.760800:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099964900/0xdfc0fb148688eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c21 expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.760810:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099964900/0xdfc0fb148688eac lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c21 expref: 26894 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.760811:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507776 00000100:00100000:1.0:1713481296.760813:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507776 00000100:00100000:2.0:1713481296.760813:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.760818:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085d9fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.760820:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784508032:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.760822:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563134 00000100:00100000:1.0:1713481296.760825:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2764:3490:x1796714784507776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.760832:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43319 count 1 00000100:00100000:0.0:1713481296.760836:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800843ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.760836:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507712 00000100:00100000:2.0:1713481296.760838:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507712 00010000:00010000:1.0:1713481296.760840:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.760847:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080186d00/0xdfc0fb148688ed6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c13 expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.760848:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784507904 00000100:00100000:2.0:1713481296.760849:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784507904 00010000:00010000:1.0:1713481296.760851:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.760852:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:3.0:1713481296.760852:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800794c1c00/2, rc 0, transno 993406 00000100:00100000:0.0:1713481296.760853:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98364 00010000:00010000:1.0:1713481296.760853:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.760858:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096760000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+36:3490:x1796714784507712:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.760859:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784502848:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.760860:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98365 00000100:00100000:2.0:1713481296.760863:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800773c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+36:3492:x1796714784507904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.760864:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.760864:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080186d00/0xdfc0fb148688ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c13 expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.760867:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.760869:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080186d00/0xdfc0fb148688ed6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c13 expref: 26894 pid: 16525 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.760871:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880075440a80/2, rc 0, transno 1073526 00010000:00010000:0.0:1713481296.760873:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa0b40/0xdfc0fb148a3aa83 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x385d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3aa75 expref: 36 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.760874:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801304b0d80/0xdfc0fb148a3a861 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a85a expref: 36 pid: 6936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.760875:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784508096:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.760879:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784502784:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.760885:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x0 (ffff880124c21f00) 00000100:00100000:1.0:1713481296.760885:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042a80 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.760888:0:16520:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x0 (ffff880083123100) 00000004:00080000:3.0:1713481296.760892:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007712b800/2, rc 0, transno 1073525 00010000:00010000:0.0:1713481296.760893:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.760896:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007712b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784501824:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.760897:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.760914:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800773c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+34:3492:x1796714784507904:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.760918:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98365 00000100:00100000:0.0:1713481296.760926:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096760000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+33:3490:x1796714784507712:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.760930:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784507712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.760930:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.760932:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98364 00000100:00100000:3.0:1713481296.760937:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784508160:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.760943:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713481296.760947:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800773c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784508224:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.760951:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007994c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784508288:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.760962:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.760972:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784508160 00000100:00100000:2.0:1713481296.760974:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784508160 00000100:00100000:2.0:1713481296.760983:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563135 00000100:00100000:2.0:1713481296.760986:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2765:3491:x1796714784508160:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.760990:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1713481296.760993:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43321 count 1 00000100:00100000:1.0:1713481296.760998:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784508224 00000100:00100000:1.0:1713481296.761000:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784508224 00010000:00010000:2.0:1713481296.761000:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.761008:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080184d80/0xdfc0fb148688eb3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c2f expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.761012:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.761013:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.761014:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.761017:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563136 00000100:00100000:1.0:1713481296.761020:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+162:3490:x1796714784508224:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.761024:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080184d80/0xdfc0fb148688eb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c2f expref: 26894 pid: 16525 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713481296.761027:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9977 count 1 00010000:00010000:2.0:1713481296.761029:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080184d80/0xdfc0fb148688eb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c2f expref: 26894 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.761034:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.761034:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007994e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784508352:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.761041:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077239b00/0xdfc0fb14880237d lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b44 expref: 20806 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.761044:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.761044:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.761045:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.761047:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.761053:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.761056:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077239b00/0xdfc0fb14880237d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b44 expref: 20806 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.761061:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077239b00/0xdfc0fb14880237d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b44 expref: 20806 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.761067:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784508416:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.761076:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784508288 00000100:00100000:1.0:1713481296.761077:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.761080:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784508288 00000100:00100000:2.0:1713481296.761081:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800773c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784507904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.761099:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563137 00000100:00100000:3.0:1713481296.761103:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+163:3492:x1796714784508288:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.761114:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9978 count 1 00010000:00010000:3.0:1713481296.761147:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.761153:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784505024:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.761160:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c5df180/0xdfc0fb148802384 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b52 expref: 20806 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.761166:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.761167:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.761171:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.761188:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c5df180/0xdfc0fb148802384 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b52 expref: 20806 pid: 16470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.761197:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c5df180/0xdfc0fb148802384 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b52 expref: 20806 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.761207:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784508480:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.761216:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784505152:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.761228:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94e40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.761240:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880121aa0900/0xdfc0fb148a3aa2f lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e8 expref: 24482 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.761246:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa0900, rc 0) 00000100:00100000:1.0:1713481296.761259:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:10409:x1796714882476416:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5309us (5335us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.761263:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563113 00000100:00100000:1.0:1713481296.761287:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784505472:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.761299:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.761300:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.761322:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478720 00000100:00100000:3.0:1713481296.761326:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478720 00000100:00100000:3.0:1713481296.761344:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485829 00000100:00100000:3.0:1713481296.761349:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2030:18828:x1796714882478720:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.761357:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.761367:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4480/0xdfc0fb148a3ab86 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49643 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.761410:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784505536:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.761426:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.761443:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.761450:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761456:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761461:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761467:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761471:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761475:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800821a4240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.761478:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761483:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761490:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff88008bd1db00) 00010000:00010000:3.0:1713481296.761492:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1713481296.761495:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761500:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4240/0xdfc0fb148a3ab8d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.761548:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4480/0xdfc0fb148a3ab86 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49643 expref: 2031 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.761555:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800821a4480/0xdfc0fb148a3ab86 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49643 expref: 2031 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.761569:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800821a4480, rc 0) 00000100:00100000:3.0:1713481296.761594:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2030:18828:x1796714882478720:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 244us (296us total) trans 0 rc 301/301 00000100:00100000:3.0:1713481296.761600:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485829 00000100:00100000:1.0:1713481296.761719:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784506048:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.761732:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.761751:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.761766:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478848 00000100:00100000:1.0:1713481296.761768:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478848 00000100:00100000:1.0:1713481296.761781:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125684 00000100:00100000:1.0:1713481296.761784:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2373:18729:x1796714882478848:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:1.0:1713481296.761857:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2374:18729:x1796714882478848:12345-192.168.202.24@tcp:35:rm.0 Request processed in 71us (157us total) trans 4295107593 rc 0/0 00000100:00100000:1.0:1713481296.761862:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125684 00000100:00100000:0.0:1713481296.761872:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784506176:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.761887:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.761898:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083452a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784506368:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.761911:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784506432:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.761915:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121aa2f40/0xdfc0fb148a3aab4 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495f6 expref: 16878 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.761921:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa2f40, rc 0) 00010000:00010000:2.0:1713481296.761924:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.761932:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16878:11552:x1796714882476672:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4016us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.761937:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563119 00000100:00100000:2.0:1713481296.761937:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1959:x1796714882475584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3800us (4101us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.761942:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820319 00000100:00100000:0.0:1713481296.761965:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.761986:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479360 00000100:00100000:3.0:1713481296.761990:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479360 00000100:00100000:3.0:1713481296.762019:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485830 00000100:00100000:3.0:1713481296.762024:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2374:18382:x1796714882479360:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.762031:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.762041:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e347840/0xdfc0fb148a3ab94 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4964a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.762100:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.762111:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.762145:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.762151:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.762156:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:2.0:1713481296.762163:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478912 00010000:00010000:3.0:1713481296.762163:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.762166:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478912 00000100:00100000:0.0:1713481296.762168:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.762169:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762174:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080382f40/0xdfc0fb14893ab83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db403 expref: 26895 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.762178:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.762190:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479040 00010000:00010000:3.0:1713481296.762190:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.762192:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479040 00000100:00100000:0.0:1713481296.762194:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479168 00010000:00010000:3.0:1713481296.762195:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.762196:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479168 00010000:00010000:2.0:1713481296.762198:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880079aaa1c0/0xdfc0fb14880235a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962af0 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.762200:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.762205:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.762207:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0b40/0xdfc0fb148688e5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bdb expref: 26896 pid: 16451 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.762207:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820331 00000100:00100000:2.0:1713481296.762210:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26896:1960:x1796714882478912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.762210:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801346b3cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.762212:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762214:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.762216:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080382f40/0xdfc0fb14893ab83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db403 expref: 26896 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.762217:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762225:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080382f40/0xdfc0fb14893ab83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db403 expref: 26896 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.762228:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88008bd1d900) 00010000:00010000:3.0:1713481296.762230:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.762233:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080382f40/0xdfc0fb14893ab83 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db403 expref: 26896 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.762233:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.762237:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801346b3cc0/0xdfc0fb148a3ab9b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762240:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.762252:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.762253:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26895:1960:x1796714882478912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.762257:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820331 00010000:00010000:3.0:1713481296.762257:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.762262:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.762266:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800942a8240 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.762267:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820332 00000100:00100000:2.0:1713481296.762269:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20807:1960:x1796714882479040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.762269:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762273:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.762274:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762276:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880079aaa1c0/0xdfc0fb14880235a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962af0 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.762280:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880079aaa1c0/0xdfc0fb14880235a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962af0 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.762280:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x3531 (ffff88008bd1d300) 00010000:00010000:3.0:1713481296.762281:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.762284:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762288:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079aaa1c0/0xdfc0fb14880235a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962af0 expref: 20807 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.762288:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3aba2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.762298:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.762299:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.762301:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.762306:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.762316:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.762321:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e347840/0xdfc0fb148a3ab94 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4964a expref: 2375 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.762324:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:1960:x1796714882479040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.762328:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820332 00010000:00010000:3.0:1713481296.762329:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e347840/0xdfc0fb148a3ab94 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4964a expref: 2375 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.762342:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e347840, rc 0) 00000100:00100000:0.0:1713481296.762366:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820333 00000100:00100000:3.0:1713481296.762366:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2374:18382:x1796714882479360:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 341us (400us total) trans 0 rc 301/301 00000100:00100000:0.0:1713481296.762371:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26894:1960:x1796714882479168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.762372:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485830 00010000:00010000:0.0:1713481296.762378:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.762381:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0b40/0xdfc0fb148688e5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa933:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bdb expref: 26894 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.762386:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0b40/0xdfc0fb148688e5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa933:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bdb expref: 26894 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.762429:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0b40/0xdfc0fb148688e5f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa933:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bdb expref: 26894 pid: 16451 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.762438:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.762439:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.762440:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.762445:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.762458:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.762524:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26893:1960:x1796714882479168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 151us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.762531:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820333 00000100:00100000:0.0:1713481296.762635:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.762647:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479296 00000100:00100000:0.0:1713481296.762651:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479296 00000100:00100000:0.0:1713481296.762688:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98366 00000100:00100000:0.0:1713481296.762694:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:1960:x1796714882479296:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.762704:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.762713:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094003180/0xdfc0fb148a3aa1a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495cc expref: 2202 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.762725:0:14813:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff880131402e00) 00010000:00010000:0.0:1713481296.762728:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.762809:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2201:1960:x1796714882479296:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 113us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.762815:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98366 00000100:00100000:2.0:1713481296.762822:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.762832:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882478976 00000100:00100000:0.0:1713481296.762834:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882478976 00000100:00100000:1.0:1713481296.762834:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2028:18678:x1796714882477632:12345-192.168.202.24@tcp:37:rm.0 Request processed in 3827us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.762838:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125682 00010000:00010000:0.0:1713481296.762843:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008372af40/0xdfc0fb14891d437 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6f3 expref: 24481 pid: 15498 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.762849:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.762856:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.762861:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.762865:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.762868:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479104 00010000:00010000:1.0:1713481296.762869:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.762871:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479104 00000100:00100000:0.0:1713481296.762872:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820334 00010000:00010000:1.0:1713481296.762873:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.762877:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1960:x1796714882478976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.762877:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa2640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.762879:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.762879:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303dd440/0xdfc0fb148688e58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bcd expref: 26893 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.762883:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.762885:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.762889:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008372af40/0xdfc0fb14891d437 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6f3 expref: 24481 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.762891:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.762895:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121aa2640/0xdfc0fb148a3aa59 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.762898:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008372af40/0xdfc0fb14891d437 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6f3 expref: 24481 pid: 15498 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.762898:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820335 00000100:00100000:2.0:1713481296.762901:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26893:1960:x1796714882479104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.762906:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.762908:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303dd440/0xdfc0fb148688e58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa932:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bcd expref: 26893 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.762913:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008372af40/0xdfc0fb14891d437 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6f3 expref: 24481 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.762913:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303dd440/0xdfc0fb148688e58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa932:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bcd expref: 26893 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.762923:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303dd440/0xdfc0fb148688e58 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa932:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bcd expref: 26893 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.762930:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.762931:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.762932:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.762932:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.762934:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.762935:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121aa0900/0xdfc0fb148a3aa2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e8 expref: 24480 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.762938:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.762943:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa0900/0xdfc0fb148a3aa2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e8 expref: 24480 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.762948:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.762959:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26892:1960:x1796714882479104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.762961:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880121aa0900/0xdfc0fb148a3aa2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495e8 expref: 24480 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.762962:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820335 00000100:00100000:0.0:1713481296.762969:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784508544:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.762987:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.762994:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.762995:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+164:3490:x1796714784505280:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6403us (6504us total) trans 4296040826 rc 0/0 00000100:00100000:1.0:1713481296.762999:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563114 00000100:00100000:2.0:1713481296.763002:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479232 00000100:00100000:2.0:1713481296.763004:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479232 00010000:00010000:2.0:1713481296.763010:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303dc900/0xdfc0fb148688e6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2be9 expref: 26892 pid: 16503 timeout: 815 lvb_type: 1 00000004:00080000:0.0:1713481296.763013:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078180380/2, rc 0, transno 1073530 00010000:00010000:1.0:1713481296.763015:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.763020:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784505280:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.763020:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763024:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763028:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763028:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820336 00000100:00100000:2.0:1713481296.763031:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26892:1960:x1796714882479232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.763033:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.763035:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.763036:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300dd40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.763037:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303dc900/0xdfc0fb148688e6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa934:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2be9 expref: 26892 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.763038:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763041:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.763042:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.763042:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303dc900/0xdfc0fb148688e6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa934:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2be9 expref: 26892 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.763050:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763053:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3aa7c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.763054:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303dc900/0xdfc0fb148688e6d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa934:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2be9 expref: 26892 pid: 16503 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.763061:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.763062:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.763063:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479424 00010000:00010000:2.0:1713481296.763064:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.763068:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.763068:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479424 00000100:00100000:0.0:1713481296.763070:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.763081:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.763082:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8846c0/0xdfc0fb148959c4b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc9 expref: 16878 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.763086:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763092:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882479232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.763093:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763095:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820336 00010000:00010000:0.0:1713481296.763100:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.763102:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820337 00000100:00100000:3.0:1713481296.763108:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16878:1960:x1796714882479424:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.763111:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.763115:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.763117:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763136:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713481296.763139:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300e1c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.763140:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007994dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784508608:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.763143:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.763150:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.763150:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8846c0/0xdfc0fb148959c4b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc9 expref: 16878 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.763155:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.763160:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8846c0/0xdfc0fb148959c4b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc9 expref: 16878 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.763163:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.763169:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3aa98 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.763180:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8846c0/0xdfc0fb148959c4b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebc9 expref: 16878 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.763192:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.763193:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2766:3492:x1796714784505600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5897us (6136us total) trans 4295960706 rc 0/0 00010000:00010000:3.0:1713481296.763195:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.763197:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563116 00000004:00080000:2.0:1713481296.763198:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880086965500/2, rc 0, transno 993410 00010000:00010000:3.0:1713481296.763198:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121aa2f40/0xdfc0fb148a3aab4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495f6 expref: 16877 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763204:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784505600:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.763205:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa2f40/0xdfc0fb148a3aab4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495f6 expref: 16877 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.763209:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784508608 00000100:00100000:1.0:1713481296.763211:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784508608 00000100:00100000:1.0:1713481296.763221:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563138 00000100:00100000:1.0:1713481296.763224:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+164:3492:x1796714784508608:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.763226:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800773c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784508672:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.763227:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880121aa2f40/0xdfc0fb148a3aab4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495f6 expref: 16877 pid: 16497 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.763231:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9979 count 1 00000100:00100000:3.0:1713481296.763236:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fe78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784508736:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.763238:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.763241:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763255:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb14880238b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b60 expref: 20805 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.763261:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.763261:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.763263:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.763265:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763282:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb14880238b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b60 expref: 20805 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.763285:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2766:3491:x1796714784506112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5698us (5740us total) trans 4295960707 rc 0/0 00000100:00100000:0.0:1713481296.763289:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563118 00010000:00010000:1.0:1713481296.763291:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb14880238b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b60 expref: 20805 pid: 16529 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.763295:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013499c000/2, rc 0, transno 993411 00000100:00100000:0.0:1713481296.763301:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784508672 00000100:00100000:1.0:1713481296.763301:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784508800:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.763303:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784508672 00000100:00100000:3.0:1713481296.763312:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013499c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784506112:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.763315:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563139 00000100:00100000:0.0:1713481296.763317:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2766:3490:x1796714784508672:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.763318:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042240 going to sleep for 11 seconds 00002000:00080000:0.0:1713481296.763325:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43322 count 1 00010000:00010000:0.0:1713481296.763332:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.763339:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801366ac240/0xdfc0fb148688ef2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c3d expref: 26890 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.763340:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083450380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784506752:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.763343:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.763344:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.763346:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763354:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713481296.763355:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801366ac240/0xdfc0fb148688ef2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c3d expref: 26890 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.763359:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784508864:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.763360:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801366ac240/0xdfc0fb148688ef2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c3d expref: 26890 pid: 15547 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.763365:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5d40/0xdfc0fb148a3aad7 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49612 expref: 16877 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.763366:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784508928:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.763371:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.763374:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2a5d40, rc 0) 00000100:00100000:0.0:1713481296.763379:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.763387:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784508864 00000100:00100000:1.0:1713481296.763389:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16877:8499:x1796714882477568:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4798us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.763391:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784508864 00000100:00100000:1.0:1713481296.763393:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563123 00000100:00100000:2.0:1713481296.763399:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.763409:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479808 00000100:00100000:3.0:1713481296.763411:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479808 00000100:00100000:1.0:1713481296.763415:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563140 00000100:00100000:1.0:1713481296.763419:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2767:3490:x1796714784508864:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.763424:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.763426:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563141 00002000:00080000:1.0:1713481296.763427:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43323 count 1 00000100:00100000:3.0:1713481296.763431:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:10479:x1796714882479808:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.763432:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479872 00010000:00010000:1.0:1713481296.763435:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763435:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479872 00010000:00010000:3.0:1713481296.763438:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.763441:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080184000/0xdfc0fb148688ec1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c4b expref: 26890 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.763445:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.763446:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.763446:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563142 00010000:00010000:1.0:1713481296.763447:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.763448:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942aaf40/0xdfc0fb148a3abbe lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49651 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.763449:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20807:18792:x1796714882479872:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.763454:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.763457:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080184000/0xdfc0fb148688ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c4b expref: 26890 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.763460:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008698e400/0xdfc0fb148a3abc5 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc516:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49658 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.763461:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086964700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784506816:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.763462:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080184000/0xdfc0fb148688ec1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c4b expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.763462:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e65b00/0xdfc0fb148916d9f lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6576 expref: 20808 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.763468:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096760a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784508992:192.168.202.24@tcp:104: 00002000:00010000:2.0:1713481296.763468:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc516:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.763472:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.763474:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.763474:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.763474:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.763475:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.763477:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942aaf40/0xdfc0fb148a3abbe lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49651 expref: 20809 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.763478:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008698e400/0xdfc0fb148a3abc5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49658 expref: 20809 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.763480:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042c00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.763484:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008698e400/0xdfc0fb148a3abc5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc516:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49658 expref: 20809 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.763489:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008698e400, rc 0) 00010000:00010000:3.0:1713481296.763492:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e65b00/0xdfc0fb148916d9f lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6576 expref: 20809 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.763497:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083451f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784506624:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.763501:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20809:18792:x1796714882479872:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 51us (76us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.763501:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e65b00/0xdfc0fb148916d9f lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6576 expref: 20809 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.763505:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563142 00000100:00100000:3.0:1713481296.763510:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784509056:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.763514:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.763529:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880089a5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784506880:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.763529:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784507072:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.763536:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88b40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.763540:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763541:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.763552:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20808:1957:x1796714882477184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4794us (5028us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.763557:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820321 00000100:00100000:1.0:1713481296.763583:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083451500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784506560:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.763586:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.763595:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880121aa0000/0xdfc0fb148a3aac2 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495fd expref: 24480 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763601:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa0000, rc 0) 00000100:00100000:1.0:1713481296.763612:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:14753:x1796714882476736:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5394us (5422us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.763615:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563120 00000100:00100000:0.0:1713481296.763618:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784507328:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.763628:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479936 00000100:00100000:1.0:1713481296.763630:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479936 00010000:00010000:0.0:1713481296.763632:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.763639:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563143 00000100:00100000:1.0:1713481296.763642:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16877:17009:x1796714882479936:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.763646:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.763652:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801205086c0/0xdfc0fb148a3abcc lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4965f expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.763659:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.763680:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.763681:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.763684:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801205086c0/0xdfc0fb148a3abcc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4965f expref: 16878 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763693:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801205086c0/0xdfc0fb148a3abcc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4965f expref: 16878 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763697:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801205086c0, rc 0) 00000100:00100000:1.0:1713481296.763708:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16878:17009:x1796714882479936:12345-192.168.202.24@tcp:101:dd.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.763711:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563143 00000100:00100000:1.0:1713481296.763734:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784507392:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.763747:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763757:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763761:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763765:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763768:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763772:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763779:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300eac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.763781:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763784:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763792:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.763796:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013300eac0/0xdfc0fb148a3aa60 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.763890:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2768:3490:x1796714784505408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7191us (7267us total) trans 4295960708 rc 0/0 00000100:00100000:1.0:1713481296.763894:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563115 00000100:00100000:1.0:1713481296.763912:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479552 00000004:00080000:2.0:1713481296.763913:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078183b80/2, rc 0, transno 993412 00000100:00100000:1.0:1713481296.763914:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479552 00000100:00100000:2.0:1713481296.763919:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784505408:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.763924:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125685 00000100:00100000:1.0:1713481296.763927:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2028:18913:x1796714882479552:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1713481296.763940:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784509120:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.763952:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.763970:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784509120 00000100:00100000:0.0:1713481296.763974:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784509120 00000100:00100000:0.0:1713481296.763993:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563144 00000100:00100000:1.0:1713481296.763995:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2029:18913:x1796714882479552:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 65us (922us total) trans 4295107594 rc 0/0 00000100:00100000:0.0:1713481296.763998:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2768:3492:x1796714784509120:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.764001:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125685 00002000:00080000:0.0:1713481296.764009:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43324 count 1 00010000:00010000:0.0:1713481296.764019:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.764028:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d26400/0xdfc0fb148688ec8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c59 expref: 26890 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.764034:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.764035:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.764037:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.764051:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d26400/0xdfc0fb148688ec8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c59 expref: 26890 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.764059:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d26400/0xdfc0fb148688ec8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c59 expref: 26890 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.764068:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784509184:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.764086:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.764416:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.764419:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.764467:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784507584:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.764480:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481472 00000100:00100000:2.0:1713481296.764483:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481472 00010000:00010000:1.0:1713481296.764486:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.764491:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480000 00000100:00100000:0.0:1713481296.764494:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480000 00000100:00100000:2.0:1713481296.764497:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485831 00000100:00100000:2.0:1713481296.764500:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2201:18915:x1796714882481472:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.764513:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.764517:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563145 00010000:00010000:2.0:1713481296.764518:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008698fa80/0xdfc0fb148a3abda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49697 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.764521:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20808:15045:x1796714882480000:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.764527:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.764533:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.764535:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3abe1 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49666 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.764538:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480192 00000100:00100000:3.0:1713481296.764539:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784507968:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.764541:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480192 00002000:00010000:0.0:1713481296.764544:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.764550:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.764551:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.764553:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563146 00010000:00010000:0.0:1713481296.764554:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3abe1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49666 expref: 20810 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.764556:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:17924:x1796714882480192:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.764560:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a26d5f80/0xdfc0fb148a3abe1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49666 expref: 20810 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.764562:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.764563:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.764565:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a26d5f80, rc 0) 00010000:00010000:1.0:1713481296.764570:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012050aac0/0xdfc0fb148a3abe8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b41:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4966d expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.764573:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764579:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.764580:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20811:15045:x1796714882480000:12345-192.168.202.24@tcp:101:dd.0 Request processed in 59us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.764581:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880121e32640/0xdfc0fb148a15fd3 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39828 expref: 20811 pid: 16455 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.764584:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563145 00010000:00010000:2.0:1713481296.764584:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.764586:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.764587:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.764589:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050aac0/0xdfc0fb148a3abe8 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4966d expref: 20811 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.764590:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764594:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764597:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.764600:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880121e32640/0xdfc0fb148a15fd3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39828 expref: 20810 pid: 16455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.764605:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880121e32640/0xdfc0fb148a15fd3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39828 expref: 20810 pid: 16455 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.764610:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784509248:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.764610:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698ef40/0xdfc0fb148a3abfd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764613:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008698ef40/0xdfc0fb148a3abfd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764617:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008698ef40/0xdfc0fb148a3abfd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764621:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764624:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.764626:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.764626:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764629:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764632:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008698cb40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.764633:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.764636:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784508032:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.764636:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764640:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.764642:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.764643:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764646:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cb40/0xdfc0fb148a3abef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.764653:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.764654:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784508096:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.764657:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764660:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764676:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764679:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008698cfc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.764680:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764683:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764687:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff88011d25c300) 00010000:00010000:2.0:1713481296.764688:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.764689:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.764692:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008698cfc0/0xdfc0fb148a3abf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.764693:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.764713:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008698fa80/0xdfc0fb148a3abda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49697 expref: 2203 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.764722:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008698ef40/0xdfc0fb148a3abfd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49697 expref: 2202 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.764725:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88011d25c800) 00010000:00010000:2.0:1713481296.764727:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.764728:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008698ef40, rc 0) 00000100:00100000:2.0:1713481296.764742:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18915:x1796714882481472:12345-192.168.202.24@tcp:101:dd.0 Request processed in 241us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.764746:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485831 00000100:00100000:2.0:1713481296.764771:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784507520:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.764786:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.764793:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784508416:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.764798:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:1957:x1796714882478336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4892us (4938us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.764802:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820330 00010000:00010000:1.0:1713481296.764813:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.764815:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.764815:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784508480:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.764820:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784507456:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.764830:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.764836:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.764838:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1957:x1796714882478016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5053us (5281us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.764841:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820329 00000100:00100000:2.0:1713481296.764881:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479616 00000100:00100000:2.0:1713481296.764883:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479616 00010000:00010000:2.0:1713481296.764889:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133a86880/0xdfc0fb148a13e77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fc4 expref: 24479 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.764907:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820338 00000100:00100000:2.0:1713481296.764910:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882479616:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.764914:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.764920:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133a86880/0xdfc0fb148a13e77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fc4 expref: 24479 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.764926:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133a86880/0xdfc0fb148a13e77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fc4 expref: 24479 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.764937:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.764940:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133a86880/0xdfc0fb148a13e77 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fc4 expref: 24479 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.764949:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.764950:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.764951:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479744 00010000:00010000:2.0:1713481296.764952:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121aa0000/0xdfc0fb148a3aac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495fd expref: 24478 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.764953:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479744 00010000:00010000:2.0:1713481296.764956:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa0000/0xdfc0fb148a3aac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495fd expref: 24478 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.764963:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19d8c0/0xdfc0fb1488e7e5a lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5502 expref: 16878 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.764966:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880121aa0000/0xdfc0fb148a3aac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa495fd expref: 24478 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.764972:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800773c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784509312:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.764982:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820339 00000100:00100000:2.0:1713481296.764984:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800916e2300 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.764989:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16878:1960:x1796714882479744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.764996:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.765000:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c19d8c0/0xdfc0fb1488e7e5a lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5502 expref: 16878 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.765002:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007994e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784508352:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.765008:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c19d8c0/0xdfc0fb1488e7e5a lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5502 expref: 16878 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.765015:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765025:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19d8c0/0xdfc0fb1488e7e5a lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5502 expref: 16878 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765040:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.765042:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.765045:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5d40/0xdfc0fb148a3aad7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49612 expref: 16877 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765052:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5d40/0xdfc0fb148a3aad7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49612 expref: 16877 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765065:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5d40/0xdfc0fb148a3aad7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49612 expref: 16877 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.765071:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784509376:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.765086:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.765164:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.765195:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480512 00000100:00100000:2.0:1713481296.765198:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480512 00000100:00100000:0.0:1713481296.765199:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.765205:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099964900/0xdfc0fb148688eac lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c21 expref: 26891 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.765220:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480704 00000100:00100000:2.0:1713481296.765222:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480704 00010000:00010000:2.0:1713481296.765226:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077239b00/0xdfc0fb14880237d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b44 expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.765228:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820340 00000100:00100000:3.0:1713481296.765235:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26891:1960:x1796714882480512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.765236:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820341 00000100:00100000:2.0:1713481296.765239:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:1960:x1796714882480704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.765244:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.765246:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077239b00/0xdfc0fb14880237d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b44 expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.765247:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.765251:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077239b00/0xdfc0fb14880237d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b44 expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.765253:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099964900/0xdfc0fb148688eac lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa938:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c21 expref: 26891 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.765260:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.765263:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077239b00/0xdfc0fb14880237d lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b44 expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.765263:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099964900/0xdfc0fb148688eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa938:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c21 expref: 26891 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.765270:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.765270:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.765272:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765277:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.765281:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099964900/0xdfc0fb148688eac lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa938:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c21 expref: 26891 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.765282:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.765287:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.765293:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.765294:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.765294:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.765296:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480768 00010000:00010000:3.0:1713481296.765297:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.765299:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480768 00000100:00100000:2.0:1713481296.765301:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20809:1960:x1796714882480704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (103us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.765304:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765305:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820341 00000100:00100000:2.0:1713481296.765314:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882479680 00000100:00100000:2.0:1713481296.765316:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882479680 00000100:00100000:1.0:1713481296.765318:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563147 00010000:00010000:2.0:1713481296.765321:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007723a880/0xdfc0fb148802353 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962afe expref: 20809 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.765322:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16878:18836:x1796714882480768:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.765322:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.765327:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.765329:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480128 00000100:00100000:2.0:1713481296.765330:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480128 00010000:00010000:2.0:1713481296.765334:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b138000/0xdfc0fb148802361 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b0c expref: 20810 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765335:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120508000/0xdfc0fb148a3ac04 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49674 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765341:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820342 00000100:00100000:2.0:1713481296.765343:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:1960:x1796714882479680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.765344:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26890:1960:x1796714882480512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 109us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.765346:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb14891e976 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb5b7 expref: 20810 pid: 16475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765347:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.765348:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.765349:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007723a880/0xdfc0fb148802353 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962afe expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765350:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.765351:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.765353:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120508000/0xdfc0fb148a3ac04 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49674 expref: 16879 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.765353:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820340 00010000:00010000:2.0:1713481296.765355:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007723a880/0xdfc0fb148802353 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962afe expref: 20810 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.765361:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480384 00010000:00010000:1.0:1713481296.765363:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb14891e976 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb5b7 expref: 20810 pid: 16475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.765364:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480384 00010000:00010000:2.0:1713481296.765366:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007723a880/0xdfc0fb148802353 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962afe expref: 20811 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765369:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb14891e976 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb5b7 expref: 20811 pid: 16475 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.765373:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.765374:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784509440:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.765374:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.765376:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.765376:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820343 00010000:00010000:0.0:1713481296.765377:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880079aabcc0/0xdfc0fb14880236f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b36 expref: 20810 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.765380:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.765381:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:1958:x1796714882480128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.765388:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.765389:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042a80 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.765389:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.765394:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b138000/0xdfc0fb148802361 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b0c expref: 20810 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.765395:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820344 00010000:00010000:1.0:1713481296.765398:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765398:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:1960:x1796714882479680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.765400:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20810:1960:x1796714882480384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.765402:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765402:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820342 00010000:00010000:3.0:1713481296.765404:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b138000/0xdfc0fb148802361 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b0c expref: 20810 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765406:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765407:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.765410:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765412:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880079aabcc0/0xdfc0fb14880236f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b36 expref: 20809 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765414:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765417:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa1200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.765419:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765421:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880079aabcc0/0xdfc0fb14880236f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b36 expref: 20809 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.765422:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b138000/0xdfc0fb148802361 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b0c expref: 20809 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765423:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765432:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765434:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079aabcc0/0xdfc0fb14880236f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b36 expref: 20808 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.765435:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.765436:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121aa1200/0xdfc0fb148a3aac9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.765437:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.765439:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765444:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.765446:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.765446:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765448:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765459:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.765461:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.765466:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765471:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765475:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765479:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.765480:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20807:1958:x1796714882480128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 97us (184us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.765482:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765485:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008698f600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.765487:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.765487:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820343 00010000:00010000:2.0:1713481296.765494:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765500:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765504:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008698f600/0xdfc0fb148a3aae5 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.765510:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.765518:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.765526:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.765536:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+165:3491:x1796714784506496:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7234us (7293us total) trans 4296040827 rc 0/0 00010000:00010000:3.0:1713481296.765539:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.765540:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563121 00010000:00010000:3.0:1713481296.765546:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765547:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.765552:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079920900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.765555:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765558:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.765561:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:1960:x1796714882480384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 161us (213us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.765562:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765563:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.765566:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820344 00010000:00010000:1.0:1713481296.765567:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765571:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765574:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765578:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2a5f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.765578:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765580:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765584:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.765584:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079920900/0xdfc0fb148a3ab63 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765592:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765595:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ab78 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765595:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+165:3493:x1796714784507008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6124us (6311us total) trans 4296040828 rc 0/0 00000100:00100000:2.0:1713481296.765600:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563125 00000100:00100000:0.0:1713481296.765610:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.765622:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011da4ed80/2, rc 0, transno 1073532 00000100:00100000:0.0:1713481296.765626:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480576 00000100:00100000:2.0:1713481296.765626:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784507008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.765629:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480576 00010000:00010000:0.0:1713481296.765641:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080184d80/0xdfc0fb148688eb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c2f expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.765645:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.765649:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007994e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784509504:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.765658:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820345 00000100:00100000:2.0:1713481296.765661:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.765662:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26890:1960:x1796714882480576:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.765684:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.765688:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080184d80/0xdfc0fb148688eb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa939:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c2f expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.765697:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080184d80/0xdfc0fb148688eb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa939:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c2f expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.765699:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+165:3490:x1796714784508224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4677us (4708us total) trans 4296040829 rc 0/0 00000100:00100000:1.0:1713481296.765703:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563136 00000004:00080000:2.0:1713481296.765703:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800773c1880/2, rc 0, transno 1073533 00000100:00100000:2.0:1713481296.765706:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800773c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784508224:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.765711:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080184d80/0xdfc0fb148688eb3 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa939:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c2f expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.765716:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784509504 00000100:00100000:1.0:1713481296.765718:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784509504 00000100:00100000:2.0:1713481296.765721:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784509568:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.765726:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.765727:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.765727:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563148 00000100:00100000:1.0:1713481296.765729:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+165:3492:x1796714784509504:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.765730:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765733:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.765737:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.765737:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9980 count 1 00010000:00010000:1.0:1713481296.765745:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765750:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784509568 00010000:00010000:1.0:1713481296.765751:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007723a1c0/0xdfc0fb148802392 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b6e expref: 20805 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.765752:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784509568 00010000:00010000:0.0:1713481296.765754:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.765759:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.765760:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.765761:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765762:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563149 00000100:00100000:2.0:1713481296.765765:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+166:3490:x1796714784509568:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.765771:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007723a1c0/0xdfc0fb148802392 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b6e expref: 20805 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.765772:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26889:1960:x1796714882480576:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 108us (160us total) trans 0 rc 0/0 00002000:00080000:2.0:1713481296.765773:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9981 count 1 00010000:00010000:1.0:1713481296.765776:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007723a1c0/0xdfc0fb148802392 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b6e expref: 20805 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.765780:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820345 00010000:00010000:2.0:1713481296.765781:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.765782:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784509632:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.765782:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007796c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2769:3492:x1796714784507840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5040us (5113us total) trans 4295960709 rc 0/0 00010000:00010000:2.0:1713481296.765788:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148802aae lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b7c expref: 20805 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.765790:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563133 00010000:00010000:2.0:1713481296.765793:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.765793:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.765795:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.765796:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012362f6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.765804:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148802aae lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b7c expref: 20805 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.765806:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.765809:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148802aae lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b7c expref: 20805 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.765811:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765815:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.765815:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011da4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784509696:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.765821:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765828:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.765831:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013499ce00/2, rc 0, transno 1073531 00000100:00100000:2.0:1713481296.765832:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.765834:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2a4000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.765836:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.765838:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013499ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784506496:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.765843:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.765848:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.765852:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007796df80/2, rc 0, transno 993413 00000100:00100000:2.0:1713481296.765857:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007796df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784507840:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.765859:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.765865:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ab24 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.765876:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784509760:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.765884:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482368 00000100:00100000:2.0:1713481296.765886:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482368 00000100:00100000:0.0:1713481296.765887:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.765896:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485832 00000100:00100000:2.0:1713481296.765899:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2029:18915:x1796714882482368:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.765901:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.765905:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480320 00000100:00100000:0.0:1713481296.765908:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480320 00010000:00010000:2.0:1713481296.765911:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.765917:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008698e1c0/0xdfc0fb148a3ac19 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496b3 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.765920:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077238d80/0xdfc0fb148802368 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b1a expref: 20806 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.765937:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820346 00000100:00100000:0.0:1713481296.765942:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:1958:x1796714882480320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.765949:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.765953:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077238d80/0xdfc0fb148802368 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b1a expref: 20806 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.765961:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077238d80/0xdfc0fb148802368 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b1a expref: 20806 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.765975:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+167:3493:x1796714784507264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5950us (5980us total) trans 4296040830 rc 0/0 00010000:00010000:0.0:1713481296.765977:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077238d80/0xdfc0fb148802368 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b1a expref: 20806 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.765979:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563131 00010000:00010000:0.0:1713481296.765989:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:2.0:1713481296.765989:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c3:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.765991:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.765993:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.765993:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784509760 00000100:00100000:1.0:1713481296.765995:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784509760 00010000:00010000:0.0:1713481296.766000:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766005:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008698e1c0/0xdfc0fb148a3ac19 lrc: 1/0,0 mode: --/CW res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496b3 expref: 2030 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766010:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008698e1c0/0xdfc0fb148a3ac19 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496b3 expref: 2030 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.766014:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563150 00010000:00010000:0.0:1713481296.766016:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.766017:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+167:3491:x1796714784509760:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.766018:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008698e1c0, rc 0) 00002000:00080000:1.0:1713481296.766025:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9982 count 1 00000100:00100000:0.0:1713481296.766032:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:1958:x1796714882480320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 89us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.766033:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.766033:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2029:18915:x1796714882482368:12345-192.168.202.24@tcp:101:dd.0 Request processed in 133us (187us total) trans 0 rc 301/301 00000100:00100000:2.0:1713481296.766036:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485832 00000100:00100000:0.0:1713481296.766039:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820346 00010000:00010000:1.0:1713481296.766040:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c583cc0/0xdfc0fb148802ab5 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b8a expref: 20805 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.766047:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.766048:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.766050:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766059:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c583cc0/0xdfc0fb148802ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b8a expref: 20804 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.766064:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c583cc0/0xdfc0fb148802ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b8a expref: 20804 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.766069:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784509888:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.766069:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784509824:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.766084:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880088150900 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.766093:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766097:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766101:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766105:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766108:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766112:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2a58c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.766114:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766133:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766143:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766147:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ab01 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.766200:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.766222:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784509824 00000100:00100000:2.0:1713481296.766224:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784509824 00000100:00100000:2.0:1713481296.766240:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563151 00000100:00100000:2.0:1713481296.766243:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007db7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+2769:3492:x1796714784509824:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.766252:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43325 count 1 00000100:00100000:1.0:1713481296.766258:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+168:3490:x1796714784507136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6551us (6629us total) trans 4296040831 rc 0/0 00010000:00010000:2.0:1713481296.766259:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.766262:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563129 00010000:00010000:2.0:1713481296.766265:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c51d40/0xdfc0fb148688f1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c6e expref: 26888 pid: 16510 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.766269:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766270:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766272:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766282:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c51d40/0xdfc0fb148688f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c6e expref: 26888 pid: 16510 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.766287:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c51d40/0xdfc0fb148688f1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c6e expref: 26888 pid: 16510 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.766290:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011da4ea00/2, rc 0, transno 1073535 00000100:00100000:2.0:1713481296.766292:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784509952:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.766302:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784507136:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.766305:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364d80 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.766323:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011da4c380/2, rc 0, transno 1073534 00000100:00100000:2.0:1713481296.766326:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784507264:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.766332:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784510016:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.766344:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.766345:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510080:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.766359:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.766362:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766367:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766371:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766375:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.766377:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510016 00000100:00100000:1.0:1713481296.766382:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510080 00010000:00010000:2.0:1713481296.766382:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.766382:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510016 00000100:00100000:1.0:1713481296.766384:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510080 00010000:00010000:2.0:1713481296.766385:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008698df80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.766387:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766391:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.766398:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563152 00010000:00010000:2.0:1713481296.766398:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.766400:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+169:3490:x1796714784510080:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.766401:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008698df80/0xdfc0fb148a3ab71 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.766404:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563153 00002000:00080000:1.0:1713481296.766409:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9984 count 1 00000100:00100000:3.0:1713481296.766410:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007db7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+169:3493:x1796714784510016:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.766417:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.766422:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9983 count 1 00010000:00010000:1.0:1713481296.766425:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135894d80/0xdfc0fb148802ac3 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ba6 expref: 20804 pid: 16452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.766429:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.766430:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.766432:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766435:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766441:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135894d80/0xdfc0fb148802ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ba6 expref: 20804 pid: 16452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.766446:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135894d80/0xdfc0fb148802ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ba6 expref: 20804 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.766447:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f932640/0xdfc0fb148802abc lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b98 expref: 20804 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.766451:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784510144:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.766453:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.766455:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.766457:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.766465:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c991c00 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.766473:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f932640/0xdfc0fb148802abc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b98 expref: 20804 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.766478:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.766482:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f932640/0xdfc0fb148802abc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b98 expref: 20804 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.766491:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784510208:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.766514:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fe78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2770:3491:x1796714784508160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5526us (5551us total) trans 4295960710 rc 0/0 00000100:00100000:3.0:1713481296.766515:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134a88840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.766518:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563135 00000100:00100000:0.0:1713481296.766536:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480640 00000100:00100000:0.0:1713481296.766540:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480640 00000004:00080000:3.0:1713481296.766543:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fe78a80/2, rc 0, transno 993414 00000100:00100000:1.0:1713481296.766549:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.766551:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784508160:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.766553:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080186d00/0xdfc0fb148688ed6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c13 expref: 26889 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.766587:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.766588:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480832 00000100:00100000:3.0:1713481296.766592:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480832 00000100:00100000:1.0:1713481296.766593:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510272:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.766605:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c5df180/0xdfc0fb148802384 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b52 expref: 20805 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.766606:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.766616:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510272 00000100:00100000:2.0:1713481296.766618:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510272 00000100:00100000:3.0:1713481296.766625:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820347 00000100:00100000:2.0:1713481296.766629:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563154 00000100:00100000:3.0:1713481296.766630:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26889:1958:x1796714882480640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.766632:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.766632:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2770:3490:x1796714784510272:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.766638:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:2.0:1713481296.766640:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43326 count 1 00010000:00010000:3.0:1713481296.766644:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080186d00/0xdfc0fb148688ed6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa937:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c13 expref: 26889 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.766646:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766653:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080186d00/0xdfc0fb148688ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa937:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c13 expref: 26889 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.766655:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480064 00010000:00010000:2.0:1713481296.766656:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d1b00/0xdfc0fb148688f23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c7c expref: 26889 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.766658:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480064 00000100:00100000:1.0:1713481296.766660:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.766660:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766661:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766678:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.766685:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123614900/0xdfc0fb148688e9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bf7 expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.766686:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.766688:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080186d00/0xdfc0fb148688ed6 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa937:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c13 expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.766689:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d0d1b00/0xdfc0fb148688f23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c7c expref: 26890 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.766694:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.766695:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d1b00/0xdfc0fb148688f23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c7c expref: 26889 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.766701:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784510336:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.766701:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.766702:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.766704:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480256 00000100:00100000:1.0:1713481296.766705:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.766705:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.766706:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480256 00010000:00010000:3.0:1713481296.766712:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.766715:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.766716:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b13aac0/0xdfc0fb148802376 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b28 expref: 20806 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.766718:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.766728:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480896 00000100:00100000:2.0:1713481296.766730:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480896 00000100:00100000:0.0:1713481296.766731:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882480448 00000100:00100000:0.0:1713481296.766733:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882480448 00000100:00100000:2.0:1713481296.766738:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481088 00000100:00100000:2.0:1713481296.766739:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481088 00010000:00010000:3.0:1713481296.766740:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.766742:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123614b40/0xdfc0fb148688ea5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c05 expref: 26890 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.766746:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563155 00000100:00100000:2.0:1713481296.766749:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16881:17935:x1796714882480896:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.766754:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.766756:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766761:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a286f40/0xdfc0fb148a3ac43 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4967b expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.766761:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26890:1958:x1796714882480640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 130us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.766763:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.766769:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820347 00010000:00010000:1.0:1713481296.766770:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.766772:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.766777:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766778:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766779:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766782:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a286f40/0xdfc0fb148a3ac43 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4967b expref: 16882 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766783:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766788:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007a286f40/0xdfc0fb148a3ac43 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4967b expref: 16882 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.766789:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2a6f40 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.766789:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820348 00010000:00010000:1.0:1713481296.766792:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766792:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a286f40, rc 0) 00000100:00100000:3.0:1713481296.766794:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:1960:x1796714882480832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.766798:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766801:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.766804:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16882:17935:x1796714882480896:12345-192.168.202.24@tcp:101:dd.0 Request processed in 54us (109us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.766806:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c5df180/0xdfc0fb148802384 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b52 expref: 20806 pid: 16470 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.766808:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563155 00010000:00010000:1.0:1713481296.766813:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766815:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c5df180/0xdfc0fb148802384 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b52 expref: 20806 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.766818:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3ab6a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.766818:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563156 00000100:00100000:2.0:1713481296.766821:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16881:18817:x1796714882481088:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.766824:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.766829:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a284d80/0xdfc0fb148a3ac4a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49682 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766829:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c5df180/0xdfc0fb148802384 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b52 expref: 20806 pid: 16470 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.766837:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095c9cfc0/0xdfc0fb1489cfa38 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22257 expref: 20805 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766841:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.766842:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.766842:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766844:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a284d80/0xdfc0fb148a3ac4a lrc: 4/0,0 mode: --/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49682 expref: 16882 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766844:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.766847:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766854:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095c9cfc0/0xdfc0fb1489cfa38 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22257 expref: 20805 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766854:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.766859:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095c9cfc0/0xdfc0fb1489cfa38 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22257 expref: 20805 pid: 16493 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.766864:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784510400:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.766865:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820349 00010000:00010000:3.0:1713481296.766869:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.766870:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26889:1958:x1796714882480064:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.766873:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095f7b6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.766878:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.766883:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123614900/0xdfc0fb148688e9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa935:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bf7 expref: 26889 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.766888:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:1960:x1796714882480832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 93us (338us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.766891:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123614900/0xdfc0fb148688e9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa935:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bf7 expref: 26889 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.766891:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820350 00000100:00100000:2.0:1713481296.766894:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083450380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:1958:x1796714882480256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.766896:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820348 00010000:00010000:2.0:1713481296.766898:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.766901:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b13aac0/0xdfc0fb148802376 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b28 expref: 20805 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.766906:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123614900/0xdfc0fb148688e9e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa935:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2bf7 expref: 26889 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.766907:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b13aac0/0xdfc0fb148802376 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b28 expref: 20805 pid: 16529 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.766916:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820351 00010000:00010000:2.0:1713481296.766917:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b13aac0/0xdfc0fb148802376 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b28 expref: 20804 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.766918:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.766918:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b05f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2771:3490:x1796714784507776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6090us (6118us total) trans 4295960711 rc 0/0 00010000:00010000:0.0:1713481296.766919:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.766921:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.766922:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26888:1958:x1796714882480448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.766925:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563134 00010000:00010000:2.0:1713481296.766925:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766925:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.766927:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.766928:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766929:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.766934:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766935:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123614b40/0xdfc0fb148688ea5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa936:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c05 expref: 26888 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.766943:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123614b40/0xdfc0fb148688ea5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa936:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c05 expref: 26888 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.766945:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.766949:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.766955:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083450380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20803:1958:x1796714882480256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (294us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.766958:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123614b40/0xdfc0fb148688ea5 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa936:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c05 expref: 26888 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.766959:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820350 00000004:00080000:1.0:1713481296.766963:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007796f480/2, rc 0, transno 993415 00000100:00100000:0.0:1713481296.766968:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26887:1958:x1796714882480064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.766971:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007796f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784507776:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.766972:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.766973:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.766975:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820349 00010000:00010000:3.0:1713481296.766976:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.766978:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481024 00000100:00100000:2.0:1713481296.766980:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481024 00010000:00010000:3.0:1713481296.766982:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.766989:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485833 00000100:00100000:2.0:1713481296.766991:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2374:18729:x1796714882481024:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:0.0:1713481296.766997:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.766998:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.767003:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767005:0:15475:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:1.0:1713481296.767006:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784510464:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.767010:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767012:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080154000/0xdfc0fb148a3a8ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x34c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49594 expref: 2374 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767015:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.767017:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26886:1958:x1796714882480448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (329us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.767021:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767024:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013667a400/0xdfc0fb148a2f873 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42f96 expref: 2373 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.767025:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.767025:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820351 00010000:00010000:0.0:1713481296.767027:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a949f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.767029:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767036:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767036:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c1:0x0].0x0 (ffff88009a9e1d00) 00010000:00010000:2.0:1713481296.767046:0:15475:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.767052:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767055:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.767058:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ab08 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767059:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.767062:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.767063:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.767064:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007796ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784506944:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.767070:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a2858c0/0xdfc0fb148a3ac58 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x347f:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.767072:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510464 00010000:00010000:2.0:1713481296.767073:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a2858c0/0xdfc0fb148a3ac58 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.767074:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510464 00010000:00010000:2.0:1713481296.767076:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007a2858c0/0xdfc0fb148a3ac58 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.767083:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481152 00000100:00100000:1.0:1713481296.767084:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481152 00010000:00010000:3.0:1713481296.767084:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.767092:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563157 00000100:00100000:1.0:1713481296.767095:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2771:3492:x1796714784510464:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.767104:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43327 count 1 00000100:00100000:3.0:1713481296.767104:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1958:x1796714882476928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 8336us (8568us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.767106:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.767110:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.767111:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767113:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.767115:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820322 00010000:00010000:1.0:1713481296.767137:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fff2640/0xdfc0fb148688f2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c8a expref: 26885 pid: 16510 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.767142:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767143:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767144:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767159:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007fff2640/0xdfc0fb148688f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c8a expref: 26885 pid: 16510 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.767164:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007fff2640/0xdfc0fb148688f2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c8a expref: 26885 pid: 16510 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.767170:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784510528:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.767181:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.767191:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+170:3490:x1796714784507200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7479us (7506us total) trans 4296040832 rc 0/0 00000100:00100000:1.0:1713481296.767196:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563158 00000100:00100000:0.0:1713481296.767199:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563130 00000100:00100000:1.0:1713481296.767199:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16883:18844:x1796714882481152:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.767204:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1713481296.767209:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c1:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.767211:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079453840/0xdfc0fb148a3ac6d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49689 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767217:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00002000:00010000:1.0:1713481296.767218:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.767220:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767223:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.767225:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767225:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767226:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.767226:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a286400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.767227:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:1.0:1713481296.767229:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079453840/0xdfc0fb148a3ac6d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49689 expref: 16884 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.767229:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767230:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.767231:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767234:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880079453840/0xdfc0fb148a3ac6d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49689 expref: 16884 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767235:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c1:0x0].0x0 (ffff88008ad2fe00) 00010000:00010000:0.0:1713481296.767237:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767237:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.767238:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.767238:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767239:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079453840, rc 0) 00010000:00010000:2.0:1713481296.767241:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a286400/0xdfc0fb148a3ac5f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.767243:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.767246:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767248:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.767248:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16884:18844:x1796714882481152:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 48us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.767252:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300c480 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.767252:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563158 00010000:00010000:3.0:1713481296.767253:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767255:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.767260:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767261:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.767265:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801302e2640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.767268:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767271:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.767275:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767277:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013300c480/0xdfc0fb148a3aade lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767283:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767286:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:3.0:1713481296.767288:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767289:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767292:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767295:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a287a80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.767295:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801302e2640/0xdfc0fb148a3ab7f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767296:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767299:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767302:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:2.0:1713481296.767303:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.767305:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767308:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a287a80/0xdfc0fb148a3ac51 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x347f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000004:00010000:2.0:1713481296.767315:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009299f100 reply state ffff880098d95000 transno 4295107595 ns: mdt-lustre-MDT0001_UUID lock: ffff88007a2858c0/0xdfc0fb148a3ac58 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767319:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a2858c0/0xdfc0fb148a3ac58 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x347f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.767323:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x3331 (ffff880098477900) 00010000:00010000:2.0:1713481296.767324:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.767325:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713481296.767340:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2374:18729:x1796714882481024:12345-192.168.202.24@tcp:36:rm.0 Request processed in 347us (634us total) trans 4295107595 rc 0/0 00000100:00100000:2.0:1713481296.767344:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485833 00000004:00080000:1.0:1713481296.767356:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011da4c700/2, rc 0, transno 1073536 00000100:00100000:1.0:1713481296.767361:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784507200:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.767381:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.767386:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784510592:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.767398:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.767411:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510592 00000100:00100000:1.0:1713481296.767413:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510592 00000100:00100000:1.0:1713481296.767424:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563159 00000100:00100000:1.0:1713481296.767427:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+171:3492:x1796714784510592:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.767434:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9985 count 1 00010000:00010000:1.0:1713481296.767441:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767448:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083b70000/0xdfc0fb148802aca lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bb4 expref: 20802 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.767450:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+171:3492:x1796714784508288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6345us (6394us total) trans 4296040833 rc 0/0 00010000:00010000:1.0:1713481296.767452:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767453:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767454:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.767458:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563137 00010000:00010000:1.0:1713481296.767463:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083b70000/0xdfc0fb148802aca lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bb4 expref: 20802 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.767468:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083b70000/0xdfc0fb148802aca lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bb4 expref: 20802 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.767474:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784510656:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.767482:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.767485:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2180 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.767490:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.767497:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2772:3493:x1796714784506688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8879us (8962us total) trans 4295960712 rc 0/0 00010000:00010000:3.0:1713481296.767498:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.767502:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563124 00010000:00010000:3.0:1713481296.767504:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.767507:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007994c000/2, rc 0, transno 1073537 00000100:00100000:1.0:1713481296.767511:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007994c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784508288:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.767511:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.767515:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007796f800/2, rc 0, transno 993416 00010000:00010000:3.0:1713481296.767517:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801302e1b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.767520:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.767521:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007796f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784506688:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.767527:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.767528:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510720:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.767540:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.767541:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.767548:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302e1b00/0xdfc0fb148a3ab5c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.767549:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713481296.767552:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510784:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.767560:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.767573:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510720 00000100:00100000:1.0:1713481296.767575:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510720 00000100:00100000:0.0:1713481296.767581:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510784 00000100:00100000:0.0:1713481296.767585:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510784 00000100:00100000:1.0:1713481296.767587:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563160 00000100:00100000:1.0:1713481296.767590:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+171:3490:x1796714784510720:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.767597:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9986 count 1 00000100:00100000:0.0:1713481296.767600:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563161 00000100:00100000:0.0:1713481296.767604:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2773:3490:x1796714784510784:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.767604:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767610:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c582f40/0xdfc0fb148802ad1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bc2 expref: 20802 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.767614:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767615:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1713481296.767616:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43328 count 1 00010000:00010000:1.0:1713481296.767616:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767625:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767628:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c582f40/0xdfc0fb148802ad1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bc2 expref: 20802 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.767633:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c582f40/0xdfc0fb148802ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bc2 expref: 20802 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.767634:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099bbf180/0xdfc0fb148688f62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c98 expref: 26885 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.767638:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784510848:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.767640:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.767641:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.767643:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.767647:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e29c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.767658:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099bbf180/0xdfc0fb148688f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c98 expref: 26885 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.767681:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099bbf180/0xdfc0fb148688f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c98 expref: 26885 pid: 16542 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.767687:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075443100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784510912:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.767706:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.767707:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800773c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2773:3493:x1796714784507648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6974us (7057us total) trans 4295960713 rc 0/0 00000004:00080000:2.0:1713481296.767708:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007796e300/2, rc 0, transno 993417 00000100:00100000:1.0:1713481296.767712:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.767713:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007796e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784507648:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.767714:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563132 00000100:00100000:0.0:1713481296.767720:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481216 00000100:00100000:0.0:1713481296.767722:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481216 00000100:00100000:2.0:1713481296.767736:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713481296.767739:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563162 00000100:00100000:2.0:1713481296.767741:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784510976:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.767742:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26886:11388:x1796714882481216:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.767747:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.767753:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133a7db00/0xdfc0fb148a3ac89 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49690 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.767758:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.767763:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af26880/0xdfc0fb148942412 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b8 expref: 24477 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.767766:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.767767:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.767769:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7db00/0xdfc0fb148a3ac89 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49690 expref: 26887 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.767778:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009af26880/0xdfc0fb148942412 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b8 expref: 24477 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.767779:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.767784:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009af26880/0xdfc0fb148942412 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b8 expref: 24477 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.767789:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075443480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784511040:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.767789:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784510976 00000100:00100000:2.0:1713481296.767790:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483264 00000100:00100000:1.0:1713481296.767792:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784510976 00000100:00100000:2.0:1713481296.767792:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483264 00000100:00100000:0.0:1713481296.767798:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb04600 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.767803:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563163 00000100:00100000:2.0:1713481296.767803:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485834 00000100:00100000:1.0:1713481296.767806:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2773:3493:x1796714784510976:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.767807:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18915:x1796714882483264:12345-192.168.202.24@tcp:101:dd.0 00002000:00080000:1.0:1713481296.767814:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43329 count 1 00010000:00010000:2.0:1713481296.767818:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.767820:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.767821:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767824:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284240/0xdfc0fb148a3ac97 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496f2 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.767827:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d33c0/0xdfc0fb148688f70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa941:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ca6 expref: 26887 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.767831:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767832:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.767833:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.767846:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784508544:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.767847:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d0d33c0/0xdfc0fb148688f70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa941:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ca6 expref: 26887 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.767852:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d33c0/0xdfc0fb148688f70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa941:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ca6 expref: 26887 pid: 15495 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.767857:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784511104:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.767859:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.767867:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.767871:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.767873:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1960:x1796714882478976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4995us (5051us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.767876:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.767879:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820334 00000100:00100000:1.0:1713481296.767880:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481408 00010000:00010000:2.0:1713481296.767880:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.767882:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481408 00010000:00010000:2.0:1713481296.767887:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767890:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.767894:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485835 00010000:00010000:2.0:1713481296.767894:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.767896:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2029:18578:x1796714882481408:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:2.0:1713481296.767900:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079646d00/0xdfc0fb148a3acac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767903:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079646d00/0xdfc0fb148a3acac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767906:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079646d00/0xdfc0fb148a3acac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767909:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.767911:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767914:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767917:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767918:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007db998c0/0xdfc0fb148a37fcd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3485:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47af9 expref: 2029 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.767920:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767923:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a284000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.767924:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767927:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767929:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3485:0x0].0x0 (ffff8800848bc400) 00000100:00100000:0.0:1713481296.767930:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.767931:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.767931:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.767932:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.767934:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767936:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284000/0xdfc0fb148a3ac9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767940:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.767944:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767945:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.767947:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767949:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.767950:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767953:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079644fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.767954:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767956:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d0f6400/0xdfc0fb148a3acba lrc: 3/0,1 mode: --/PW res: [0x240000401:0x1d3:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.767956:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.767957:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.767960:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d0f6400/0xdfc0fb148a3acba lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.767962:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d0f6400/0xdfc0fb148a3acba lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.767962:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff88008ad2f800) 00010000:00010000:2.0:1713481296.767964:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.767965:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.767968:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079644fc0/0xdfc0fb148a3aca5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.767986:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.767990:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.767992:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784508928:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.767993:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.767993:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a284240/0xdfc0fb148a3ac97 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496f2 expref: 2204 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768001:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880079646d00/0xdfc0fb148a3acac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496f2 expref: 2203 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768004:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88011d25c800) 00010000:00010000:2.0:1713481296.768005:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.768006:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079646d00, rc 0) 00010000:00010000:0.0:1713481296.768008:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.768017:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18915:x1796714882483264:12345-192.168.202.24@tcp:101:dd.0 Request processed in 210us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.768020:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485834 00000100:00100000:2.0:1713481296.768031:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481600 00000100:00100000:2.0:1713481296.768033:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481600 00000100:00100000:2.0:1713481296.768043:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485836 00000100:00100000:2.0:1713481296.768045:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18872:x1796714882481600:12345-192.168.202.24@tcp:36:lfs.0 00000100:00100000:0.0:1713481296.768074:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784509184:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.768079:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784511168:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1713481296.768093:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.768095:0:10467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.768106:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.768137:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784511168 00000100:00100000:0.0:1713481296.768138:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.768140:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784511168 00000100:00100000:2.0:1713481296.768152:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82914 00000100:00100000:2.0:1713481296.768155:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:10467:x1796714784511168:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1713481296.768158:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.768174:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.768192:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:10467:x1796714784511168:12345-0@lo:1000:mdt00_005.0 Request processed in 36us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.768196:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82914 00000100:00100000:0.0:1713481296.768205:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.768208:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482048 00000100:00100000:3.0:1713481296.768212:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482048 00000100:00100000:2.0:1713481296.768217:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482240 00000100:00100000:2.0:1713481296.768219:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482240 00000100:00100000:0.0:1713481296.768223:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.768235:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482176 00000100:00100000:2.0:1713481296.768236:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485837 00000100:00100000:3.0:1713481296.768238:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482176 00000100:00100000:2.0:1713481296.768239:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2029:18952:x1796714882482048:12345-192.168.202.24@tcp:101:touch.0 00000100:00100000:0.0:1713481296.768243:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.768244:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.768250:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079644900/0xdfc0fb148a3acc8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4969e expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.768257:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485838 00000100:00100000:0.0:1713481296.768259:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482560 00000100:00100000:0.0:1713481296.768262:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482560 00000100:00100000:3.0:1713481296.768262:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2374:18886:x1796714882482240:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:2.0:1713481296.768266:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079644900/0xdfc0fb148a3acc8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4969e expref: 2030 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768272:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880079644900/0xdfc0fb148a3acc8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cbc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4969e expref: 2030 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768273:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121e32640/0xdfc0fb148a15fd3 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x9b41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39828 expref: 20803 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.768279:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbc:0x0].0x0 (ffff88009cf16000) 00010000:00010000:2.0:1713481296.768280:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713481296.768281:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079644900, rc 0) 00010000:00010000:3.0:1713481296.768284:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.768287:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820352 00000100:00100000:2.0:1713481296.768289:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2030:18952:x1796714882482048:12345-192.168.202.24@tcp:101:touch.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.768292:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20803:1957:x1796714882482560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.768293:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485837 00010000:00010000:3.0:1713481296.768293:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3accf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496ac expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768300:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.768303:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121e32640/0xdfc0fb148a15fd3 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x9b41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39828 expref: 20803 pid: 16455 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.768307:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485839 00010000:00010000:0.0:1713481296.768309:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121e32640/0xdfc0fb148a15fd3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39828 expref: 20803 pid: 16455 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.768310:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18878:x1796714882482176:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:2.0:1713481296.768315:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.768319:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.768319:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079645680/0xdfc0fb148a3acd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496a5 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768320:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.768322:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012050aac0/0xdfc0fb148a3abe8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4966d expref: 20803 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768327:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050aac0/0xdfc0fb148a3abe8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x9b41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4966d expref: 20803 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768338:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012050aac0/0xdfc0fb148a3abe8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x9b41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4966d expref: 20803 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.768344:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007712b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784511232:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.768355:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21e40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.768355:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768360:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768360:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.768364:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768368:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768371:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768374:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768376:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768378:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768388:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.768394:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.768400:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768405:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800848ef600/0xdfc0fb148a3acf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768409:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800848ef600/0xdfc0fb148a3acf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768412:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800848ef600/0xdfc0fb148a3acf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000004:00200000:2.0:1713481296.768424:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51f4:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.768426:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713481296.768427:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e5200/0xdfc0fb148a3ad00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00000100:00100000:0.0:1713481296.768432:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00010000:2.0:1713481296.768432:0:15483:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800848ef600/0xdfc0fb148a3acf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768433:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e5200/0xdfc0fb148a3ad00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768437:0:15483:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768439:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e5200/0xdfc0fb148a3ad00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768440:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768443:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768446:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768448:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091629680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.768449:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000004:00010000:3.0:1713481296.768450:0:15577:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e5200/0xdfc0fb148a3ad00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768452:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768457:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.768458:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.768459:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768459:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768462:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091629680/0xdfc0fb148a3acdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.768465:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.768465:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.768470:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768474:0:15483:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768476:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768477:0:15483:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.768478:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482432 00000100:00100000:0.0:1713481296.768480:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482432 00010000:00010000:2.0:1713481296.768480:0:15483:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768480:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122ad3180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.768483:0:15483:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091629d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.768483:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768485:0:15483:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768488:0:15483:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:3.0:1713481296.768489:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768491:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88009bd7c000) 00010000:00010000:2.0:1713481296.768492:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.768493:0:15483:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.768495:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091629d40/0xdfc0fb148a3aceb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00000100:00100000:0.0:1713481296.768496:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482496 00010000:00010000:3.0:1713481296.768496:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:0.0:1713481296.768498:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482496 00010000:00010000:3.0:1713481296.768500:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.768503:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.768508:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482624 00010000:00010000:3.0:1713481296.768508:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3ace4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.768509:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482624 00010000:00010000:2.0:1713481296.768515:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079645680/0xdfc0fb148a3acd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496a5 expref: 2796 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.768518:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482688 00000100:00100000:0.0:1713481296.768519:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482688 00010000:00010000:3.0:1713481296.768521:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768527:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800848ef600/0xdfc0fb148a3acf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496a5 expref: 2795 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.768527:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.768530:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563164 00010000:00010000:2.0:1713481296.768530:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff8800799d1900) 00010000:00010000:2.0:1713481296.768531:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.768531:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.768532:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848ef600, rc 0) 00000100:00100000:0.0:1713481296.768534:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:10409:x1796714882482432:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.768536:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800922e7840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.768538:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.768540:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.768543:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18878:x1796714882482176:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 232us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.768543:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00000100:00100000:2.0:1713481296.768546:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485839 00010000:00010000:0.0:1713481296.768548:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3ad07 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496ba expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.768550:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x33 (ffff8800837b7400) 00010000:00010000:3.0:1713481296.768552:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.768555:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.768560:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3acf2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.768561:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096bacd80/0xdfc0fb14891d15f lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6fa expref: 24479 pid: 16526 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.768566:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563165 00010000:00010000:0.0:1713481296.768569:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e640/0xdfc0fb14893ab28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db411 expref: 26887 pid: 16457 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.768569:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16884:17009:x1796714882482496:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.768574:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.768574:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.768575:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.768577:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3ad07 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496ba expref: 24479 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768580:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095e82d00/0xdfc0fb148a3ad0e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496c1 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768588:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e640/0xdfc0fb14893ab28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db411 expref: 26887 pid: 16457 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713481296.768588:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.768593:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e640/0xdfc0fb14893ab28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db411 expref: 26887 pid: 16457 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.768594:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.768595:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.768596:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3accf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496ac expref: 2376 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768598:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095e82d00/0xdfc0fb148a3ad0e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496c1 expref: 16885 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.768599:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784511296:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.768604:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095e82d00/0xdfc0fb148a3ad0e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496c1 expref: 16885 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768608:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095e82d00, rc 0) 00010000:00010000:3.0:1713481296.768608:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e5200/0xdfc0fb148a3ad00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496ac expref: 2375 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768613:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096bacd80/0xdfc0fb14891d15f lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6fa expref: 24479 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.768614:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e9:0x0].0x0 (ffff880081510c00) 00000100:00100000:2.0:1713481296.768616:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16885:17009:x1796714882482496:12345-192.168.202.24@tcp:101:dd.0 Request processed in 47us (394us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.768616:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.768618:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096bacd80/0xdfc0fb14891d15f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6fa expref: 24479 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.768618:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922e5200, rc 0) 00000100:00100000:2.0:1713481296.768620:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563165 00000100:00100000:0.0:1713481296.768623:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784511360:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.768632:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563166 00000100:00100000:0.0:1713481296.768635:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.768636:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20804:18792:x1796714882482624:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713481296.768636:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2375:18886:x1796714882482240:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 373us (477us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.768639:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.768643:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485838 00010000:00010000:2.0:1713481296.768645:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099fe9440/0xdfc0fb148a3ad15 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc517:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496c8 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.768652:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563167 00002000:00010000:2.0:1713481296.768652:0:16488:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc517:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.768655:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:15045:x1796714882482688:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.768657:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.768657:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.768659:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.768660:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099fe9440/0xdfc0fb148a3ad15 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496c8 expref: 20805 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768679:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009654f840/0xdfc0fb148a3ad1c lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496cf expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768682:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099fe9440/0xdfc0fb148a3ad15 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc517:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496c8 expref: 20805 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768686:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099fe9440, rc 0) 00002000:00010000:0.0:1713481296.768688:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.768695:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.768696:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.768698:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009654f840/0xdfc0fb148a3ad1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496cf expref: 24480 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.768700:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:18792:x1796714882482624:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 65us (270us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.768705:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009654f840/0xdfc0fb148a3ad1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496cf expref: 24480 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.768705:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563166 00000100:00100000:3.0:1713481296.768705:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784509056:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.768709:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009654f840, rc 0) 00000100:00100000:0.0:1713481296.768719:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:15045:x1796714882482688:12345-192.168.202.24@tcp:101:dd.0 Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.768723:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563167 00010000:00010000:3.0:1713481296.768728:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942aaf40/0xdfc0fb148a3abbe lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49651 expref: 20804 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.768730:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784511168:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1713481296.768738:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942aaf40, rc 0) 00000100:00100000:3.0:1713481296.768756:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20804:10479:x1796714882479808:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5323us (5355us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.768759:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784511424:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1713481296.768764:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563141 00000100:00100000:0.0:1713481296.768769:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.768774:0:10467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.768780:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481856 00000100:00100000:0.0:1713481296.768782:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481856 00000100:00100000:2.0:1713481296.768783:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.768792:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784511424 00010000:00010000:0.0:1713481296.768793:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801366ac240/0xdfc0fb148688ef2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c3d expref: 26888 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.768794:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784511424 00000100:00100000:2.0:1713481296.768806:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82915 00000100:00100000:3.0:1713481296.768807:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fe78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784508736:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.768808:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820353 00000100:00100000:2.0:1713481296.768809:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+33:10467:x1796714784511424:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1713481296.768813:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26888:1959:x1796714882481856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.768819:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.768822:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801366ac240/0xdfc0fb148688ef2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c3d expref: 26888 pid: 15547 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.768828:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.768830:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801366ac240/0xdfc0fb148688ef2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c3d expref: 26888 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.768845:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16884:1960:x1796714882479424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5735us (5801us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.768846:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801366ac240/0xdfc0fb148688ef2 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c3d expref: 26888 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.768853:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820337 00000100:00100000:2.0:1713481296.768855:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+33:10467:x1796714784511424:12345-0@lo:1000:mdt00_005.0 Request processed in 45us (81us total) trans 0 rc 1/1 00010000:00010000:0.0:1713481296.768860:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.768860:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82915 00010000:00010000:0.0:1713481296.768862:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.768864:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.768871:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.768881:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784511424:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1713481296.768886:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713481296.768894:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3433, 64 off227904 00000100:00100000:0.0:1713481296.768900:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26887:1959:x1796714882481856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.768905:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820353 00000100:00100000:2.0:1713481296.768906:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18872:x1796714882481600:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 859us (977us total) trans 0 rc -17/-17 00000040:00080000:1.0:1713481296.768908:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31886, 64 off2048896 00000100:00100000:2.0:1713481296.768910:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485836 00000040:00080000:1.0:1713481296.768914:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3434, 64 off227968 00000040:00080000:1.0:1713481296.768919:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31887, 64 off2048960 00000040:00080000:1.0:1713481296.768924:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3435, 64 off228032 00010000:00010000:0.0:1713481296.768926:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.768928:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31888, 64 off2049024 00000100:00100000:2.0:1713481296.768930:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800773c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784509312:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.768933:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.768933:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3436, 64 off228096 00000040:00080000:1.0:1713481296.768938:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31889, 64 off2049088 00010000:00010000:0.0:1713481296.768940:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.768941:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713481296.768943:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3437, 64 off228160 00010000:00010000:0.0:1713481296.768946:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.768947:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882479616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4037us (4134us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.768948:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31890, 64 off2049152 00000100:00100000:2.0:1713481296.768950:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820338 00000040:00080000:1.0:1713481296.768952:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3438, 64 off228224 00010000:00010000:0.0:1713481296.768953:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.768957:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31891, 64 off2049216 00000040:00080000:1.0:1713481296.768961:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3439, 64 off228288 00010000:00010000:0.0:1713481296.768963:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a26d7180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.768966:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.768966:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31892, 64 off2049280 00000040:00080000:1.0:1713481296.768971:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3440, 64 off228352 00010000:00010000:0.0:1713481296.768972:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.768976:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31893, 64 off2049344 00000040:00080000:1.0:1713481296.768981:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3441, 64 off228416 00010000:00010000:0.0:1713481296.768985:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.768986:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31894, 64 off2049408 00000040:00080000:1.0:1713481296.768990:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3442, 64 off228480 00010000:00010000:0.0:1713481296.768992:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a26d7180/0xdfc0fb148a3abb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa93a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.768995:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31895, 64 off2049472 00000040:00080000:1.0:1713481296.769000:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3443, 64 off228544 00000040:00080000:1.0:1713481296.769005:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31896, 64 off2049536 00000040:00080000:1.0:1713481296.769009:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3444, 64 off228608 00000040:00080000:1.0:1713481296.769014:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31897, 64 off2049600 00000040:00080000:1.0:1713481296.769019:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3445, 64 off228672 00000040:00080000:1.0:1713481296.769023:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31898, 64 off2049664 00000040:00080000:1.0:1713481296.769028:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3446, 64 off228736 00000040:00080000:1.0:1713481296.769032:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31899, 64 off2049728 00000040:00080000:1.0:1713481296.769037:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3447, 64 off228800 00000040:00080000:1.0:1713481296.769041:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31900, 64 off2049792 00000040:00080000:1.0:1713481296.769046:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3448, 64 off228864 00000040:00080000:1.0:1713481296.769050:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31901, 64 off2049856 00000040:00080000:1.0:1713481296.769055:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3449, 64 off228928 00000040:00080000:1.0:1713481296.769059:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31902, 64 off2049920 00000040:00080000:1.0:1713481296.769064:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3450, 64 off228992 00000040:00080000:1.0:1713481296.769068:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31903, 64 off2049984 00000040:00080000:1.0:1713481296.769073:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3451, 64 off229056 00000040:00080000:1.0:1713481296.769077:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31904, 64 off2050048 00000040:00080000:1.0:1713481296.769082:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3452, 64 off229120 00000040:00080000:1.0:1713481296.769087:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31905, 64 off2050112 00000040:00080000:1.0:1713481296.769091:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3453, 64 off229184 00000040:00080000:1.0:1713481296.769096:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31906, 64 off2050176 00000040:00080000:1.0:1713481296.769100:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3454, 64 off229248 00000040:00080000:1.0:1713481296.769105:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31907, 64 off2050240 00000040:00080000:1.0:1713481296.769109:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3455, 64 off229312 00000040:00080000:1.0:1713481296.769114:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31908, 64 off2050304 00000040:00080000:1.0:1713481296.769135:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3456, 64 off229376 00000040:00080000:1.0:1713481296.769141:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31909, 64 off2050368 00000100:00100000:0.0:1713481296.769153:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2774:3490:x1796714784508672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5833us (5912us total) trans 4295960714 rc 0/0 00000100:00100000:0.0:1713481296.769160:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563139 00000004:00080000:0.0:1713481296.769195:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800773c0a80/2, rc 0, transno 993418 00000040:00080000:1.0:1713481296.769201:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3457, 64 off229440 00000100:00100000:0.0:1713481296.769202:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800773c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784508672:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713481296.769210:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31910, 64 off2050432 00000040:00080000:1.0:1713481296.769217:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3458, 64 off229504 00000100:00100000:2.0:1713481296.769225:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000040:00080000:1.0:1713481296.769226:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31911, 64 off2050496 00000100:00100000:2.0:1713481296.769230:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784511488:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.769233:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.769234:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3459, 64 off229568 00000040:00080000:1.0:1713481296.769241:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31912, 64 off2050560 00000100:00100000:0.0:1713481296.769249:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481984 00000040:00080000:1.0:1713481296.769249:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3460, 64 off229632 00000100:00100000:0.0:1713481296.769252:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481984 00000100:00100000:2.0:1713481296.769255:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713481296.769257:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31913, 64 off2050624 00010000:00010000:0.0:1713481296.769263:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e65b00/0xdfc0fb148916d9f lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6576 expref: 20804 pid: 15547 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769265:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3461, 64 off229696 00000040:00080000:1.0:1713481296.769273:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31914, 64 off2050688 00000100:00100000:0.0:1713481296.769281:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820354 00000040:00080000:1.0:1713481296.769281:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3462, 64 off229760 00000100:00100000:0.0:1713481296.769285:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20804:1959:x1796714882481984:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000040:00080000:1.0:1713481296.769289:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31915, 64 off2050752 00010000:00010000:0.0:1713481296.769293:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:1.0:1713481296.769297:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3463, 64 off229824 00010000:00010000:0.0:1713481296.769303:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e65b00/0xdfc0fb148916d9f lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6576 expref: 20804 pid: 15547 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769304:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31916, 64 off2050816 00010000:00010000:0.0:1713481296.769311:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e65b00/0xdfc0fb148916d9f lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6576 expref: 20804 pid: 15547 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769311:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3464, 64 off229888 00000040:00080000:1.0:1713481296.769319:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31917, 64 off2050880 00010000:00010000:0.0:1713481296.769327:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e65b00/0xdfc0fb148916d9f lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6576 expref: 20804 pid: 15547 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769327:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3465, 64 off229952 00000040:00080000:1.0:1713481296.769333:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31918, 64 off2050944 00000040:00080000:1.0:1713481296.769338:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3466, 64 off230016 00010000:00010000:0.0:1713481296.769342:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713481296.769343:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31919, 64 off2051008 00010000:00010000:0.0:1713481296.769344:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.769347:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942aaf40/0xdfc0fb148a3abbe lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49651 expref: 20803 pid: 9203 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769348:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3467, 64 off230080 00000040:00080000:1.0:1713481296.769352:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31920, 64 off2051072 00010000:00010000:0.0:1713481296.769354:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942aaf40/0xdfc0fb148a3abbe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49651 expref: 20803 pid: 9203 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769357:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3468, 64 off230144 00000040:00080000:1.0:1713481296.769361:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31921, 64 off2051136 00000040:00080000:1.0:1713481296.769366:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3469, 64 off230208 00010000:00010000:0.0:1713481296.769369:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942aaf40/0xdfc0fb148a3abbe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49651 expref: 20803 pid: 9203 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769371:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31922, 64 off2051200 00000040:00080000:1.0:1713481296.769375:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3470, 64 off230272 00000100:00100000:0.0:1713481296.769377:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784511552:192.168.202.24@tcp:105: 00000040:00080000:1.0:1713481296.769380:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31923, 64 off2051264 00000040:00080000:1.0:1713481296.769384:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3471, 64 off230336 00000040:00080000:1.0:1713481296.769389:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31924, 64 off2051328 00000100:00100000:0.0:1713481296.769392:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bb40 going to sleep for 11 seconds 00000040:00080000:1.0:1713481296.769394:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3472, 64 off230400 00000040:00080000:1.0:1713481296.769399:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31925, 64 off2051392 00000040:00080000:1.0:1713481296.769404:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3473, 64 off230464 00000100:00100000:0.0:1713481296.769407:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784511488 00000040:00080000:1.0:1713481296.769409:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31926, 64 off2051456 00000100:00100000:0.0:1713481296.769410:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784511488 00000040:00080000:1.0:1713481296.769413:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3474, 64 off230528 00000040:00080000:1.0:1713481296.769418:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31927, 64 off2051520 00000040:00080000:1.0:1713481296.769423:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3475, 64 off230592 00000040:00080000:1.0:1713481296.769427:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31928, 64 off2051584 00000040:00080000:1.0:1713481296.769431:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3476, 64 off230656 00000100:00100000:0.0:1713481296.769435:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563168 00000040:00080000:1.0:1713481296.769436:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31929, 64 off2051648 00000100:00100000:0.0:1713481296.769439:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2774:3492:x1796714784511488:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713481296.769441:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3477, 64 off230720 00000040:00080000:1.0:1713481296.769445:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31930, 64 off2051712 00002000:00080000:0.0:1713481296.769449:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43330 count 1 00000040:00080000:1.0:1713481296.769449:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3478, 64 off230784 00000040:00080000:1.0:1713481296.769454:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31931, 64 off2051776 00010000:00010000:0.0:1713481296.769459:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769459:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3479, 64 off230848 00000040:00080000:1.0:1713481296.769463:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31932, 64 off2051840 00010000:00010000:0.0:1713481296.769467:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0240/0xdfc0fb148688f38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cb4 expref: 26886 pid: 15495 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.769468:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3480, 64 off230912 00010000:00010000:0.0:1713481296.769472:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713481296.769472:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31933, 64 off2051904 00010000:00010000:0.0:1713481296.769473:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.769476:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769478:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3481, 64 off230976 00000040:00080000:1.0:1713481296.769483:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31934, 64 off2051968 00000040:00080000:1.0:1713481296.769487:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3482, 64 off231040 00010000:00010000:0.0:1713481296.769488:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0240/0xdfc0fb148688f38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cb4 expref: 26886 pid: 15495 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.769492:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31935, 64 off2052032 00010000:00010000:0.0:1713481296.769494:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0240/0xdfc0fb148688f38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cb4 expref: 26886 pid: 15495 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769496:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3483, 64 off231104 00000040:00080000:1.0:1713481296.769501:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31936, 64 off2052096 00000100:00100000:0.0:1713481296.769502:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784511616:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.769505:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3484, 64 off231168 00000100:00100000:0.0:1713481296.769515:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.769539:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.769544:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31937, 64 off2052160 00000040:00080000:1.0:1713481296.769552:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3485, 64 off231232 00000100:00100000:2.0:1713481296.769552:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481792 00000100:00100000:2.0:1713481296.769555:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481792 00000040:00080000:1.0:1713481296.769558:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31938, 64 off2052224 00000100:00100000:0.0:1713481296.769559:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.769562:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3486, 64 off231296 00010000:00010000:2.0:1713481296.769564:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb14880238b lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b60 expref: 20804 pid: 16529 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769567:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31939, 64 off2052288 00000100:00100000:0.0:1713481296.769572:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481920 00000040:00080000:1.0:1713481296.769572:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3487, 64 off231360 00000100:00100000:0.0:1713481296.769574:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481920 00000040:00080000:1.0:1713481296.769577:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31940, 64 off2052352 00000040:00080000:1.0:1713481296.769582:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3488, 64 off231424 00000100:00100000:2.0:1713481296.769582:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820355 00010000:00010000:0.0:1713481296.769584:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080184000/0xdfc0fb148688ec1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c4b expref: 26887 pid: 16525 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769586:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31941, 64 off2052416 00000100:00100000:2.0:1713481296.769586:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20804:1959:x1796714882481792:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.769590:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:1.0:1713481296.769591:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3489, 64 off231488 00010000:00010000:2.0:1713481296.769592:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb14880238b lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b60 expref: 20804 pid: 16529 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769596:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31942, 64 off2052480 00010000:00010000:2.0:1713481296.769598:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb14880238b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b60 expref: 20804 pid: 16529 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769601:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3490, 64 off231552 00000040:00080000:1.0:1713481296.769605:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31943, 64 off2052544 00000100:00100000:0.0:1713481296.769606:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820356 00010000:00010000:2.0:1713481296.769608:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.769609:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713481296.769610:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3491, 64 off231616 00000100:00100000:0.0:1713481296.769611:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26887:1959:x1796714882481920:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.769611:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769614:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31944, 64 off2052608 00010000:00010000:2.0:1713481296.769615:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.769617:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:1.0:1713481296.769619:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3492, 64 off231680 00010000:00010000:0.0:1713481296.769620:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080184000/0xdfc0fb148688ec1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c4b expref: 26887 pid: 16525 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769623:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31945, 64 off2052672 00010000:00010000:2.0:1713481296.769624:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.769627:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080184000/0xdfc0fb148688ec1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c4b expref: 26887 pid: 16525 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769628:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3493, 64 off231744 00000040:00080000:1.0:1713481296.769633:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31946, 64 off2052736 00000100:00100000:2.0:1713481296.769633:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20804:1959:x1796714882481792:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 47us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.769636:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820355 00000040:00080000:1.0:1713481296.769637:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3494, 64 off231808 00010000:00010000:0.0:1713481296.769639:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.769641:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713481296.769642:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31947, 64 off2052800 00010000:00010000:0.0:1713481296.769643:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769646:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3495, 64 off231872 00010000:00010000:0.0:1713481296.769649:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769651:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31948, 64 off2052864 00000040:00080000:1.0:1713481296.769655:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3496, 64 off231936 00010000:00010000:0.0:1713481296.769660:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713481296.769660:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31949, 64 off2052928 00000040:00080000:1.0:1713481296.769680:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3497, 64 off232000 00000040:00080000:1.0:1713481296.769686:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31950, 64 off2052992 00000100:00100000:0.0:1713481296.769687:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26887:1959:x1796714882481920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.769691:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3498, 64 off232064 00000100:00100000:0.0:1713481296.769693:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820356 00000040:00080000:1.0:1713481296.769695:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31951, 64 off2053056 00000040:00080000:1.0:1713481296.769700:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3499, 64 off232128 00000040:00080000:1.0:1713481296.769705:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31952, 64 off2053120 00000040:00080000:1.0:1713481296.769709:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3500, 64 off232192 00000040:00080000:1.0:1713481296.769714:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31953, 64 off2053184 00000100:00100000:0.0:1713481296.769717:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.769718:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3501, 64 off232256 00000040:00080000:1.0:1713481296.769723:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31954, 64 off2053248 00000100:00100000:0.0:1713481296.769726:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482112 00000100:00100000:0.0:1713481296.769728:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482112 00000040:00080000:1.0:1713481296.769728:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3502, 64 off232320 00000040:00080000:1.0:1713481296.769732:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31955, 64 off2053312 00010000:00010000:0.0:1713481296.769733:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d26400/0xdfc0fb148688ec8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c59 expref: 26887 pid: 16535 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769737:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3503, 64 off232384 00000040:00080000:1.0:1713481296.769742:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31956, 64 off2053376 00000100:00100000:0.0:1713481296.769743:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820357 00000040:00080000:1.0:1713481296.769746:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3504, 64 off232448 00000100:00100000:0.0:1713481296.769747:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26887:1959:x1796714882482112:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000040:00080000:1.0:1713481296.769751:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31957, 64 off2053440 00010000:00010000:0.0:1713481296.769753:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.769756:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d26400/0xdfc0fb148688ec8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c59 expref: 26887 pid: 16535 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769756:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3505, 64 off232512 00000040:00080000:1.0:1713481296.769761:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31958, 64 off2053504 00010000:00010000:0.0:1713481296.769764:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d26400/0xdfc0fb148688ec8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c59 expref: 26887 pid: 16535 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769765:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3506, 64 off232576 00000040:00080000:1.0:1713481296.769770:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31959, 64 off2053568 00000040:00080000:1.0:1713481296.769775:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3507, 64 off232640 00010000:00010000:0.0:1713481296.769779:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d26400/0xdfc0fb148688ec8 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c59 expref: 26887 pid: 16535 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.769779:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31960, 64 off2053632 00000040:00080000:1.0:1713481296.769784:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3508, 64 off232704 00000040:00080000:1.0:1713481296.769789:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31961, 64 off2053696 00010000:00010000:0.0:1713481296.769793:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713481296.769793:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3509, 64 off232768 00010000:00010000:0.0:1713481296.769795:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.769797:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769798:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31962, 64 off2053760 00000040:00080000:1.0:1713481296.769802:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3510, 64 off232832 00010000:00010000:0.0:1713481296.769803:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769807:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31963, 64 off2053824 00000040:00080000:1.0:1713481296.769811:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3511, 64 off232896 00000040:00080000:1.0:1713481296.769816:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31964, 64 off2053888 00010000:00010000:0.0:1713481296.769820:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713481296.769820:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3512, 64 off232960 00000040:00080000:1.0:1713481296.769825:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31965, 64 off2053952 00000040:00080000:1.0:1713481296.769829:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3513, 64 off233024 00000100:00100000:0.0:1713481296.769832:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26886:1959:x1796714882482112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 84us (114us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.769834:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31966, 64 off2054016 00000100:00100000:0.0:1713481296.769838:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820357 00000040:00080000:1.0:1713481296.769838:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3514, 64 off233088 00000040:00080000:1.0:1713481296.769843:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31967, 64 off2054080 00000040:00080000:1.0:1713481296.769847:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3515, 64 off233152 00000040:00080000:1.0:1713481296.769852:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31968, 64 off2054144 00000040:00080000:1.0:1713481296.769856:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3516, 64 off233216 00010000:00010000:0.0:1713481296.769858:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769861:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31969, 64 off2054208 00010000:00010000:0.0:1713481296.769865:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769865:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3517, 64 off233280 00000040:00080000:1.0:1713481296.769870:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31970, 64 off2054272 00000040:00080000:1.0:1713481296.769875:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3518, 64 off233344 00010000:00010000:0.0:1713481296.769876:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769879:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31971, 64 off2054336 00010000:00010000:0.0:1713481296.769882:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769884:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3519, 64 off233408 00010000:00010000:0.0:1713481296.769888:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769888:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31972, 64 off2054400 00010000:00010000:0.0:1713481296.769893:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a26d4fc0 already unused, calling callback (ffffffffa084eb20) 00000040:00080000:1.0:1713481296.769893:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3520, 64 off233472 00010000:00010000:0.0:1713481296.769895:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769898:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31973, 64 off2054464 00010000:00010000:0.0:1713481296.769902:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.769914:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.769920:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a26d4fc0/0xdfc0fb148a3abd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa93c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.769928:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3521, 64 off233536 00000040:00080000:1.0:1713481296.769936:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31974, 64 off2054528 00000040:00080000:1.0:1713481296.769942:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3522, 64 off233600 00000040:00080000:1.0:1713481296.769946:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31975, 64 off2054592 00000040:00080000:1.0:1713481296.769951:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3523, 64 off233664 00000040:00080000:1.0:1713481296.769956:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31976, 64 off2054656 00000040:00080000:1.0:1713481296.769961:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3524, 64 off233728 00000040:00080000:1.0:1713481296.769965:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31977, 64 off2054720 00000040:00080000:1.0:1713481296.769970:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3525, 64 off233792 00000040:00080000:1.0:1713481296.769975:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31978, 64 off2054784 00000040:00080000:1.0:1713481296.769979:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3526, 64 off233856 00000040:00080000:1.0:1713481296.769985:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31979, 64 off2054848 00000040:00080000:1.0:1713481296.769993:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3527, 64 off233920 00000040:00080000:1.0:1713481296.770001:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31980, 64 off2054912 00000040:00080000:1.0:1713481296.770008:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3528, 64 off233984 00000040:00080000:1.0:1713481296.770017:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31981, 64 off2054976 00000040:00080000:1.0:1713481296.770025:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3529, 64 off234048 00000040:00080000:1.0:1713481296.770033:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31982, 64 off2055040 00000040:00080000:1.0:1713481296.770040:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3530, 64 off234112 00000100:00100000:0.0:1713481296.770047:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2775:3492:x1796714784509120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6048us (6092us total) trans 4295960715 rc 0/0 00000040:00080000:1.0:1713481296.770048:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31983, 64 off2055104 00000100:00100000:0.0:1713481296.770053:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563144 00000040:00080000:1.0:1713481296.770053:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3531, 64 off234176 00000040:00080000:1.0:1713481296.770058:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31984, 64 off2055168 00000004:00080000:2.0:1713481296.770061:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e275500/2, rc 0, transno 993419 00000040:00080000:1.0:1713481296.770062:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3532, 64 off234240 00000100:00100000:2.0:1713481296.770066:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784509120:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713481296.770067:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31985, 64 off2055232 00000040:00080000:1.0:1713481296.770072:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3533, 64 off234304 00000040:00080000:1.0:1713481296.770077:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31986, 64 off2055296 00000040:00080000:1.0:1713481296.770081:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3534, 64 off234368 00000100:00100000:0.0:1713481296.770083:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.770086:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31987, 64 off2055360 00000040:00080000:1.0:1713481296.770090:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3535, 64 off234432 00000040:00080000:1.0:1713481296.770095:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31988, 64 off2055424 00000100:00100000:2.0:1713481296.770096:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784511680:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.770097:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882481728 00000100:00100000:0.0:1713481296.770099:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882481728 00000040:00080000:1.0:1713481296.770100:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3536, 64 off234496 00000040:00080000:1.0:1713481296.770107:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31989, 64 off2055488 00000100:00100000:2.0:1713481296.770110:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.770112:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482752 00000100:00100000:0.0:1713481296.770114:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482752 00000040:00080000:1.0:1713481296.770115:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3537, 64 off234560 00000100:00100000:0.0:1713481296.770145:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125686 00000100:00100000:0.0:1713481296.770150:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2031:18678:x1796714882481728:12345-192.168.202.24@tcp:35:rm.0 00010000:00010000:1.0:1713481296.770163:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080184000/0xdfc0fb148688ec1 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c4b expref: 26885 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.770175:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096760a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784508992:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.770198:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770205:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770211:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770217:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770221:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2032:18678:x1796714882481728:12345-192.168.202.24@tcp:35:rm.0 Request processed in 70us (2263us total) trans 4295107596 rc 0/0 00010000:00010000:1.0:1713481296.770223:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770227:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125686 00010000:00010000:1.0:1713481296.770230:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770235:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120509200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.770237:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770244:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770254:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770257:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120509200/0xdfc0fb148a3abb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa93b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770275:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125687 00000100:00100000:0.0:1713481296.770279:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2031:18913:x1796714882482752:12345-192.168.202.24@tcp:33:lfs.0 00000004:00200000:0.0:1713481296.770334:0:15494:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2caf:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.770337:0:15494:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713481296.770357:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2775:3490:x1796714784508864:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6937us (6985us total) trans 4295960716 rc 0/0 00000100:00100000:0.0:1713481296.770362:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2031:18913:x1796714882482752:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.770362:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563140 00000004:00080000:2.0:1713481296.770367:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e277100/2, rc 0, transno 993420 00000100:00100000:0.0:1713481296.770368:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125687 00000100:00100000:2.0:1713481296.770371:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784508864:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.770379:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784511680 00000100:00100000:1.0:1713481296.770381:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784511680 00000100:00100000:1.0:1713481296.770392:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563169 00000100:00100000:1.0:1713481296.770395:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2775:3490:x1796714784511680:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.770395:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.770400:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007994fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784511744:0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.770403:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43331 count 1 00010000:00010000:1.0:1713481296.770411:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770414:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.770417:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148688f3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cc2 expref: 26884 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.770421:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.770422:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.770424:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.770425:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.770435:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148688f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cc2 expref: 26884 pid: 16467 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.770439:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482816 00010000:00010000:1.0:1713481296.770440:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148688f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cc2 expref: 26884 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.770442:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482816 00000100:00100000:1.0:1713481296.770446:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784511808:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.770448:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784511744 00000100:00100000:2.0:1713481296.770450:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784511744 00000100:00100000:1.0:1713481296.770456:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.770466:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563170 00000100:00100000:0.0:1713481296.770470:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20804:14753:x1796714882482816:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.770470:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563171 00000100:00100000:2.0:1713481296.770472:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2776:3490:x1796714784511744:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.770474:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb14880238b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b60 expref: 20804 pid: 16529 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.770476:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:2.0:1713481296.770481:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43332 count 1 00000100:00100000:1.0:1713481296.770483:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784508800:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.770484:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148a3ad31 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496d6 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.770488:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.770496:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095cbb3c0/0xdfc0fb148a13ea1 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fcb expref: 20804 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.770496:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099bbd680/0xdfc0fb148688f46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cd0 expref: 26884 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.770500:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.770500:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.770502:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.770502:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.770503:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.770503:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770504:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.770506:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148a3ad31 lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496d6 expref: 20804 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770508:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770512:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.770513:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099bbd680/0xdfc0fb148688f46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cd0 expref: 26884 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.770515:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.770518:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095cbb3c0/0xdfc0fb148a13ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fcb expref: 20804 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.770519:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099bbd680/0xdfc0fb148688f46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cd0 expref: 26884 pid: 16542 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.770520:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770523:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120508b40 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.770524:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784511872:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.770525:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095cbb3c0/0xdfc0fb148a13ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fcb expref: 20804 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.770525:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770528:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770532:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784511936:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.770534:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.770536:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770539:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880120508b40/0xdfc0fb148a3aba9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770546:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.770562:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.770575:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482880 00000100:00100000:2.0:1713481296.770577:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482880 00000100:00100000:0.0:1713481296.770587:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.770593:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563172 00000100:00100000:2.0:1713481296.770596:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26885:11552:x1796714882482880:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.770598:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.770600:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.770605:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099fe9200/0xdfc0fb148a3ad3f lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496dd expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770609:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483008 00000100:00100000:0.0:1713481296.770611:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483008 00010000:00010000:2.0:1713481296.770615:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801242d1440/0xdfc0fb148959c0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd0 expref: 26886 pid: 16475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.770619:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.770620:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.770622:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099fe9200/0xdfc0fb148a3ad3f lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496dd expref: 26886 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770628:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125688 00000100:00100000:0.0:1713481296.770631:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18953:x1796714882483008:12345-192.168.202.24@tcp:33:lfs.0 00010000:00010000:2.0:1713481296.770634:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801242d1440/0xdfc0fb148959c0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd0 expref: 26886 pid: 16475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.770639:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801242d1440/0xdfc0fb148959c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd0 expref: 26886 pid: 16475 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.770644:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784512000:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.770657:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800916e2300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.770662:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784509376:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.770697:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+172:3492:x1796714784508608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7471us (7540us total) trans 4296040834 rc 0/0 00000004:00200000:0.0:1713481296.770699:0:15535:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x38b1:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.770701:0:15535:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713481296.770701:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563138 00000004:00080000:2.0:1713481296.770703:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007994dc00/2, rc 0, transno 1073538 00000100:00100000:2.0:1713481296.770708:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007994dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784508608:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.770722:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.770727:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882482944 00000100:00100000:2.0:1713481296.770727:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512064:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.770728:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18953:x1796714882483008:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 95us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.770729:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882482944 00000100:00100000:0.0:1713481296.770734:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125688 00000100:00100000:1.0:1713481296.770742:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485840 00000100:00100000:3.0:1713481296.770742:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16883:1960:x1796714882479744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5752us (5805us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.770744:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.770745:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2031:18917:x1796714882482944:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:1.0:1713481296.770751:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.770754:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820339 00010000:00010000:1.0:1713481296.770759:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d680/0xdfc0fb148a3ad46 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496e4 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770770:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.770786:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784512064 00000100:00100000:2.0:1713481296.770788:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784512064 00000100:00100000:2.0:1713481296.770797:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483072 00000100:00100000:2.0:1713481296.770798:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483072 00000100:00100000:0.0:1713481296.770800:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.770807:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563173 00000100:00100000:2.0:1713481296.770809:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+172:3492:x1796714784512064:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.770810:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483136 00000100:00100000:0.0:1713481296.770812:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483136 00010000:00010000:1.0:1713481296.770816:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00002000:00080000:2.0:1713481296.770816:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9987 count 1 00010000:00010000:0.0:1713481296.770821:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb14891e976 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb5b7 expref: 20805 pid: 16475 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.770824:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770825:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.770831:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f932880/0xdfc0fb148802ad8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bd0 expref: 20805 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.770832:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.770835:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820358 00010000:00010000:2.0:1713481296.770838:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.770839:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:1960:x1796714882483136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.770839:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.770840:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770842:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.770845:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.770847:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.770849:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb14891e976 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb5b7 expref: 20805 pid: 16475 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.770850:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f932880/0xdfc0fb148802ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bd0 expref: 20805 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.770852:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.770855:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f932880/0xdfc0fb148802ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bd0 expref: 20805 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.770856:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb14891e976 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb5b7 expref: 20805 pid: 16475 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.770860:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784512128:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.770866:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563174 00010000:00010000:0.0:1713481296.770869:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.770870:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.770870:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f8bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.770872:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16883:8499:x1796714882483072:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.770874:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880120508000/0xdfc0fb148a3ac04 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49674 expref: 16883 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.770880:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120508000/0xdfc0fb148a3ac04 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49674 expref: 16883 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.770880:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.770885:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3ad62 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c92:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.770889:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3ad62 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c92:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.770890:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800922e5f80/0xdfc0fb148a3ad69 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496eb expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770893:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3ad62 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c92:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.770894:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880120508000/0xdfc0fb148a3ac04 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49674 expref: 16883 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.770906:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784512192:192.168.202.24@tcp:105: 00000004:00200000:1.0:1713481296.770907:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c92:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.770908:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c330900/0xdfc0fb1488e7ea7 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5509 expref: 16884 pid: 16453 timeout: 0 lvb_type: 1 00000004:00200000:1.0:1713481296.770909:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713481296.770915:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3ad62 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c92:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.770915:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.770917:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.770918:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134f80b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.770920:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.770921:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e5f80/0xdfc0fb148a3ad69 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496eb expref: 16884 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.770923:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770926:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770929:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770932:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300d8c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.770933:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770936:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.770938:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c330900/0xdfc0fb1488e7ea7 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5509 expref: 16884 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.770940:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.770942:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.770943:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770946:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d8c0/0xdfc0fb148a3ad4d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.770947:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c330900/0xdfc0fb1488e7ea7 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5509 expref: 16884 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.770955:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:3.0:1713481296.770957:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784512256:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.770958:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770961:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770964:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300cfc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.770965:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.770967:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784509696:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.770968:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770972:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff88008bd1de00) 00010000:00010000:1.0:1713481296.770973:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.770974:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.770976:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3ad5b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:3.0:1713481296.770977:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9600 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.770980:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.770993:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16532:1796714784509952:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.770997:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013300d680/0xdfc0fb148a3ad46 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496e4 expref: 2033 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.771000:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.771004:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771005:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3ad62 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c92:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496e4 expref: 2032 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771009:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c92:0x0].0x0 (ffff88008bd1da00) 00010000:00010000:1.0:1713481296.771010:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.771010:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121e32640/0xdfc0fb148a15fd3 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39828 expref: 20805 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.771011:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013300fa80, rc 0) 00000100:00100000:0.0:1713481296.771014:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.771014:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483328 00000100:00100000:2.0:1713481296.771016:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483328 00000100:00100000:1.0:1713481296.771023:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2032:18917:x1796714882482944:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 277us (436us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.771023:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007723a1c0/0xdfc0fb148802392 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b6e expref: 20805 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.771027:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485840 00000100:00100000:0.0:1713481296.771029:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.771031:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784509248:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.771036:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483392 00000100:00100000:2.0:1713481296.771038:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483392 00000100:00100000:0.0:1713481296.771041:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.771042:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148802aae lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b7c expref: 20806 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.771050:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820359 00000100:00100000:2.0:1713481296.771052:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20806:1960:x1796714882483328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.771056:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb14891e976 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb5b7 expref: 20806 pid: 16475 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.771056:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012050aac0/0xdfc0fb148a3abe8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x9b41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4966d expref: 20806 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.771057:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.771057:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.771059:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007723a1c0/0xdfc0fb148802392 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b6e expref: 20806 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.771064:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007723a1c0/0xdfc0fb148802392 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b6e expref: 20805 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.771065:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012050aac0, rc 0) 00000100:00100000:1.0:1713481296.771066:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784509440:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.771075:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771076:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771077:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771081:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.771083:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:17924:x1796714882480192:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6525us (6549us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.771085:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120508000/0xdfc0fb148a3ac04 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49674 expref: 16884 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771088:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.771090:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120508000, rc 0) 00000100:00100000:3.0:1713481296.771091:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563146 00000100:00100000:2.0:1713481296.771097:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:1960:x1796714882483328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 44us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.771099:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16884:18836:x1796714882480768:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 5777us (5841us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.771101:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820359 00000100:00100000:1.0:1713481296.771103:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563147 00000100:00100000:2.0:1713481296.771111:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483456 00000100:00100000:2.0:1713481296.771113:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483456 00010000:00010000:2.0:1713481296.771133:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c583cc0/0xdfc0fb148802ab5 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b8a expref: 20804 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.771140:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784510144:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.771142:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483520 00000100:00100000:3.0:1713481296.771146:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483520 00000100:00100000:2.0:1713481296.771147:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483584 00000100:00100000:2.0:1713481296.771148:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483584 00010000:00010000:2.0:1713481296.771153:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135894d80/0xdfc0fb148802ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ba6 expref: 20805 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.771154:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771160:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c51d40/0xdfc0fb148688f1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c6e expref: 26887 pid: 16510 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.771162:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820360 00000100:00100000:2.0:1713481296.771164:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20805:1959:x1796714882483392:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.771168:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007723a1c0/0xdfc0fb148802392 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b6e expref: 20805 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.771168:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.771170:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148802aae lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b7c expref: 20805 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.771175:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784509632:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.771175:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148802aae lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b7c expref: 20804 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.771183:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820361 00010000:00010000:1.0:1713481296.771185:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771186:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148802aae lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b7c expref: 20804 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.771189:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.771189:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20804:1960:x1796714882483456:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.771191:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820362 00010000:00010000:2.0:1713481296.771192:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.771193:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771193:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771195:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.771196:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078198380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20803:1959:x1796714882483584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.771196:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771196:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.771199:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771201:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771202:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c583cc0/0xdfc0fb148802ab5 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x26fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b8a expref: 20803 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.771204:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771206:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.771207:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012050b180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.771208:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.771209:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771210:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135894d80/0xdfc0fb148802ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ba6 expref: 20803 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.771212:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c583cc0/0xdfc0fb148802ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b8a expref: 20803 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.771213:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.771217:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20803:1959:x1796714882483392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 51us (201us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.771219:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135894d80/0xdfc0fb148802ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ba6 expref: 20803 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.771220:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.771220:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820360 00010000:00010000:1.0:1713481296.771223:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3ac0b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771228:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.771230:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820363 00010000:00010000:3.0:1713481296.771230:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.771233:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007819b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26887:1958:x1796714882483520:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.771233:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771235:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135894d80/0xdfc0fb148802ac3 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ba6 expref: 20802 pid: 16452 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.771237:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.771240:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c51d40/0xdfc0fb148688f1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c6e expref: 26887 pid: 16510 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.771241:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771245:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771245:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c51d40/0xdfc0fb148688f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c6e expref: 26887 pid: 16510 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.771247:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.771249:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771255:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771255:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c51d40/0xdfc0fb148688f1c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c6e expref: 26887 pid: 16510 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.771255:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.771263:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771264:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771266:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771270:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.771270:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.771271:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20801:1960:x1796714882483456:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (240us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.771276:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.771278:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820361 00000100:00100000:0.0:1713481296.771283:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078198380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20801:1959:x1796714882483584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.771284:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007819b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26886:1958:x1796714882483520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.771288:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820363 00000100:00100000:0.0:1713481296.771291:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820362 00010000:00010000:2.0:1713481296.771306:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771311:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771314:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771315:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771319:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.771320:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+173:3492:x1796714784509504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5588us (5657us total) trans 4296040835 rc 0/0 00010000:00010000:0.0:1713481296.771321:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771322:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.771322:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784510208:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.771324:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563148 00010000:00010000:2.0:1713481296.771325:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008698c480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.771327:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771328:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771330:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771334:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771336:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771341:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771342:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771343:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008698c480/0xdfc0fb148a3ac27 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa93d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771346:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832cd200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.771349:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.771350:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007994e300/2, rc 0, transno 1073539 00000100:00100000:1.0:1713481296.771354:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007994e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784509504:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.771355:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771374:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.771375:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.771379:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512320:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.771380:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3ac2e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.771391:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.771403:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784512320 00000100:00100000:1.0:1713481296.771405:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784512320 00000100:00100000:1.0:1713481296.771414:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563175 00000100:00100000:1.0:1713481296.771416:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+173:3492:x1796714784512320:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.771425:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9988 count 1 00010000:00010000:1.0:1713481296.771432:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771439:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083b72d00/0xdfc0fb148802adf lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bde expref: 20799 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.771443:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.771443:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007db7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+2777:3492:x1796714784509824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5198us (5241us total) trans 4295960717 rc 0/0 00010000:00010000:1.0:1713481296.771444:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.771445:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.771447:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563151 00010000:00010000:1.0:1713481296.771455:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083b72d00/0xdfc0fb148802adf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bde expref: 20799 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.771461:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083b72d00/0xdfc0fb148802adf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bde expref: 20799 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.771466:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784512384:192.168.202.24@tcp:104: 00000004:00080000:2.0:1713481296.771471:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007db7e300/2, rc 0, transno 993421 00000100:00100000:2.0:1713481296.771474:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784509824:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.771476:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012362f6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.771493:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c583cc0/0xdfc0fb148802ab5 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b8a expref: 20799 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.771500:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+174:3490:x1796714784510080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5098us (5139us total) trans 4296040836 rc 0/0 00000100:00100000:2.0:1713481296.771503:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784512448:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.771506:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563152 00000100:00100000:1.0:1713481296.771509:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784509888:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.771516:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.771519:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.771522:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784512448 00010000:00010000:1.0:1713481296.771524:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.771525:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784512448 00010000:00010000:1.0:1713481296.771528:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.771533:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800823a0000/2, rc 0, transno 1073540 00010000:00010000:1.0:1713481296.771534:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.771537:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510080:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.771538:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563176 00010000:00010000:1.0:1713481296.771540:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.771541:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2777:3490:x1796714784512448:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.771546:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771548:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.771550:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43333 count 1 00010000:00010000:1.0:1713481296.771551:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012050a1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.771553:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771554:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771557:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771559:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771561:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771561:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771564:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771568:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801241eef40/0xdfc0fb148688f4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cde expref: 26885 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.771568:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008698e880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.771570:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771573:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.771574:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771574:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771576:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771580:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771581:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771584:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008698e880/0xdfc0fb148a3ac12 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.771586:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3ac20 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.771589:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801241eef40/0xdfc0fb148688f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cde expref: 26885 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.771601:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801241eef40/0xdfc0fb148688f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cde expref: 26885 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.771609:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007819a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784512512:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.771623:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085dce300 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.771650:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.771655:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784510336:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.771688:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.771700:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483712 00000100:00100000:2.0:1713481296.771702:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483712 00010000:00010000:2.0:1713481296.771710:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f932640/0xdfc0fb148802abc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b98 expref: 20799 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.771722:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820364 00000100:00100000:2.0:1713481296.771725:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20799:1959:x1796714882483712:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.771729:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.771731:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f932640/0xdfc0fb148802abc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x26ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b98 expref: 20799 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.771735:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+175:3491:x1796714784509760:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5715us (5832us total) trans 4296040838 rc 0/0 00010000:00010000:2.0:1713481296.771736:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f932640/0xdfc0fb148802abc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x26ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b98 expref: 20799 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.771739:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.771741:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563150 00010000:00010000:2.0:1713481296.771746:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f932640/0xdfc0fb148802abc lrc: 0/0,0 mode: --/PR res: [0x280000408:0x26ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962b98 expref: 20799 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.771755:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771756:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771757:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771762:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.771768:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+174:3490:x1796714784509568:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5999us (6031us total) trans 4296040837 rc 0/0 00010000:00010000:2.0:1713481296.771772:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.771775:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563149 00000100:00100000:2.0:1713481296.771781:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20798:1959:x1796714882483712:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.771784:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820364 00000100:00100000:2.0:1713481296.771794:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483648 00000040:00080000:1.0:1713481296.771796:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31990, 64 off2055552 00000100:00100000:2.0:1713481296.771796:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483648 00010000:00010000:2.0:1713481296.771801:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d1b00/0xdfc0fb148688f23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c7c expref: 26886 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.771805:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784512576:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.771809:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820365 00000040:00080000:1.0:1713481296.771810:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3538, 64 off234624 00000100:00100000:2.0:1713481296.771812:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26886:1959:x1796714882483648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000040:00080000:1.0:1713481296.771815:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31991, 64 off2055616 00010000:00010000:2.0:1713481296.771816:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.771818:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d0d1b00/0xdfc0fb148688f23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c7c expref: 26886 pid: 15511 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.771820:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3539, 64 off234688 00010000:00010000:2.0:1713481296.771822:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d0d1b00/0xdfc0fb148688f23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c7c expref: 26886 pid: 15511 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.771825:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31992, 64 off2055680 00000100:00100000:3.0:1713481296.771826:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713481296.771830:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3540, 64 off234752 00010000:00010000:2.0:1713481296.771832:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d1b00/0xdfc0fb148688f23 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c7c expref: 26886 pid: 15511 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.771835:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31993, 64 off2055744 00000040:00080000:1.0:1713481296.771839:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3541, 64 off234816 00010000:00010000:2.0:1713481296.771839:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771840:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.771841:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.771844:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31994, 64 off2055808 00010000:00010000:2.0:1713481296.771845:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.771849:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3542, 64 off234880 00000004:00080000:3.0:1713481296.771850:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800823a0a80/2, rc 0, transno 1073542 00000040:00080000:1.0:1713481296.771853:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31995, 64 off2055872 00010000:00010000:2.0:1713481296.771853:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.771856:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784509760:0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713481296.771859:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3543, 64 off234944 00000100:00100000:2.0:1713481296.771860:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26885:1959:x1796714882483648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 47us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.771863:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820365 00000040:00080000:1.0:1713481296.771864:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31996, 64 off2055936 00000040:00080000:1.0:1713481296.771868:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3544, 64 off235008 00000040:00080000:1.0:1713481296.771873:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31997, 64 off2056000 00010000:00010000:2.0:1713481296.771875:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.771875:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784512576 00000100:00100000:3.0:1713481296.771877:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784512576 00000040:00080000:1.0:1713481296.771878:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3545, 64 off235072 00010000:00010000:2.0:1713481296.771879:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.771883:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31998, 64 off2056064 00010000:00010000:2.0:1713481296.771886:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.771887:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3546, 64 off235136 00000100:00100000:0.0:1713481296.771888:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800783fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512640:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.771889:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563177 00010000:00010000:2.0:1713481296.771890:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.771892:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].31999, 64 off2056128 00000100:00100000:3.0:1713481296.771892:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+174:3491:x1796714784512576:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.771894:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.771897:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3547, 64 off235200 00010000:00010000:2.0:1713481296.771897:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ff78b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.771898:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.771901:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9989 count 1 00000040:00080000:1.0:1713481296.771902:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32000, 64 off2056192 00010000:00010000:2.0:1713481296.771902:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.771906:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3548, 64 off235264 00000100:00100000:0.0:1713481296.771909:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.771909:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771910:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.771913:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff78b40/0xdfc0fb148a3ac35 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x26ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771919:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013543db00/0xdfc0fb148802ae6 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bec expref: 20797 pid: 16452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.771924:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.771925:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.771927:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.771937:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013543db00/0xdfc0fb148802ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bec expref: 20797 pid: 16452 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.771943:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32001, 64 off2056256 00010000:00010000:3.0:1713481296.771943:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013543db00/0xdfc0fb148802ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bec expref: 20797 pid: 16452 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.771949:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784512704:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.771951:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3549, 64 off235328 00000040:00080000:1.0:1713481296.771957:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32002, 64 off2056320 00000100:00100000:3.0:1713481296.771961:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9900 going to sleep for 11 seconds 00000040:00080000:1.0:1713481296.771962:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3550, 64 off235392 00000040:00080000:1.0:1713481296.771967:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32003, 64 off2056384 00000040:00080000:1.0:1713481296.771971:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3551, 64 off235456 00000040:00080000:1.0:1713481296.771976:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32004, 64 off2056448 00000100:00100000:3.0:1713481296.771976:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784512640 00000100:00100000:3.0:1713481296.771978:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784512640 00000040:00080000:1.0:1713481296.771981:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3552, 64 off235520 00000040:00080000:1.0:1713481296.771986:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32005, 64 off2056512 00000100:00100000:3.0:1713481296.771989:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563178 00000040:00080000:1.0:1713481296.771990:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3553, 64 off235584 00000100:00100000:3.0:1713481296.771992:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+176:3492:x1796714784512640:12345-0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713481296.771995:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32006, 64 off2056576 00000040:00080000:1.0:1713481296.772000:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3554, 64 off235648 00002000:00080000:3.0:1713481296.772000:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9990 count 1 00000040:00080000:1.0:1713481296.772004:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32007, 64 off2056640 00000100:00100000:2.0:1713481296.772005:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007db7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+176:3493:x1796714784510016:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5595us (5660us total) trans 4296040839 rc 0/0 00010000:00010000:3.0:1713481296.772007:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772009:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3555, 64 off235712 00000100:00100000:2.0:1713481296.772009:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563153 00000040:00080000:1.0:1713481296.772013:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32008, 64 off2056704 00010000:00010000:3.0:1713481296.772014:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9306c0/0xdfc0fb148802af4 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bfa expref: 20797 pid: 9201 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.772018:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3556, 64 off235776 00010000:00010000:3.0:1713481296.772019:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.772020:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713481296.772022:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32009, 64 off2056768 00010000:00010000:3.0:1713481296.772022:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772027:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3557, 64 off235840 00000040:00080000:1.0:1713481296.772031:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32010, 64 off2056832 00010000:00010000:3.0:1713481296.772031:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9306c0/0xdfc0fb148802af4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bfa expref: 20797 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.772035:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9306c0/0xdfc0fb148802af4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bfa expref: 20797 pid: 9201 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.772036:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3558, 64 off235904 00000004:00080000:2.0:1713481296.772037:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011da4d500/2, rc 0, transno 1073541 00000100:00100000:3.0:1713481296.772040:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784512768:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.772041:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32011, 64 off2056896 00000100:00100000:2.0:1713481296.772043:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011da4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784509568:0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713481296.772045:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3559, 64 off235968 00000040:00080000:1.0:1713481296.772050:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32012, 64 off2056960 00010000:00010000:2.0:1713481296.772050:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.772050:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1713481296.772055:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3560, 64 off236032 00010000:00010000:2.0:1713481296.772055:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772059:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32013, 64 off2057024 00010000:00010000:2.0:1713481296.772059:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.772062:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.772064:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000040:00080000:1.0:1713481296.772064:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3561, 64 off236096 00010000:00010000:2.0:1713481296.772066:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772068:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32014, 64 off2057088 00010000:00010000:2.0:1713481296.772069:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008698f840 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.772070:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800783faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512832:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.772070:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772073:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3562, 64 off236160 00010000:00010000:2.0:1713481296.772074:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772077:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32015, 64 off2057152 00010000:00010000:2.0:1713481296.772081:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772082:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3563, 64 off236224 00010000:00010000:2.0:1713481296.772085:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008698f840/0xdfc0fb148a3ac3c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa93e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.772087:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713481296.772087:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32016, 64 off2057216 00000040:00080000:1.0:1713481296.772091:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3564, 64 off236288 00000040:00080000:1.0:1713481296.772096:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32017, 64 off2057280 00000040:00080000:1.0:1713481296.772100:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3565, 64 off236352 00000040:00080000:1.0:1713481296.772104:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32018, 64 off2057344 00000040:00080000:1.0:1713481296.772109:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3566, 64 off236416 00000040:00080000:1.0:1713481296.772114:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32019, 64 off2057408 00000040:00080000:1.0:1713481296.772137:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3567, 64 off236480 00000040:00080000:1.0:1713481296.772144:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32020, 64 off2057472 00000040:00080000:1.0:1713481296.772149:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3568, 64 off236544 00000040:00080000:1.0:1713481296.772154:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32021, 64 off2057536 00000040:00080000:1.0:1713481296.772158:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3569, 64 off236608 00000040:00080000:1.0:1713481296.772163:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32022, 64 off2057600 00000040:00080000:1.0:1713481296.772167:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3570, 64 off236672 00000040:00080000:1.0:1713481296.772172:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32023, 64 off2057664 00000040:00080000:1.0:1713481296.772176:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3571, 64 off236736 00000040:00080000:1.0:1713481296.772181:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32024, 64 off2057728 00000040:00080000:1.0:1713481296.772186:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3572, 64 off236800 00000040:00080000:1.0:1713481296.772190:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32025, 64 off2057792 00000040:00080000:1.0:1713481296.772195:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3573, 64 off236864 00000100:00100000:2.0:1713481296.772197:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2778:3490:x1796714784510272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5564us (5590us total) trans 4295960718 rc 0/0 00000040:00080000:1.0:1713481296.772199:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32026, 64 off2057856 00000100:00100000:2.0:1713481296.772201:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563154 00000040:00080000:1.0:1713481296.772204:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3574, 64 off236928 00000040:00080000:1.0:1713481296.772208:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32027, 64 off2057920 00000100:00100000:2.0:1713481296.772211:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784512832 00000040:00080000:1.0:1713481296.772213:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3575, 64 off236992 00000100:00100000:2.0:1713481296.772213:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784512832 00000040:00080000:1.0:1713481296.772218:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32028, 64 off2057984 00000040:00080000:1.0:1713481296.772222:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3576, 64 off237056 00000040:00080000:1.0:1713481296.772227:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32029, 64 off2058048 00000100:00100000:2.0:1713481296.772228:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563179 00000100:00100000:2.0:1713481296.772231:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+176:3492:x1796714784512832:12345-0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713481296.772232:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3577, 64 off237120 00000040:00080000:1.0:1713481296.772237:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32030, 64 off2058112 00002000:00080000:2.0:1713481296.772238:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9991 count 1 00000040:00080000:1.0:1713481296.772241:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3578, 64 off237184 00000040:00080000:1.0:1713481296.772246:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32031, 64 off2058176 00010000:00010000:2.0:1713481296.772246:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772251:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3579, 64 off237248 00010000:00010000:2.0:1713481296.772252:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c581440/0xdfc0fb148802aed lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c08 expref: 20797 pid: 16497 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.772256:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32032, 64 off2058240 00010000:00010000:2.0:1713481296.772256:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.772257:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.772259:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772261:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3580, 64 off237312 00000040:00080000:1.0:1713481296.772266:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32033, 64 off2058304 00010000:00010000:2.0:1713481296.772269:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c581440/0xdfc0fb148802aed lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c08 expref: 20797 pid: 16497 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.772270:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3581, 64 off237376 00010000:00010000:2.0:1713481296.772274:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c581440/0xdfc0fb148802aed lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c08 expref: 20797 pid: 16497 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.772275:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32034, 64 off2058368 00000040:00080000:1.0:1713481296.772279:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3582, 64 off237440 00000100:00100000:2.0:1713481296.772280:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784512896:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.772284:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32035, 64 off2058432 00000040:00080000:1.0:1713481296.772288:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3583, 64 off237504 00000100:00100000:2.0:1713481296.772291:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364d80 going to sleep for 11 seconds 00000040:00080000:1.0:1713481296.772293:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32036, 64 off2058496 00000040:00080000:1.0:1713481296.772298:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3584, 64 off237568 00000040:00080000:1.0:1713481296.772302:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32037, 64 off2058560 00000004:00080000:2.0:1713481296.772309:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007db7f100/2, rc 0, transno 993422 00000100:00100000:2.0:1713481296.772313:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510272:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.772338:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784512960:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713481296.772339:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3585, 64 off237632 00000040:00080000:1.0:1713481296.772348:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32038, 64 off2058624 00000100:00100000:2.0:1713481296.772351:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713481296.772353:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3586, 64 off237696 00000040:00080000:1.0:1713481296.772358:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32039, 64 off2058688 00000040:00080000:1.0:1713481296.772362:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3587, 64 off237760 00000040:00080000:1.0:1713481296.772367:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32040, 64 off2058752 00000100:00100000:2.0:1713481296.772368:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784512960 00000100:00100000:2.0:1713481296.772370:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784512960 00000040:00080000:1.0:1713481296.772371:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3588, 64 off237824 00000040:00080000:1.0:1713481296.772376:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32041, 64 off2058816 00000040:00080000:1.0:1713481296.772380:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3589, 64 off237888 00000100:00100000:2.0:1713481296.772384:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563180 00000040:00080000:1.0:1713481296.772385:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32042, 64 off2058880 00000100:00100000:2.0:1713481296.772387:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007db7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2778:3490:x1796714784512960:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713481296.772389:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3590, 64 off237952 00000040:00080000:1.0:1713481296.772394:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32043, 64 off2058944 00002000:00080000:2.0:1713481296.772394:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43334 count 1 00000040:00080000:1.0:1713481296.772399:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3591, 64 off238016 00010000:00010000:2.0:1713481296.772400:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772403:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32044, 64 off2059008 00010000:00010000:2.0:1713481296.772407:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0480/0xdfc0fb148688f54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cec expref: 26884 pid: 15511 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.772410:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3592, 64 off238080 00010000:00010000:2.0:1713481296.772410:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.772411:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.772413:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772418:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32045, 64 off2059072 00010000:00010000:2.0:1713481296.772422:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0480/0xdfc0fb148688f54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cec expref: 26884 pid: 15511 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713481296.772425:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3593, 64 off238144 00010000:00010000:2.0:1713481296.772427:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0480/0xdfc0fb148688f54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cec expref: 26884 pid: 15511 timeout: 815 lvb_type: 1 00000040:00080000:1.0:1713481296.772432:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32046, 64 off2059136 00000100:00100000:2.0:1713481296.772436:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784513024:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.772440:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3594, 64 off238208 00000100:00100000:2.0:1713481296.772445:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941d0c0 going to sleep for 11 seconds 00000040:00080000:1.0:1713481296.772449:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32047, 64 off2059200 00000040:00080000:1.0:1713481296.772457:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3595, 64 off238272 00000040:00080000:1.0:1713481296.772466:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32048, 64 off2059264 00000040:00080000:1.0:1713481296.772475:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3596, 64 off238336 00000040:00080000:1.0:1713481296.772483:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32049, 64 off2059328 00000040:00080000:1.0:1713481296.772491:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3597, 64 off238400 00000040:00080000:1.0:1713481296.772498:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32050, 64 off2059392 00000040:00080000:1.0:1713481296.772504:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3598, 64 off238464 00000040:00080000:1.0:1713481296.772512:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32051, 64 off2059456 00000040:00080000:1.0:1713481296.772520:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3599, 64 off238528 00000040:00080000:1.0:1713481296.772528:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32052, 64 off2059520 00000040:00080000:1.0:1713481296.772533:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3600, 64 off238592 00000040:00080000:1.0:1713481296.772538:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32053, 64 off2059584 00000040:00080000:1.0:1713481296.772542:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3601, 64 off238656 00000040:00080000:1.0:1713481296.772547:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32054, 64 off2059648 00000040:00080000:1.0:1713481296.772552:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3602, 64 off238720 00000040:00080000:1.0:1713481296.772557:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32055, 64 off2059712 00000040:00080000:1.0:1713481296.772561:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3603, 64 off238784 00000040:00080000:1.0:1713481296.772566:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32056, 64 off2059776 00000040:00080000:1.0:1713481296.772570:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3604, 64 off238848 00000040:00080000:1.0:1713481296.772575:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32057, 64 off2059840 00000040:00080000:1.0:1713481296.772579:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3605, 64 off238912 00000040:00080000:1.0:1713481296.772584:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32058, 64 off2059904 00000040:00080000:1.0:1713481296.772588:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3606, 64 off238976 00000040:00080000:1.0:1713481296.772593:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32059, 64 off2059968 00000040:00080000:1.0:1713481296.772597:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3607, 64 off239040 00000040:00080000:1.0:1713481296.772602:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32060, 64 off2060032 00000040:00080000:1.0:1713481296.772607:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3608, 64 off239104 00000040:00080000:1.0:1713481296.772611:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32061, 64 off2060096 00000040:00080000:1.0:1713481296.772616:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3609, 64 off239168 00000040:00080000:1.0:1713481296.772620:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32062, 64 off2060160 00000040:00080000:1.0:1713481296.772625:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3610, 64 off239232 00000040:00080000:1.0:1713481296.772630:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32063, 64 off2060224 00000040:00080000:1.0:1713481296.772634:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3611, 64 off239296 00000040:00080000:1.0:1713481296.772639:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32064, 64 off2060288 00000040:00080000:1.0:1713481296.772644:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3612, 64 off239360 00000040:00080000:1.0:1713481296.772699:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32065, 64 off2060352 00000040:00080000:1.0:1713481296.772709:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3613, 64 off239424 00000040:00080000:1.0:1713481296.772714:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32066, 64 off2060416 00000040:00080000:1.0:1713481296.772719:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3614, 64 off239488 00000040:00080000:1.0:1713481296.772724:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32067, 64 off2060480 00000040:00080000:1.0:1713481296.772729:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3615, 64 off239552 00000040:00080000:1.0:1713481296.772733:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32068, 64 off2060544 00000040:00080000:1.0:1713481296.772738:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3616, 64 off239616 00000040:00080000:1.0:1713481296.772743:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32069, 64 off2060608 00000040:00080000:1.0:1713481296.772747:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3617, 64 off239680 00000040:00080000:1.0:1713481296.772752:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32070, 64 off2060672 00000040:00080000:1.0:1713481296.772756:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3618, 64 off239744 00000040:00080000:1.0:1713481296.772761:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32071, 64 off2060736 00000040:00080000:1.0:1713481296.772765:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3619, 64 off239808 00000040:00080000:1.0:1713481296.772770:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32072, 64 off2060800 00000040:00080000:1.0:1713481296.772774:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3620, 64 off239872 00000040:00080000:1.0:1713481296.772779:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32073, 64 off2060864 00000040:00080000:1.0:1713481296.772783:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3621, 64 off239936 00000040:00080000:1.0:1713481296.772788:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32074, 64 off2060928 00000040:00080000:1.0:1713481296.772793:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3622, 64 off240000 00000040:00080000:1.0:1713481296.772797:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32075, 64 off2060992 00000040:00080000:1.0:1713481296.772802:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3623, 64 off240064 00000040:00080000:1.0:1713481296.772806:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32076, 64 off2061056 00000040:00080000:1.0:1713481296.772811:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3624, 64 off240128 00000040:00080000:1.0:1713481296.772816:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32077, 64 off2061120 00000040:00080000:1.0:1713481296.772820:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3625, 64 off240192 00000040:00080000:1.0:1713481296.772825:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32078, 64 off2061184 00000040:00080000:1.0:1713481296.772829:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3626, 64 off240256 00000040:00080000:1.0:1713481296.772834:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32079, 64 off2061248 00000040:00080000:1.0:1713481296.772839:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3627, 64 off240320 00000040:00080000:1.0:1713481296.772844:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32080, 64 off2061312 00000040:00080000:1.0:1713481296.772848:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3628, 64 off240384 00000040:00080000:1.0:1713481296.772853:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32081, 64 off2061376 00000040:00080000:1.0:1713481296.772858:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3629, 64 off240448 00000040:00080000:1.0:1713481296.772863:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32082, 64 off2061440 00000040:00080000:1.0:1713481296.772867:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3630, 64 off240512 00000040:00080000:1.0:1713481296.772872:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32083, 64 off2061504 00000040:00080000:1.0:1713481296.772876:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3631, 64 off240576 00000040:00080000:1.0:1713481296.772881:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32084, 64 off2061568 00000040:00080000:1.0:1713481296.772885:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3632, 64 off240640 00000040:00080000:1.0:1713481296.772890:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32085, 64 off2061632 00000040:00080000:1.0:1713481296.772894:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3633, 64 off240704 00000040:00080000:1.0:1713481296.772899:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32086, 64 off2061696 00000040:00080000:1.0:1713481296.772903:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3634, 64 off240768 00000040:00080000:1.0:1713481296.772908:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32087, 64 off2061760 00000040:00080000:1.0:1713481296.772912:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3635, 64 off240832 00000040:00080000:1.0:1713481296.772917:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32088, 64 off2061824 00000040:00080000:1.0:1713481296.772921:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3636, 64 off240896 00000040:00080000:1.0:1713481296.772926:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32089, 64 off2061888 00000040:00080000:1.0:1713481296.772930:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3637, 64 off240960 00000040:00080000:1.0:1713481296.772935:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32090, 64 off2061952 00000040:00080000:1.0:1713481296.772939:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3638, 64 off241024 00000040:00080000:1.0:1713481296.772944:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32091, 64 off2062016 00000040:00080000:1.0:1713481296.772948:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3639, 64 off241088 00000040:00080000:1.0:1713481296.772953:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32092, 64 off2062080 00000100:00100000:2.0:1713481296.772956:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784510400:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.772957:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3640, 64 off241152 00000040:00080000:1.0:1713481296.772962:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32093, 64 off2062144 00000040:00080000:1.0:1713481296.772966:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3641, 64 off241216 00010000:00010000:2.0:1713481296.772970:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007a284d80/0xdfc0fb148a3ac4a lrc: 3/0,0 mode: --/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49682 expref: 16883 pid: 16498 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.772971:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32094, 64 off2062208 00000040:00080000:1.0:1713481296.772975:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3642, 64 off241280 00010000:00010000:2.0:1713481296.772976:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a284d80, rc 0) 00000040:00080000:1.0:1713481296.772980:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32095, 64 off2062272 00000040:00080000:1.0:1713481296.772985:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3643, 64 off241344 00000040:00080000:1.0:1713481296.772990:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32096, 64 off2062336 00000100:00100000:2.0:1713481296.772990:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16883:18817:x1796714882481088:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6168us (6274us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.772994:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3644, 64 off241408 00000100:00100000:2.0:1713481296.772994:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563156 00000040:00080000:1.0:1713481296.772999:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32097, 64 off2062400 00000040:00080000:1.0:1713481296.773004:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3645, 64 off241472 00000040:00080000:1.0:1713481296.773008:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32098, 64 off2062464 00000040:00080000:1.0:1713481296.773013:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3646, 64 off241536 00000040:00080000:1.0:1713481296.773017:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32099, 64 off2062528 00000040:00080000:1.0:1713481296.773022:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3647, 64 off241600 00000040:00080000:1.0:1713481296.773027:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32100, 64 off2062592 00000040:00080000:1.0:1713481296.773031:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3648, 64 off241664 00000040:00080000:1.0:1713481296.773036:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32101, 64 off2062656 00000040:00080000:1.0:1713481296.773063:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3649, 64 off241728 00000100:00100000:0.0:1713481296.773068:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.773071:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32102, 64 off2062720 00000040:00080000:1.0:1713481296.773076:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3650, 64 off241792 00000100:00100000:2.0:1713481296.773078:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483776 00000100:00100000:2.0:1713481296.773079:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483776 00000040:00080000:1.0:1713481296.773081:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32103, 64 off2062784 00000040:00080000:1.0:1713481296.773086:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3651, 64 off241856 00000100:00100000:2.0:1713481296.773089:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563181 00000040:00080000:1.0:1713481296.773090:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32104, 64 off2062848 00000100:00100000:2.0:1713481296.773092:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26885:17935:x1796714882483776:12345-192.168.202.24@tcp:101:dd.0 00000040:00080000:1.0:1713481296.773095:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3652, 64 off241920 00010000:00010000:2.0:1713481296.773096:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1713481296.773100:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32105, 64 off2062912 00010000:00010000:2.0:1713481296.773103:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148a3ad9a lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa496f9 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.773104:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3653, 64 off241984 00000040:00080000:1.0:1713481296.773109:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32106, 64 off2062976 00002000:00010000:2.0:1713481296.773112:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb794:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000040:00080000:1.0:1713481296.773113:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3654, 64 off242048 00010000:00010000:2.0:1713481296.773134:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.773135:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.773138:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148a3ad9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496f9 expref: 26886 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.773147:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942abcc0/0xdfc0fb148a3ad9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496f9 expref: 26886 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.773151:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784510528:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.773152:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942abcc0, rc 0) 00000100:00100000:2.0:1713481296.773163:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26886:17935:x1796714882483776:12345-192.168.202.24@tcp:101:dd.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.773167:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563181 00010000:00010000:1.0:1713481296.773168:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.773188:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800823a2a00/2, rc 0, transno 1073543 00000100:00100000:1.0:1713481296.773200:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784510016:0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713481296.773216:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32107, 64 off2063040 00000040:00080000:1.0:1713481296.773224:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3655, 64 off242112 00000100:00100000:0.0:1713481296.773229:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800783f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784513088:0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713481296.773229:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32108, 64 off2063104 00000040:00080000:1.0:1713481296.773234:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3656, 64 off242176 00000040:00080000:1.0:1713481296.773239:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32109, 64 off2063168 00000040:00080000:1.0:1713481296.773244:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3657, 64 off242240 00000040:00080000:1.0:1713481296.773248:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32110, 64 off2063232 00000040:00080000:1.0:1713481296.773253:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3658, 64 off242304 00000040:00080000:1.0:1713481296.773258:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32111, 64 off2063296 00000040:00080000:1.0:1713481296.773263:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3659, 64 off242368 00000040:00080000:1.0:1713481296.773267:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32112, 64 off2063360 00000040:00080000:1.0:1713481296.773272:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3660, 64 off242432 00000040:00080000:1.0:1713481296.773276:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32113, 64 off2063424 00000040:00080000:1.0:1713481296.773281:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3661, 64 off242496 00000040:00080000:1.0:1713481296.773286:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32114, 64 off2063488 00000040:00080000:1.0:1713481296.773290:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3662, 64 off242560 00000040:00080000:1.0:1713481296.773297:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32115, 64 off2063552 00000040:00080000:1.0:1713481296.773305:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3663, 64 off242624 00000100:00100000:0.0:1713481296.773313:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713481296.773313:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32116, 64 off2063616 00000100:00100000:1.0:1713481296.773333:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784513088 00000100:00100000:1.0:1713481296.773336:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784513088 00000100:00100000:1.0:1713481296.773352:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563182 00000100:00100000:1.0:1713481296.773356:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+177:3491:x1796714784513088:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.773366:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9992 count 1 00010000:00010000:1.0:1713481296.773374:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.773382:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8faf40/0xdfc0fb148803210 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c16 expref: 20797 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.773386:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.773387:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.773389:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.773399:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8faf40/0xdfc0fb148803210 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c16 expref: 20797 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.773405:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8faf40/0xdfc0fb148803210 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c16 expref: 20797 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.773411:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784513152:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.773428:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800894a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.773447:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784510656:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.773466:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.773503:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784510848:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.773518:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.773519:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075443100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784510912:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.773537:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3664, 64 off242688 00000040:00080000:1.0:1713481296.773549:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32117, 64 off2063680 00000040:00080000:1.0:1713481296.773556:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3665, 64 off242752 00000040:00080000:1.0:1713481296.773563:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32118, 64 off2063744 00000040:00080000:1.0:1713481296.773570:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3666, 64 off242816 00000040:00080000:1.0:1713481296.773578:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32119, 64 off2063808 00000040:00080000:1.0:1713481296.773585:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3667, 64 off242880 00000040:00080000:1.0:1713481296.773591:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32120, 64 off2063872 00000040:00080000:1.0:1713481296.773596:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3668, 64 off242944 00000040:00080000:1.0:1713481296.773601:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32121, 64 off2063936 00000040:00080000:1.0:1713481296.773605:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3669, 64 off243008 00000040:00080000:1.0:1713481296.773610:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32122, 64 off2064000 00000040:00080000:1.0:1713481296.773615:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3670, 64 off243072 00000040:00080000:1.0:1713481296.773619:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32123, 64 off2064064 00000040:00080000:1.0:1713481296.773624:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3671, 64 off243136 00010000:00010000:0.0:1713481296.773627:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.773629:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32124, 64 off2064128 00000040:00080000:1.0:1713481296.773633:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3672, 64 off243200 00000040:00080000:1.0:1713481296.773638:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32125, 64 off2064192 00000040:00080000:1.0:1713481296.773643:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3673, 64 off243264 00000040:00080000:1.0:1713481296.773647:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32126, 64 off2064256 00000040:00080000:1.0:1713481296.773652:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3674, 64 off243328 00000040:00080000:1.0:1713481296.773656:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32127, 64 off2064320 00000040:00080000:1.0:1713481296.773661:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3675, 64 off243392 00000040:00080000:1.0:1713481296.773681:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32128, 64 off2064384 00000040:00080000:1.0:1713481296.773686:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3676, 64 off243456 00000040:00080000:1.0:1713481296.773722:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32129, 64 off2064448 00000040:00080000:1.0:1713481296.773730:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3677, 64 off243520 00000040:00080000:1.0:1713481296.773736:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32130, 64 off2064512 00000040:00080000:1.0:1713481296.773741:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3678, 64 off243584 00000040:00080000:1.0:1713481296.773745:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32131, 64 off2064576 00000040:00080000:1.0:1713481296.773750:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3679, 64 off243648 00000040:00080000:1.0:1713481296.773755:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32132, 64 off2064640 00000040:00080000:1.0:1713481296.773759:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3680, 64 off243712 00000040:00080000:1.0:1713481296.773764:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32133, 64 off2064704 00000040:00080000:1.0:1713481296.773769:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3681, 64 off243776 00000040:00080000:1.0:1713481296.773773:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32134, 64 off2064768 00000040:00080000:1.0:1713481296.773778:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3682, 64 off243840 00000040:00080000:1.0:1713481296.773783:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32135, 64 off2064832 00000040:00080000:1.0:1713481296.773787:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3683, 64 off243904 00000040:00080000:1.0:1713481296.773793:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32136, 64 off2064896 00000040:00080000:1.0:1713481296.773797:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3684, 64 off243968 00000040:00080000:1.0:1713481296.773802:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32137, 64 off2064960 00000040:00080000:1.0:1713481296.773807:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3685, 64 off244032 00000040:00080000:1.0:1713481296.773812:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32138, 64 off2065024 00000040:00080000:1.0:1713481296.773817:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3686, 64 off244096 00000040:00080000:1.0:1713481296.773821:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32139, 64 off2065088 00000040:00080000:1.0:1713481296.773826:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3687, 64 off244160 00000040:00080000:1.0:1713481296.773830:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32140, 64 off2065152 00000040:00080000:1.0:1713481296.773835:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3688, 64 off244224 00000040:00080000:1.0:1713481296.773840:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32141, 64 off2065216 00000040:00080000:1.0:1713481296.773845:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3689, 64 off244288 00000040:00080000:1.0:1713481296.773849:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32142, 64 off2065280 00000040:00080000:1.0:1713481296.773854:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3690, 64 off244352 00000040:00080000:1.0:1713481296.773859:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32143, 64 off2065344 00000040:00080000:1.0:1713481296.773863:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3691, 64 off244416 00000040:00080000:1.0:1713481296.773868:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32144, 64 off2065408 00000040:00080000:1.0:1713481296.773872:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3692, 64 off244480 00000040:00080000:1.0:1713481296.773877:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32145, 64 off2065472 00000040:00080000:1.0:1713481296.773882:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3693, 64 off244544 00000040:00080000:1.0:1713481296.773886:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32146, 64 off2065536 00000040:00080000:1.0:1713481296.773891:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3694, 64 off244608 00000040:00080000:1.0:1713481296.773896:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32147, 64 off2065600 00000040:00080000:1.0:1713481296.773900:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3695, 64 off244672 00000040:00080000:1.0:1713481296.773905:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32148, 64 off2065664 00000040:00080000:1.0:1713481296.773909:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3696, 64 off244736 00000040:00080000:1.0:1713481296.773914:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32149, 64 off2065728 00000040:00080000:1.0:1713481296.773919:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3697, 64 off244800 00000040:00080000:1.0:1713481296.773923:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32150, 64 off2065792 00000040:00080000:1.0:1713481296.773928:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3698, 64 off244864 00000040:00080000:1.0:1713481296.773933:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32151, 64 off2065856 00000040:00080000:1.0:1713481296.773937:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3699, 64 off244928 00000040:00080000:1.0:1713481296.773942:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32152, 64 off2065920 00000040:00080000:1.0:1713481296.773947:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3700, 64 off244992 00000040:00080000:1.0:1713481296.773951:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32153, 64 off2065984 00000040:00080000:1.0:1713481296.773956:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3701, 64 off245056 00000040:00080000:1.0:1713481296.773961:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32154, 64 off2066048 00000040:00080000:1.0:1713481296.773965:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3702, 64 off245120 00000100:00100000:0.0:1713481296.773970:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075443480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784511040:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.773970:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32155, 64 off2066112 00000040:00080000:1.0:1713481296.773974:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3703, 64 off245184 00000040:00080000:1.0:1713481296.773979:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32156, 64 off2066176 00000040:00080000:1.0:1713481296.773983:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3704, 64 off245248 00000040:00080000:1.0:1713481296.773988:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32157, 64 off2066240 00010000:00010000:0.0:1713481296.773989:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133a7db00/0xdfc0fb148a3ac89 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49690 expref: 26885 pid: 16481 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.773993:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3705, 64 off245312 00000040:00080000:1.0:1713481296.773997:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32158, 64 off2066304 00000040:00080000:1.0:1713481296.774002:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3706, 64 off245376 00010000:00010000:0.0:1713481296.774004:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133a7db00, rc 0) 00000040:00080000:1.0:1713481296.774006:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32159, 64 off2066368 00000040:00080000:1.0:1713481296.774011:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3707, 64 off245440 00000040:00080000:1.0:1713481296.774015:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32160, 64 off2066432 00000040:00080000:1.0:1713481296.774020:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3708, 64 off245504 00000040:00080000:1.0:1713481296.774024:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32161, 64 off2066496 00000040:00080000:1.0:1713481296.774029:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3709, 64 off245568 00000040:00080000:1.0:1713481296.774034:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32162, 64 off2066560 00000040:00080000:1.0:1713481296.774038:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3710, 64 off245632 00000040:00080000:1.0:1713481296.774043:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32163, 64 off2066624 00000100:00100000:0.0:1713481296.774048:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26885:11388:x1796714882481216:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6303us (6335us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.774048:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3711, 64 off245696 00000040:00080000:1.0:1713481296.774052:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32164, 64 off2066688 00000100:00100000:0.0:1713481296.774054:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563162 00000040:00080000:1.0:1713481296.774057:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3712, 64 off245760 00000040:00080000:1.0:1713481296.774061:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32165, 64 off2066752 00000100:00100000:0.0:1713481296.774088:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.774090:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3713, 64 off245824 00000100:00100000:1.0:1713481296.774107:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484032 00000100:00100000:1.0:1713481296.774110:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484032 00000100:00100000:1.0:1713481296.774146:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485841 00000100:00100000:1.0:1713481296.774150:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18878:x1796714882484032:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:1.0:1713481296.774158:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.774166:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa18c0/0xdfc0fb148a3ada8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49700 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.774174:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.774184:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.774193:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483904 00000100:00100000:2.0:1713481296.774198:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483904 00000100:00100000:0.0:1713481296.774199:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.774207:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484096 00000100:00100000:0.0:1713481296.774209:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.774211:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007fff2640/0xdfc0fb148688f2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c8a expref: 26885 pid: 16510 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.774212:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484096 00010000:00010000:1.0:1713481296.774217:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.774218:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.774225:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.774228:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c582f40/0xdfc0fb148802ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bc2 expref: 20798 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.774231:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.774231:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484224 00000100:00100000:2.0:1713481296.774233:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484224 00000100:00100000:0.0:1713481296.774237:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483840 00000100:00100000:0.0:1713481296.774239:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483840 00010000:00010000:2.0:1713481296.774240:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009af26880/0xdfc0fb148942412 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b8 expref: 24479 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.774241:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.774246:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.774248:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882483968 00010000:00010000:0.0:1713481296.774249:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095c9cfc0/0xdfc0fb1489cfa38 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22257 expref: 20799 pid: 16493 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.774251:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.774251:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882483968 00000100:00100000:2.0:1713481296.774253:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820366 00000100:00100000:2.0:1713481296.774257:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4018050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26885:1959:x1796714882483904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.774262:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.774262:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083b70000/0xdfc0fb148802aca lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bb4 expref: 20800 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.774265:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007fff2640/0xdfc0fb148688f2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c8a expref: 26885 pid: 16510 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.774268:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820367 00010000:00010000:1.0:1713481296.774268:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.774271:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.774271:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007fff2640/0xdfc0fb148688f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c8a expref: 26885 pid: 16510 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.774273:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20800:1959:x1796714882484096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.774274:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.774277:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.774280:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.774280:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa2ac0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:3.0:1713481296.774280:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820368 00010000:00010000:1.0:1713481296.774282:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.774285:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c582f40/0xdfc0fb148802ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2702:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bc2 expref: 20800 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.774285:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.774286:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fff2640/0xdfc0fb148688f2a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c8a expref: 26885 pid: 16510 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.774287:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800783f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1959:x1796714882484224:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.774290:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.774291:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.774293:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.774294:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c582f40/0xdfc0fb148802ad1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2702:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bc2 expref: 20800 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.774296:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa2ac0/0xdfc0fb148a3adaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.774297:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.774298:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.774298:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.774300:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.774303:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af26880/0xdfc0fb148942412 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b8 expref: 24479 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.774305:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.774305:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774308:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.774311:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.774313:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af26880/0xdfc0fb148942412 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b8 expref: 24479 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.774314:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c582f40/0xdfc0fb148802ad1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2702:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bc2 expref: 20800 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.774314:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa3600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.774315:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.774317:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.774318:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.774321:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3431 (ffff88008bd1df00) 00010000:00010000:1.0:1713481296.774322:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.774323:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.774328:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.774328:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa3600/0xdfc0fb148a3adb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.774330:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.774331:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4018050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26884:1959:x1796714882483904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.774332:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.774332:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af26880/0xdfc0fb148942412 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03b8 expref: 24479 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.774336:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820366 00010000:00010000:0.0:1713481296.774339:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.774348:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.774350:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.774352:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa18c0/0xdfc0fb148a3ada8 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49700 expref: 2795 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.774354:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133a7db00/0xdfc0fb148a3ac89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49690 expref: 26883 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774357:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121aa18c0/0xdfc0fb148a3ada8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49700 expref: 2795 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.774363:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7db00/0xdfc0fb148a3ac89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49690 expref: 26883 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774365:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa18c0, rc 0) 00000100:00100000:2.0:1713481296.774377:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820369 00000100:00100000:2.0:1713481296.774380:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20799:1959:x1796714882483840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.774381:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18878:x1796714882484032:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 231us (293us total) trans 0 rc 301/301 00010000:00010000:3.0:1713481296.774383:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133a7db00/0xdfc0fb148a3ac89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49690 expref: 26883 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774384:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.774386:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485841 00010000:00010000:2.0:1713481296.774387:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095c9cfc0/0xdfc0fb1489cfa38 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22257 expref: 20799 pid: 16493 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.774392:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784513216:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.774393:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095c9cfc0/0xdfc0fb1489cfa38 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22257 expref: 20799 pid: 16493 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.774403:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095c9cfc0/0xdfc0fb1489cfa38 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22257 expref: 20799 pid: 16493 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.774404:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774408:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774412:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.774413:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774413:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.774415:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007a284d80/0xdfc0fb148a3ac4a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49682 expref: 16882 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774416:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.774417:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bf00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.774420:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.774420:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774420:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a284d80/0xdfc0fb148a3ac4a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49682 expref: 16882 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774426:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079450480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.774428:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774431:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007a284d80/0xdfc0fb148a3ac4a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49682 expref: 16882 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774432:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774437:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a89880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784513280:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.774439:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.774440:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20798:1959:x1796714882484096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 166us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.774443:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079450480/0xdfc0fb148a3ac66 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa93f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.774444:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820370 00000100:00100000:0.0:1713481296.774449:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820367 00000100:00100000:2.0:1713481296.774450:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086971e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.774450:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20798:1959:x1796714882483968:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.774457:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.774463:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083b70000/0xdfc0fb148802aca lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bb4 expref: 20797 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.774471:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083b70000/0xdfc0fb148802aca lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bb4 expref: 20797 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.774487:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083b70000/0xdfc0fb148802aca lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bb4 expref: 20797 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.774488:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.774501:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.774502:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.774505:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.774512:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.774531:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.774547:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2779:3492:x1796714784510464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7450us (7522us total) trans 4295960719 rc 0/0 00000100:00100000:3.0:1713481296.774550:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20796:1959:x1796714882483968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.774551:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563157 00000100:00100000:3.0:1713481296.774557:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820370 00000100:00100000:0.0:1713481296.774559:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484160 00000100:00100000:0.0:1713481296.774563:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484160 00010000:00010000:1.0:1713481296.774569:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774574:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.774575:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099bbf180/0xdfc0fb148688f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c98 expref: 26884 pid: 16542 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.774578:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774581:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774586:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774589:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079451d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.774590:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774594:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.774600:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820371 00010000:00010000:1.0:1713481296.774601:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774605:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079451d40/0xdfc0fb148a3ac7b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.774605:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26884:1959:x1796714882484160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.774613:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.774619:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099bbf180/0xdfc0fb148688f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa940:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c98 expref: 26884 pid: 16542 timeout: 815 lvb_type: 1 00000004:00080000:0.0:1713481296.774622:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299e300/2, rc 0, transno 993423 00000100:00100000:0.0:1713481296.774627:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784510464:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.774632:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099bbf180/0xdfc0fb148688f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa940:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c98 expref: 26884 pid: 16542 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.774652:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784513344:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.774652:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099bbf180/0xdfc0fb148688f62 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa940:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2c98 expref: 26884 pid: 16542 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.774679:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.774681:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.774684:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774685:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.774690:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.774690:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774709:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484288 00000100:00100000:2.0:1713481296.774712:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484288 00010000:00010000:3.0:1713481296.774715:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.774717:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+178:3490:x1796714784510720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7125us (7175us total) trans 4296040840 rc 0/0 00000100:00100000:1.0:1713481296.774721:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563160 00010000:00010000:2.0:1713481296.774721:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d33c0/0xdfc0fb148688f70 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa941:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ca6 expref: 26884 pid: 15495 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.774732:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820372 00000100:00100000:1.0:1713481296.774733:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784513344 00000100:00100000:1.0:1713481296.774735:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784513344 00000100:00100000:2.0:1713481296.774735:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26884:1959:x1796714882484288:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.774735:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26884:1959:x1796714882484160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 129us (247us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.774739:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.774744:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d0d33c0/0xdfc0fb148688f70 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa941:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ca6 expref: 26884 pid: 15495 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.774744:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820371 00000100:00100000:1.0:1713481296.774745:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563183 00000100:00100000:1.0:1713481296.774748:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2779:3492:x1796714784513344:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.774750:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d0d33c0/0xdfc0fb148688f70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa941:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ca6 expref: 26884 pid: 15495 timeout: 815 lvb_type: 1 00002000:00080000:1.0:1713481296.774756:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43368 count 1 00010000:00010000:2.0:1713481296.774761:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.774762:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.774763:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774764:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774768:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774773:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007347f3c0/0xdfc0fb148688f5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa968:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cfa expref: 26883 pid: 16484 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.774777:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.774777:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.774778:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.774780:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774790:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007347f3c0/0xdfc0fb148688f5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa968:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cfa expref: 26883 pid: 16484 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.774790:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26883:1959:x1796714882484288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (101us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.774791:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774794:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820372 00010000:00010000:1.0:1713481296.774795:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007347f3c0/0xdfc0fb148688f5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa968:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cfa expref: 26883 pid: 16484 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.774798:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.774801:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d286a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784513408:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.774809:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.774815:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.774815:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e29c0 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.774817:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880082305c00/2, rc 0, transno 1073544 00010000:00010000:0.0:1713481296.774821:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774822:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510720:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.774825:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133a7c900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.774825:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.774828:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774830:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.774834:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774834:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774837:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774841:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774841:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713481296.774845:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774845:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079452640 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.774845:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784513472:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.774847:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774850:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.774852:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133a7c900/0xdfc0fb148a3ac82 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774858:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.774859:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.774862:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079452640/0xdfc0fb148a3ac74 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.774873:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784513472 00000100:00100000:2.0:1713481296.774875:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784513472 00000100:00100000:2.0:1713481296.774885:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563184 00000100:00100000:2.0:1713481296.774887:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+178:3492:x1796714784513472:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.774895:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9993 count 1 00010000:00010000:2.0:1713481296.774903:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774910:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c5821c0/0xdfc0fb148802afb lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c24 expref: 20795 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.774915:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.774916:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.774917:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.774926:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c5821c0/0xdfc0fb148802afb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c24 expref: 20795 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.774931:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c5821c0/0xdfc0fb148802afb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c24 expref: 20795 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.774937:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784513536:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.774946:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.774952:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+179:3492:x1796714784510592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7524us (7552us total) trans 4296040841 rc 0/0 00000100:00100000:1.0:1713481296.774956:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563159 00000004:00080000:2.0:1713481296.774962:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880082307800/2, rc 0, transno 1073545 00000100:00100000:2.0:1713481296.774967:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784510592:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.774975:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2780:3490:x1796714784510784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7368us (7411us total) trans 4295960720 rc 0/0 00000100:00100000:0.0:1713481296.774981:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563161 00010000:00010000:1.0:1713481296.774982:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d33c0/0xdfc0fb148688f70 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa941:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ca6 expref: 26882 pid: 15495 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.774984:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784513600:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.774990:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784511104:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.774995:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.775005:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.775010:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784513600 00000004:00080000:2.0:1713481296.775011:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007db7ca80/2, rc 0, transno 993424 00010000:00010000:1.0:1713481296.775013:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.775014:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784513600 00000100:00100000:2.0:1713481296.775014:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784510784:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.775017:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.775021:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.775024:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.775028:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.775030:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563185 00010000:00010000:1.0:1713481296.775031:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800794521c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.775032:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784513664:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.775033:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.775034:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+179:3490:x1796714784513600:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.775036:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.775042:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.775043:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.775044:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9994 count 1 00010000:00010000:1.0:1713481296.775048:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800794521c0/0xdfc0fb148a3ac90 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.775052:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.775061:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd88fc0/0xdfc0fb148802b02 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c32 expref: 20795 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.775061:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784513664 00000100:00100000:2.0:1713481296.775063:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784513664 00010000:00010000:0.0:1713481296.775067:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.775072:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563186 00000100:00100000:2.0:1713481296.775075:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2780:3491:x1796714784513664:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.775082:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43370 count 1 00010000:00010000:2.0:1713481296.775089:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.775096:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c203600/0xdfc0fb148688fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d08 expref: 26881 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.775099:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.775100:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.775101:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.775110:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c203600/0xdfc0fb148688fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d08 expref: 26881 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.775115:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c203600/0xdfc0fb148688fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d08 expref: 26881 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.775137:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078199180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784513728:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.775139:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.775144:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 4/0,1 mode: --/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.775147:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.775171:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2781:3493:x1796714784510976:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7363us (7411us total) trans 4295960721 rc 0/0 00000100:00100000:1.0:1713481296.775175:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563163 00000004:00080000:2.0:1713481296.775176:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800881a7b80/2, rc 0, transno 993425 00000100:00100000:2.0:1713481296.775181:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784510976:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.775197:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007db7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784513792:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713481296.775207:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32166, 64 off2066816 00000100:00100000:2.0:1713481296.775210:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.775228:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784513792 00000100:00100000:1.0:1713481296.775231:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784513792 00000100:00100000:1.0:1713481296.775248:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563187 00000100:00100000:1.0:1713481296.775252:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2781:3492:x1796714784513792:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.775262:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43372 count 1 00010000:00010000:1.0:1713481296.775271:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.775281:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c202f40/0xdfc0fb14868900a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d1d expref: 26881 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.775284:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd88fc0/0xdfc0fb148802b02 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c32 expref: 20795 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.775286:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.775287:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.775290:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.775293:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd88fc0/0xdfc0fb148802b02 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c32 expref: 20795 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.775302:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079709500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784513856:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.775302:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c202f40/0xdfc0fb14868900a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d1d expref: 26881 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.775309:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c202f40/0xdfc0fb14868900a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d1d expref: 26881 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.775318:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.775324:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784513920:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.775337:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1713481296.775358:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3714, 64 off245888 00000100:00100000:0.0:1713481296.775362:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007712b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784511232:192.168.202.24@tcp:105: 00000040:00080000:1.0:1713481296.775368:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32167, 64 off2066880 00000040:00080000:1.0:1713481296.775373:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3715, 64 off245952 00010000:00010000:0.0:1713481296.775376:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713481296.775378:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32168, 64 off2066944 00000040:00080000:1.0:1713481296.775383:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3716, 64 off246016 00000100:00100000:0.0:1713481296.775386:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20795:1957:x1796714882482560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7094us (7142us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.775388:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32169, 64 off2067008 00000040:00080000:1.0:1713481296.775392:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3717, 64 off246080 00000100:00100000:0.0:1713481296.775395:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820352 00000040:00080000:1.0:1713481296.775397:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32170, 64 off2067072 00000040:00080000:1.0:1713481296.775402:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3718, 64 off246144 00000001:00080000:3.0:1713481296.775405:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040818 00000040:00080000:1.0:1713481296.775406:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32171, 64 off2067136 00000040:00080000:1.0:1713481296.775411:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3719, 64 off246208 00000040:00080000:1.0:1713481296.775415:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32172, 64 off2067200 00000040:00080000:1.0:1713481296.775420:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3720, 64 off246272 00000040:00080000:1.0:1713481296.775425:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32173, 64 off2067264 00000040:00080000:1.0:1713481296.775430:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3721, 64 off246336 00000040:00080000:1.0:1713481296.775434:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32174, 64 off2067328 00000040:00080000:1.0:1713481296.775439:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3722, 64 off246400 00000040:00080000:1.0:1713481296.775444:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32175, 64 off2067392 00000040:00080000:1.0:1713481296.775448:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3723, 64 off246464 00000040:00080000:1.0:1713481296.775453:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32176, 64 off2067456 00000040:00080000:1.0:1713481296.775458:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3724, 64 off246528 00000040:00080000:1.0:1713481296.775462:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32177, 64 off2067520 00000040:00080000:1.0:1713481296.775467:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3725, 64 off246592 00000040:00080000:1.0:1713481296.775471:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32178, 64 off2067584 00000040:00080000:1.0:1713481296.775476:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3726, 64 off246656 00000040:00080000:1.0:1713481296.775480:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32179, 64 off2067648 00000100:00100000:0.0:1713481296.775484:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.775485:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3727, 64 off246720 00000040:00080000:1.0:1713481296.775490:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32180, 64 off2067712 00002000:00080000:3.0:1713481296.775493:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 56914 00000040:00080000:1.0:1713481296.775494:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3728, 64 off246784 00000040:00080000:1.0:1713481296.775499:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32181, 64 off2067776 00000040:00080000:1.0:1713481296.775504:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3729, 64 off246848 00000040:00080000:1.0:1713481296.775508:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32182, 64 off2067840 00000100:00100000:2.0:1713481296.775511:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485568 00000040:00080000:1.0:1713481296.775513:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3730, 64 off246912 00000100:00100000:2.0:1713481296.775513:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485568 00000040:00080000:1.0:1713481296.775517:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32183, 64 off2067904 00000040:00080000:1.0:1713481296.775522:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3731, 64 off246976 00000100:00100000:2.0:1713481296.775530:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485842 00000100:00100000:2.0:1713481296.775533:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2032:18915:x1796714882485568:12345-192.168.202.24@tcp:101:dd.0 00000040:00080000:1.0:1713481296.775538:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32184, 64 off2067968 00010000:00010000:2.0:1713481296.775539:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1713481296.775543:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3732, 64 off247040 00010000:00010000:2.0:1713481296.775545:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ade0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x34c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4972a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.775548:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32185, 64 off2068032 00000040:00080000:1.0:1713481296.775553:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3733, 64 off247104 00000040:00080000:1.0:1713481296.775557:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32186, 64 off2068096 00000040:00080000:1.0:1713481296.775562:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3734, 64 off247168 00000040:00080000:1.0:1713481296.775567:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32187, 64 off2068160 00000040:00080000:1.0:1713481296.775571:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3735, 64 off247232 00000040:00080000:1.0:1713481296.775576:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32188, 64 off2068224 00000040:00080000:1.0:1713481296.775580:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3736, 64 off247296 00000040:00080000:1.0:1713481296.775585:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32189, 64 off2068288 00000100:00100000:0.0:1713481296.775588:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784511296:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.775590:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3737, 64 off247360 00000040:00080000:1.0:1713481296.775594:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32190, 64 off2068352 00000040:00080000:1.0:1713481296.775599:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3738, 64 off247424 00000040:00080000:1.0:1713481296.775604:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32191, 64 off2068416 00000040:00080000:1.0:1713481296.775608:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3739, 64 off247488 00000040:00080000:1.0:1713481296.775613:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32192, 64 off2068480 00000040:00080000:1.0:1713481296.775617:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3740, 64 off247552 00000004:00200000:2.0:1713481296.775617:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34c3:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.775632:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.775633:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ade0 lrc: 1/0,0 mode: --/CW res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4972a expref: 2033 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.775638:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3ade0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4972a expref: 2033 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.775645:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2a58c0, rc 0) 00000100:00100000:1.0:1713481296.775647:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486016 00000100:00100000:1.0:1713481296.775649:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486016 00000100:00100000:2.0:1713481296.775657:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2033:18915:x1796714882485568:12345-192.168.202.24@tcp:101:dd.0 Request processed in 122us (173us total) trans 0 rc 301/301 00000100:00100000:2.0:1713481296.775660:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485842 00000100:00100000:1.0:1713481296.775678:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485843 00000100:00100000:1.0:1713481296.775682:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2032:18678:x1796714882486016:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:0.0:1713481296.775688:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784511360:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.775689:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.775695:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa2640/0xdfc0fb148a3ade7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49731 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.775710:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3ad07 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496ba expref: 24478 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.775720:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133a7f600, rc 0) 00000100:00100000:0.0:1713481296.775734:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:10409:x1796714882482432:12345-192.168.202.24@tcp:101:dd.0 Request processed in 7199us (7529us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.775740:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563164 00010000:00010000:1.0:1713481296.775744:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa3180/0xdfc0fb148a3adee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.775750:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa3180/0xdfc0fb148a3adee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.775754:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa3180/0xdfc0fb148a3adee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000004:00200000:1.0:1713481296.775758:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c36:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.775769:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.775780:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484352 00000100:00100000:0.0:1713481296.775783:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484352 00000100:00100000:0.0:1713481296.775795:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563188 00010000:00010000:1.0:1713481296.775797:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa2640/0xdfc0fb148a3ade7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49731 expref: 2035 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.775799:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16883:17009:x1796714882484352:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.775805:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.775807:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa3180/0xdfc0fb148a3adee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49731 expref: 2034 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.775811:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88008ad2f200) 00010000:00010000:0.0:1713481296.775813:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3adfc lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49707 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.775813:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713481296.775814:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121aa3180, rc 0) 00002000:00010000:0.0:1713481296.775825:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.775825:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2034:18678:x1796714882486016:12345-192.168.202.24@tcp:101:rm.0 Request processed in 143us (193us total) trans 4295107597 rc 0/0 00000100:00100000:1.0:1713481296.775829:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485843 00010000:00010000:0.0:1713481296.775833:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.775834:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.775838:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3adfc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49707 expref: 16884 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.775847:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086bc58c0/0xdfc0fb148a3adfc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49707 expref: 16884 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.775853:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086bc58c0, rc 0) 00000040:00080000:1.0:1713481296.775862:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32193, 64 off2068544 00000100:00100000:0.0:1713481296.775864:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16884:17009:x1796714882484352:12345-192.168.202.24@tcp:101:dd.0 Request processed in 64us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.775868:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563188 00000040:00080000:1.0:1713481296.775875:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3741, 64 off247616 00000040:00080000:1.0:1713481296.775885:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32194, 64 off2068608 00000040:00080000:1.0:1713481296.775893:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3742, 64 off247680 00000040:00080000:1.0:1713481296.775902:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32195, 64 off2068672 00000040:00080000:1.0:1713481296.775909:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3743, 64 off247744 00000040:00080000:1.0:1713481296.775917:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32196, 64 off2068736 00000100:00100000:0.0:1713481296.775922:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784511552:192.168.202.24@tcp:105: 00000040:00080000:1.0:1713481296.775925:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3744, 64 off247808 00010000:00010000:0.0:1713481296.775932:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713481296.775934:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32197, 64 off2068800 00000100:00100000:0.0:1713481296.775941:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20794:1959:x1796714882481984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6655us (6710us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.775943:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3745, 64 off247872 00000100:00100000:0.0:1713481296.775946:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820354 00000040:00080000:1.0:1713481296.775951:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32198, 64 off2068864 00000040:00080000:1.0:1713481296.775958:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3746, 64 off247936 00000040:00080000:1.0:1713481296.775965:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32199, 64 off2068928 00000040:00080000:1.0:1713481296.775972:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3747, 64 off248000 00000040:00080000:1.0:1713481296.775979:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32200, 64 off2068992 00000100:00100000:0.0:1713481296.775987:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784511616:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.775987:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3748, 64 off248064 00000040:00080000:1.0:1713481296.775994:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32201, 64 off2069056 00010000:00010000:0.0:1713481296.775999:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776001:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3749, 64 off248128 00000040:00080000:1.0:1713481296.776009:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32202, 64 off2069120 00000040:00080000:1.0:1713481296.776016:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3750, 64 off248192 00000040:00080000:1.0:1713481296.776021:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32203, 64 off2069184 00000040:00080000:1.0:1713481296.776026:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3751, 64 off248256 00000040:00080000:1.0:1713481296.776031:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32204, 64 off2069248 00000040:00080000:1.0:1713481296.776036:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3752, 64 off248320 00000040:00080000:1.0:1713481296.776041:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32205, 64 off2069312 00000100:00100000:2.0:1713481296.776054:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784511872:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.776064:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784511808:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.776070:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.776080:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776094:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3753, 64 off248384 00000040:00080000:1.0:1713481296.776101:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32206, 64 off2069376 00000040:00080000:1.0:1713481296.776105:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3754, 64 off248448 00000040:00080000:1.0:1713481296.776110:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32207, 64 off2069440 00000040:00080000:1.0:1713481296.776115:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3755, 64 off248512 00000040:00080000:1.0:1713481296.776135:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32208, 64 off2069504 00000040:00080000:1.0:1713481296.776141:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3756, 64 off248576 00000040:00080000:1.0:1713481296.776146:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32209, 64 off2069568 00000040:00080000:1.0:1713481296.776151:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3757, 64 off248640 00000100:00100000:0.0:1713481296.776156:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784511936:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.776156:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32210, 64 off2069632 00000040:00080000:1.0:1713481296.776160:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3758, 64 off248704 00000040:00080000:1.0:1713481296.776165:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32211, 64 off2069696 00000040:00080000:1.0:1713481296.776170:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3759, 64 off248768 00010000:00010000:0.0:1713481296.776173:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148a3ad31 lrc: 3/0,0 mode: --/PW res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496d6 expref: 20793 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776175:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32212, 64 off2069760 00000040:00080000:1.0:1713481296.776180:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3760, 64 off248832 00010000:00010000:0.0:1713481296.776182:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302e2880, rc 0) 00000040:00080000:1.0:1713481296.776184:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32213, 64 off2069824 00000040:00080000:1.0:1713481296.776189:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3761, 64 off248896 00000040:00080000:1.0:1713481296.776193:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32214, 64 off2069888 00000100:00100000:0.0:1713481296.776194:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20793:14753:x1796714882482816:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5723us (5780us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.776198:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3762, 64 off248960 00000100:00100000:0.0:1713481296.776202:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563170 00000040:00080000:1.0:1713481296.776202:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32215, 64 off2069952 00000040:00080000:1.0:1713481296.776207:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3763, 64 off249024 00000040:00080000:1.0:1713481296.776211:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32216, 64 off2070016 00000040:00080000:1.0:1713481296.776215:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3764, 64 off249088 00000040:00080000:1.0:1713481296.776220:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32217, 64 off2070080 00000040:00080000:1.0:1713481296.776225:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3765, 64 off249152 00000040:00080000:1.0:1713481296.776229:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32218, 64 off2070144 00000040:00080000:1.0:1713481296.776234:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3766, 64 off249216 00000040:00080000:1.0:1713481296.776238:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32219, 64 off2070208 00000040:00080000:1.0:1713481296.776243:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3767, 64 off249280 00000040:00080000:1.0:1713481296.776248:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32220, 64 off2070272 00000040:00080000:1.0:1713481296.776253:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3768, 64 off249344 00000100:00100000:2.0:1713481296.776255:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784512128:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.776257:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32221, 64 off2070336 00000100:00100000:0.0:1713481296.776261:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:1.0:1713481296.776261:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3769, 64 off249408 00000040:00080000:1.0:1713481296.776266:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32222, 64 off2070400 00000040:00080000:1.0:1713481296.776271:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3770, 64 off249472 00010000:00010000:2.0:1713481296.776271:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776275:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32223, 64 off2070464 00000100:00100000:0.0:1713481296.776277:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484544 00000040:00080000:1.0:1713481296.776279:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3771, 64 off249536 00000100:00100000:0.0:1713481296.776280:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484544 00000040:00080000:1.0:1713481296.776284:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32224, 64 off2070528 00000040:00080000:1.0:1713481296.776289:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3772, 64 off249600 00000040:00080000:1.0:1713481296.776294:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32225, 64 off2070592 00000100:00100000:2.0:1713481296.776296:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784512000:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.776297:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563189 00000040:00080000:1.0:1713481296.776298:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3773, 64 off249664 00000100:00100000:0.0:1713481296.776301:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20793:18792:x1796714882484544:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000040:00080000:1.0:1713481296.776303:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32226, 64 off2070656 00010000:00010000:0.0:1713481296.776307:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1713481296.776307:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3774, 64 off249728 00010000:00010000:2.0:1713481296.776309:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099fe9200/0xdfc0fb148a3ad3f lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496dd expref: 26881 pid: 9203 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776312:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32227, 64 off2070720 00010000:00010000:2.0:1713481296.776315:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099fe9200, rc 0) 00010000:00010000:0.0:1713481296.776316:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3ae03 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc518:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4970e expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776316:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3775, 64 off249792 00000040:00080000:1.0:1713481296.776321:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32228, 64 off2070784 00000100:00100000:2.0:1713481296.776324:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:11552:x1796714882482880:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5727us (5762us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.776326:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3776, 64 off249856 00002000:00010000:0.0:1713481296.776328:0:16509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc518:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.776328:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563172 00000040:00080000:1.0:1713481296.776330:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32229, 64 off2070848 00010000:00010000:0.0:1713481296.776337:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.776338:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.776343:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3ae03 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4970e expref: 20794 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.776352:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086bc5b00/0xdfc0fb148a3ae03 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc518:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4970e expref: 20794 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.776360:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086bc5b00, rc 0) 00000040:00080000:1.0:1713481296.776364:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3777, 64 off249920 00000100:00100000:0.0:1713481296.776373:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20794:18792:x1796714882484544:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 71us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.776379:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563189 00000100:00100000:3.0:1713481296.776382:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784512256:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.776386:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784512384:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.776398:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.776398:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800922e5f80/0xdfc0fb148a3ad69 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496eb expref: 16883 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.776399:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.776406:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922e5f80, rc 0) 00000100:00100000:0.0:1713481296.776411:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007819a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784512512:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.776412:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32230, 64 off2070912 00000100:00100000:3.0:1713481296.776418:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16883:8499:x1796714882483072:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5547us (5649us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.776419:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3778, 64 off249984 00000100:00100000:2.0:1713481296.776421:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784513024:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.776424:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32231, 64 off2070976 00000100:00100000:3.0:1713481296.776424:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563174 00010000:00010000:0.0:1713481296.776425:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776428:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3779, 64 off250048 00000040:00080000:1.0:1713481296.776433:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32232, 64 off2071040 00010000:00010000:2.0:1713481296.776437:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776438:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3780, 64 off250112 00000040:00080000:1.0:1713481296.776443:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32233, 64 off2071104 00000100:00100000:3.0:1713481296.776443:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484608 00000100:00100000:3.0:1713481296.776445:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484608 00000040:00080000:1.0:1713481296.776447:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3781, 64 off250176 00000100:00100000:0.0:1713481296.776448:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784512192:192.168.202.24@tcp:105: 00000040:00080000:1.0:1713481296.776452:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32234, 64 off2071168 00000040:00080000:1.0:1713481296.776457:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3782, 64 off250240 00010000:00010000:0.0:1713481296.776462:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713481296.776462:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32235, 64 off2071232 00000040:00080000:1.0:1713481296.776466:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3783, 64 off250304 00000100:00100000:3.0:1713481296.776466:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563190 00000100:00100000:3.0:1713481296.776470:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20794:15045:x1796714882484608:12345-192.168.202.24@tcp:101:dd.0 00000040:00080000:1.0:1713481296.776471:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32236, 64 off2071296 00000100:00100000:0.0:1713481296.776475:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20794:1960:x1796714882483136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5634us (5674us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.776476:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3784, 64 off250368 00010000:00010000:3.0:1713481296.776476:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.776481:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820358 00010000:00010000:3.0:1713481296.776483:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091629d40/0xdfc0fb148a3ae0a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49715 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.776491:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784513152:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.776491:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:3.0:1713481296.776494:0:16541:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.776496:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484736 00000100:00100000:2.0:1713481296.776498:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484736 00010000:00010000:3.0:1713481296.776501:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.776502:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.776503:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.776505:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091629d40/0xdfc0fb148a3ae0a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49715 expref: 20794 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.776509:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563191 00000100:00100000:2.0:1713481296.776512:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16883:18836:x1796714882484736:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.776512:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091629d40/0xdfc0fb148a3ae0a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49715 expref: 20794 pid: 16541 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776517:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32237, 64 off2071360 00010000:00010000:2.0:1713481296.776517:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.776517:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091629d40, rc 0) 00000040:00080000:1.0:1713481296.776523:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3785, 64 off250432 00010000:00010000:2.0:1713481296.776524:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ae11 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4971c expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776528:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32238, 64 off2071424 00000100:00100000:3.0:1713481296.776528:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20794:15045:x1796714882484608:12345-192.168.202.24@tcp:101:dd.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000040:00080000:1.0:1713481296.776533:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3786, 64 off250496 00000100:00100000:3.0:1713481296.776533:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563190 00010000:00010000:2.0:1713481296.776534:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a05c900/0xdfc0fb14891eac6 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb612 expref: 20794 pid: 16536 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776538:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32239, 64 off2071488 00010000:00010000:2.0:1713481296.776541:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000040:00080000:1.0:1713481296.776542:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3787, 64 off250560 00010000:00010000:2.0:1713481296.776542:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.776544:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ae11 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4971c expref: 16884 pid: 9203 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776547:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32240, 64 off2071552 00000040:00080000:1.0:1713481296.776552:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3788, 64 off250624 00010000:00010000:2.0:1713481296.776554:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a05c900/0xdfc0fb14891eac6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb612 expref: 20793 pid: 16536 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776557:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32241, 64 off2071616 00010000:00010000:2.0:1713481296.776559:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a05c900/0xdfc0fb14891eac6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb612 expref: 20793 pid: 16536 timeout: 815 lvb_type: 0 00000040:00080000:1.0:1713481296.776561:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3789, 64 off250688 00000100:00100000:3.0:1713481296.776561:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784512704:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.776565:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784513984:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.776566:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32242, 64 off2071680 00000040:00080000:1.0:1713481296.776571:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3790, 64 off250752 00000040:00080000:1.0:1713481296.776575:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32243, 64 off2071744 00000100:00100000:2.0:1713481296.776576:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941d0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.776577:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776581:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3791, 64 off250816 00000040:00080000:1.0:1713481296.776585:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32244, 64 off2071808 00000040:00080000:1.0:1713481296.776590:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3792, 64 off250880 00000100:00100000:2.0:1713481296.776591:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784512896:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.776594:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32245, 64 off2071872 00000100:00100000:0.0:1713481296.776595:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.776596:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784512768:192.168.202.24@tcp:104: 00000040:00080000:1.0:1713481296.776599:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3793, 64 off250944 00010000:00010000:2.0:1713481296.776603:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776604:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32246, 64 off2071936 00000040:00080000:1.0:1713481296.776608:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3794, 64 off251008 00000040:00080000:1.0:1713481296.776613:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32247, 64 off2072000 00010000:00010000:3.0:1713481296.776614:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.776620:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3795, 64 off251072 00000100:00100000:3.0:1713481296.776626:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485120 00000040:00080000:1.0:1713481296.776628:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32248, 64 off2072064 00000100:00100000:3.0:1713481296.776628:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485120 00000040:00080000:1.0:1713481296.776635:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x16:0x0].3796, 64 off251136 00000040:00080000:1.0:1713481296.776644:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32249, 64 off2072128 00000100:00100000:3.0:1713481296.776647:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563192 00000100:00100000:3.0:1713481296.776650:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16885:18844:x1796714882485120:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.776654:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.776657:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.776675:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091629680/0xdfc0fb148a3ae18 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49723 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.776682:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:3.0:1713481296.776683:0:16541:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.776686:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485824 00000100:00100000:0.0:1713481296.776690:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485824 00010000:00010000:3.0:1713481296.776690:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.776691:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.776693:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091629680/0xdfc0fb148a3ae18 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49723 expref: 16886 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.776697:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.776700:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091629680/0xdfc0fb148a3ae18 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49723 expref: 16886 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.776704:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485952 00010000:00010000:3.0:1713481296.776705:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091629680, rc 0) 00000100:00100000:1.0:1713481296.776707:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485952 00000100:00100000:2.0:1713481296.776708:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.776710:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98367 00000100:00100000:0.0:1713481296.776715:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:1957:x1796714882485824:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.776716:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16886:18844:x1796714882485120:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.776720:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563192 00010000:00010000:0.0:1713481296.776723:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.776729:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485844 00000100:00100000:3.0:1713481296.776731:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486080 00000100:00100000:1.0:1713481296.776732:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18886:x1796714882485952:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.776733:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079646d00/0xdfc0fb148a3acac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34c3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496f2 expref: 2203 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.776733:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486080 00010000:00010000:1.0:1713481296.776737:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.776744:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801304b0d80/0xdfc0fb148a3ae1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x51e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49738 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.776744:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563193 00000100:00100000:3.0:1713481296.776747:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:10479:x1796714882486080:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.776751:0:15497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34c3:0x0].0x0 (ffff88011d25c800) 00010000:00010000:3.0:1713481296.776751:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.776753:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.776758:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097642640/0xdfc0fb148a3ae26 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4973f expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.776767:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:1957:x1796714882485824:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (110us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.776768:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007995c000/0xdfc0fb148916da6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c657d expref: 24479 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.776772:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.776773:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98367 00010000:00010000:3.0:1713481296.776773:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.776775:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097642640/0xdfc0fb148a3ae26 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4973f expref: 24479 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.776784:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007995c000/0xdfc0fb148916da6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c657d expref: 24479 pid: 16460 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.776785:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484480 00000100:00100000:0.0:1713481296.776787:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484480 00010000:00010000:1.0:1713481296.776787:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3ae2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.776790:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007995c000/0xdfc0fb148916da6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c657d expref: 24479 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.776795:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096bacd80/0xdfc0fb14891d15f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6fa expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.776795:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.776796:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784514048:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.776802:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.776808:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.776816:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820373 00000100:00100000:0.0:1713481296.776820:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1960:x1796714882484480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00200000:1.0:1713481296.776821:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51e9:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.776824:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.776826:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.776829:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096bacd80/0xdfc0fb14891d15f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6fa expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.776837:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096bacd80/0xdfc0fb14891d15f lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6fa expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.776848:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096bacd80/0xdfc0fb14891d15f lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca6fa expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.776848:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801304b0d80/0xdfc0fb148a3ae1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x51e9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49738 expref: 2796 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.776859:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.776864:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801304b2400/0xdfc0fb148a3ae2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51e9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49738 expref: 2795 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.776869:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882484480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 48us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.776870:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51e9:0x0].0x0 (ffff8800965b3600) 00010000:00010000:1.0:1713481296.776872:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00000100:00100000:0.0:1713481296.776874:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820373 00010000:00010000:1.0:1713481296.776874:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801304b2400, rc 0) 00000100:00100000:1.0:1713481296.776893:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18886:x1796714882485952:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 160us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.776898:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485844 00010000:00010000:1.0:1713481296.776922:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.776928:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776932:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776935:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776939:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.776939:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.776942:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776945:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776947:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079bccb40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.776949:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.776951:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.776952:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.776955:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484800 00010000:00010000:1.0:1713481296.776955:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3485:0x0].0x0 (ffff8800848bc400) 00010000:00010000:1.0:1713481296.776957:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1713481296.776958:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484800 00010000:00010000:1.0:1713481296.776958:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.776960:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.776961:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079bccb40/0xdfc0fb148a3ae34 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3485:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.776968:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099bbd680/0xdfc0fb148688f46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cd0 expref: 26881 pid: 16542 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.776968:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.776975:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.776976:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.776978:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776981:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776984:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009430df80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.776985:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.776988:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.776990:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484928 00010000:00010000:1.0:1713481296.776991:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3485:0x0].0x0 (ffff8800848bc400) 00010000:00010000:1.0:1713481296.776992:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1713481296.776993:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484928 00010000:00010000:1.0:1713481296.776993:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.776993:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485056 00000100:00100000:2.0:1713481296.776995:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485056 00010000:00010000:1.0:1713481296.776996:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009430df80/0xdfc0fb148a3acc1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3485:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.777003:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095cbb3c0/0xdfc0fb148a13ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fcb expref: 20794 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777004:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801242d1440/0xdfc0fb148959c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd0 expref: 26882 pid: 16475 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.777020:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485248 00000100:00100000:2.0:1713481296.777021:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485248 00010000:00010000:2.0:1713481296.777027:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083b72d00/0xdfc0fb148802adf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bde expref: 20795 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.777028:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820374 00000100:00100000:0.0:1713481296.777033:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26882:1960:x1796714882484800:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.777034:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820375 00000100:00100000:3.0:1713481296.777038:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26882:1960:x1796714882485056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.777041:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.777043:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820376 00010000:00010000:0.0:1713481296.777046:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099bbd680/0xdfc0fb148688f46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa944:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cd0 expref: 26882 pid: 16542 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.777046:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20795:1960:x1796714882484928:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.777047:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.777051:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.777054:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099bbd680/0xdfc0fb148688f46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa944:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cd0 expref: 26882 pid: 16542 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777060:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095cbb3c0/0xdfc0fb148a13ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc177:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fcb expref: 20795 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.777060:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801242d1440/0xdfc0fb148959c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd0 expref: 26882 pid: 16475 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777066:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095cbb3c0/0xdfc0fb148a13ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc177:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fcb expref: 20795 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.777067:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099bbd680/0xdfc0fb148688f46 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa944:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cd0 expref: 26882 pid: 16542 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.777069:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801242d1440/0xdfc0fb148959c0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd0 expref: 26882 pid: 16475 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.777077:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.777077:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cbb3c0/0xdfc0fb148a13ea1 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc177:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa37fcb expref: 20795 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.777079:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.777081:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777086:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.777087:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.777088:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777089:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148a3ad31 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496d6 expref: 20794 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.777089:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801242d1440/0xdfc0fb148959c0c lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd0 expref: 26881 pid: 16475 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777098:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148a3ad31 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496d6 expref: 20794 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.777101:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.777102:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.777103:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.777107:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099fe9200/0xdfc0fb148a3ad3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496dd expref: 26880 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777108:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801302e2880/0xdfc0fb148a3ad31 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc177:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496d6 expref: 20794 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777114:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784514112:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.777116:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099fe9200/0xdfc0fb148a3ad3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496dd expref: 26880 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777145:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ca72600 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.777157:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820377 00000100:00100000:2.0:1713481296.777160:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20794:1960:x1796714882485248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.777160:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099fe9200/0xdfc0fb148a3ad3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496dd expref: 26880 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777166:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.777168:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083b72d00/0xdfc0fb148802adf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2704:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bde expref: 20794 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.777170:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784514176:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.777174:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083b72d00/0xdfc0fb148802adf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2704:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bde expref: 20794 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777185:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083b72d00/0xdfc0fb148802adf lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2704:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bde expref: 20794 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.777187:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26880:1960:x1796714882484800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 151us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.777192:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.777193:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820374 00010000:00010000:2.0:1713481296.777193:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.777194:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9900 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.777195:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777202:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777217:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.777218:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486208 00000100:00100000:0.0:1713481296.777221:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486208 00000100:00100000:2.0:1713481296.777230:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20793:1960:x1796714882485248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.777234:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820377 00000100:00100000:0.0:1713481296.777243:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125689 00000100:00100000:0.0:1713481296.777247:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2035:18913:x1796714882486208:12345-192.168.202.24@tcp:35:lfs.0 00010000:00010000:2.0:1713481296.777249:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777253:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777257:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777261:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777264:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777268:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099feaac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.777269:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777276:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777282:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777286:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099feaac0/0xdfc0fb148a3ad38 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa944:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.777324:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2036:18913:x1796714882486208:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 76us (362us total) trans 4295107599 rc 0/0 00000100:00100000:0.0:1713481296.777330:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125689 00000100:00100000:0.0:1713481296.777365:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.777382:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486272 00000100:00100000:0.0:1713481296.777385:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486272 00000100:00100000:2.0:1713481296.777390:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2782:3490:x1796714784511744:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6916us (6963us total) trans 4295960722 rc 0/0 00000100:00100000:2.0:1713481296.777394:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563171 00000100:00100000:2.0:1713481296.777408:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563194 00000100:00100000:2.0:1713481296.777411:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26880:1957:x1796714882486272:12345-192.168.202.24@tcp:2:touch.0 00000100:00100000:0.0:1713481296.777450:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.777463:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485376 00000100:00100000:0.0:1713481296.777465:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485376 00010000:00010000:0.0:1713481296.777475:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013543db00/0xdfc0fb148802ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bec expref: 20793 pid: 16452 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.777481:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:1957:x1796714882486272:12345-192.168.202.24@tcp:2:touch.0 Request processed in 68us (116us total) trans 4295960723 rc 0/0 00000100:00100000:2.0:1713481296.777485:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563194 00000100:00100000:0.0:1713481296.777491:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820378 00000100:00100000:0.0:1713481296.777495:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20793:1960:x1796714882485376:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.777502:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.777505:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013543db00/0xdfc0fb148802ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2705:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bec expref: 20793 pid: 16452 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.777510:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007994fb80/2, rc 0, transno 993426 00010000:00010000:0.0:1713481296.777514:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013543db00/0xdfc0fb148802ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2705:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bec expref: 20793 pid: 16452 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.777514:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007994fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784511744:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.777529:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013543db00/0xdfc0fb148802ae6 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2705:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bec expref: 20793 pid: 16452 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.777533:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.777537:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784514240:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.777543:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.777545:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.777547:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777551:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.777559:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777566:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784514240 00000100:00100000:2.0:1713481296.777568:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784514240 00000100:00100000:2.0:1713481296.777589:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563195 00000100:00100000:2.0:1713481296.777591:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007836ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2782:3492:x1796714784514240:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.777592:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.777598:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43374 count 1 00010000:00010000:3.0:1713481296.777601:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777606:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.777609:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777613:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880079411680/0xdfc0fb148689088 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d39 expref: 26880 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.777617:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.777617:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777618:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.777620:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.777625:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777629:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880079411680/0xdfc0fb148689088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d39 expref: 26880 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.777632:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800922e4000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.777634:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880079411680/0xdfc0fb148689088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d39 expref: 26880 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.777635:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.777639:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.777640:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007836f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784514304:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.777642:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777653:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082364d80 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.777654:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.777660:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20792:1960:x1796714882485376:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 164us (210us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.777661:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800922e4000/0xdfc0fb148a3ad7e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.777684:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820378 00000100:00100000:2.0:1713481296.777694:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.777699:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485632 00000100:00100000:0.0:1713481296.777702:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485632 00000100:00100000:2.0:1713481296.777710:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.777711:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9306c0/0xdfc0fb148802af4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bfa expref: 20792 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.777716:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485760 00000100:00100000:2.0:1713481296.777718:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485760 00010000:00010000:2.0:1713481296.777725:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c581440/0xdfc0fb148802aed lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c08 expref: 20793 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.777728:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820379 00000100:00100000:0.0:1713481296.777732:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20793:1960:x1796714882485632:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.777739:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.777739:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820380 00000100:00100000:2.0:1713481296.777741:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007836dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20793:1960:x1796714882485760:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.777743:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9306c0/0xdfc0fb148802af4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2706:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bfa expref: 20793 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777746:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.777748:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c581440/0xdfc0fb148802aed lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2707:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c08 expref: 20793 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.777751:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9306c0/0xdfc0fb148802af4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2706:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bfa expref: 20793 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777754:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c581440/0xdfc0fb148802aed lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2707:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c08 expref: 20793 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.777765:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9306c0/0xdfc0fb148802af4 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2706:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bfa expref: 20793 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777765:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c581440/0xdfc0fb148802aed lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2707:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c08 expref: 20793 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.777776:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.777777:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.777777:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.777778:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.777779:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.777781:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777783:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.777787:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777793:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.777802:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.777804:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007836dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20791:1960:x1796714882485760:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.777807:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820380 00000100:00100000:0.0:1713481296.777814:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20791:1960:x1796714882485632:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.777819:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820379 00000004:00080000:2.0:1713481296.777833:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d285c00/2, rc 0, transno 1073547 00000100:00100000:3.0:1713481296.777834:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+181:3491:x1796714784512576:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5939us (6005us total) trans 4296040843 rc 0/0 00010000:00010000:0.0:1713481296.777836:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777837:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784512576:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.777842:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.777842:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563177 00010000:00010000:0.0:1713481296.777848:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.777853:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777858:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007836ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784514368:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.777859:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.777864:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800922e4b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.777866:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.777871:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.777872:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.777882:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.777888:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800922e4b40/0xdfc0fb148a3ad85 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.777891:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784514368 00000100:00100000:3.0:1713481296.777895:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784514368 00010000:00010000:2.0:1713481296.777901:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777906:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777910:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.777912:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563196 00010000:00010000:2.0:1713481296.777914:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777917:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.777917:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007836df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+181:3490:x1796714784514368:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.777920:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d0d0b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.777922:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777926:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.777929:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9995 count 1 00010000:00010000:2.0:1713481296.777934:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.777941:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d0b40/0xdfc0fb148a3ad8c lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.777941:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.777953:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c580d80/0xdfc0fb148802b09 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c40 expref: 20789 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.777959:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.777961:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.777964:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.777981:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c580d80/0xdfc0fb148802b09 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c40 expref: 20789 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.777991:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c580d80/0xdfc0fb148802b09 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c40 expref: 20789 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.778001:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784514432:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.778094:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+183:3492:x1796714784512640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6099us (6183us total) trans 4296040844 rc 0/0 00000100:00100000:3.0:1713481296.778096:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9600 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.778099:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563178 00000100:00100000:2.0:1713481296.778108:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+182:3492:x1796714784512832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5875us (6019us total) trans 4296040845 rc 0/0 00000100:00100000:2.0:1713481296.778112:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563179 00000004:00080000:2.0:1713481296.778150:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800783faa00/2, rc 0, transno 1073549 00000100:00100000:2.0:1713481296.778154:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800783faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512832:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713481296.778160:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800783fa680/2, rc 0, transno 1073548 00000100:00100000:2.0:1713481296.778161:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800783fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512640:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.778185:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007836f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784514496:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.778198:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.778215:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007836ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784514560:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.778223:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.778235:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784514496 00000100:00100000:0.0:1713481296.778238:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784514496 00000100:00100000:3.0:1713481296.778244:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784514560 00000100:00100000:3.0:1713481296.778248:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784514560 00000100:00100000:0.0:1713481296.778250:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563197 00000100:00100000:0.0:1713481296.778253:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+183:3491:x1796714784514496:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.778261:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9996 count 1 00000100:00100000:2.0:1713481296.778265:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.778269:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778276:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148802b10 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c4e expref: 20789 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.778276:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486336 00000100:00100000:3.0:1713481296.778279:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486336 00010000:00010000:0.0:1713481296.778280:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.778281:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.778281:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563198 00010000:00010000:0.0:1713481296.778282:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.778284:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+183:3492:x1796714784514560:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.778293:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148802b10 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c4e expref: 20789 pid: 9202 timeout: 0 lvb_type: 1 00002000:00080000:2.0:1713481296.778293:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9997 count 1 00000100:00100000:3.0:1713481296.778293:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563199 00000100:00100000:3.0:1713481296.778296:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:17924:x1796714882486336:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.778299:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148802b10 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c4e expref: 20789 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.778301:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.778302:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.778305:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784514624:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.778308:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd89200/0xdfc0fb148802b17 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c5c expref: 20789 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.778309:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148a3ae57 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49746 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.778314:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.778315:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.778317:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc49cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.778317:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.778321:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b226880/0xdfc0fb148a1625e lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3982f expref: 24480 pid: 16469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.778325:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.778326:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd89200/0xdfc0fb148802b17 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c5c expref: 20789 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.778326:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.778328:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148a3ae57 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49746 expref: 24480 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.778331:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd89200/0xdfc0fb148802b17 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c5c expref: 20789 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.778337:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120112a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784514688:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.778339:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b226880/0xdfc0fb148a1625e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3982f expref: 24480 pid: 16469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.778345:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b226880/0xdfc0fb148a1625e lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3982f expref: 24480 pid: 16469 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.778347:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009434e000 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.778351:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013499ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784514752:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.778365:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.778370:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.778414:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.778434:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484416 00000100:00100000:0.0:1713481296.778437:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484416 00010000:00010000:0.0:1713481296.778449:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e640/0xdfc0fb14893ab28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db411 expref: 26881 pid: 16457 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.778467:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820381 00000100:00100000:0.0:1713481296.778472:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120111c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:1960:x1796714882484416:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.778479:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.778482:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e640/0xdfc0fb14893ab28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db411 expref: 26881 pid: 16457 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.778490:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e640/0xdfc0fb14893ab28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db411 expref: 26881 pid: 16457 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.778510:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ff9e640/0xdfc0fb14893ab28 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db411 expref: 26881 pid: 16457 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.778528:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.778530:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.778533:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3ad07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496ba expref: 24480 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778541:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3ad07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496ba expref: 24480 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778559:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133a7f600/0xdfc0fb148a3ad07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496ba expref: 24480 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.778568:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784514816:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.778585:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.778614:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.778621:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484672 00000100:00100000:2.0:1713481296.778623:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484672 00010000:00010000:2.0:1713481296.778629:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0240/0xdfc0fb148688f38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cb4 expref: 26881 pid: 15495 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.778645:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820382 00000100:00100000:2.0:1713481296.778648:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:1960:x1796714882484672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.778649:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.778652:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.778654:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484864 00010000:00010000:2.0:1713481296.778655:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0240/0xdfc0fb148688f38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa942:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cb4 expref: 26881 pid: 15495 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.778658:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484864 00010000:00010000:2.0:1713481296.778676:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0240/0xdfc0fb148688f38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa942:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cb4 expref: 26882 pid: 15495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.778682:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148688f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cc2 expref: 26882 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.778689:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0240/0xdfc0fb148688f38 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa942:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cb4 expref: 26882 pid: 15495 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.778696:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.778697:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.778699:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.778703:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.778704:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820383 00000100:00100000:3.0:1713481296.778708:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007819a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:1960:x1796714882484864:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.778714:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.778716:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148688f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa943:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cc2 expref: 26881 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.778720:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.778722:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148688f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa943:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cc2 expref: 26881 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.778723:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778730:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.778730:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26881:1960:x1796714882484672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.778734:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820382 00010000:00010000:3.0:1713481296.778735:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148688f3f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa943:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cc2 expref: 26881 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.778737:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778744:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.778747:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.778748:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.778751:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778755:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.778756:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778760:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801302e3840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.778763:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.778770:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.778770:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.778781:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007819a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26879:1960:x1796714882484864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.778782:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.778785:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820383 00010000:00010000:0.0:1713481296.778788:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302e3840/0xdfc0fb148a3ad23 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa942:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778794:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778799:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778802:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778805:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778808:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079452ac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.778810:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778813:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778819:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x0 (ffff88008304be00) 00010000:00010000:1.0:1713481296.778820:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.778822:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778824:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079452ac0/0xdfc0fb148a3acb3 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000004:00010000:1.0:1713481296.778838:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a3db100 reply state ffff88008fc29000 transno 4295107598 ns: mdt-lustre-MDT0001_UUID lock: ffff88011d0f6400/0xdfc0fb148a3acba lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778842:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d0f6400/0xdfc0fb148a3acba lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x1d3:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.778846:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x3331 (ffff88009bd02e00) 00010000:00010000:1.0:1713481296.778847:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.778848:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713481296.778864:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778868:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778873:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778877:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778881:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778884:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa0b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.778885:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778889:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778897:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.778901:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121aa0b40/0xdfc0fb148a3ad70 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.778904:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2783:3492:x1796714784511488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9463us (9646us total) trans 4295960724 rc 0/0 00000004:00080000:2.0:1713481296.778908:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800881a7800/2, rc 0, transno 993428 00000100:00100000:0.0:1713481296.778910:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563168 00000100:00100000:2.0:1713481296.778912:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784511488:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.778931:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.778935:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784514880:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.778947:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.779025:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+184:3492:x1796714784512320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7606us (7631us total) trans 4296040846 rc 0/0 00000004:00080000:2.0:1713481296.779026:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d284380/2, rc 0, transno 1073550 00000100:00100000:2.0:1713481296.779030:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512320:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.779031:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563175 00000100:00100000:2.0:1713481296.779047:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784514944:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.779048:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784514880 00000100:00100000:1.0:1713481296.779051:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784514880 00000100:00100000:2.0:1713481296.779060:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.779065:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784514944 00000100:00100000:1.0:1713481296.779067:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784514944 00000100:00100000:1.0:1713481296.779075:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563200 00000100:00100000:1.0:1713481296.779078:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2783:3492:x1796714784514880:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.779084:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563201 00000100:00100000:2.0:1713481296.779086:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+184:3490:x1796714784514944:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.779087:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43376 count 1 00010000:00010000:1.0:1713481296.779094:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.779095:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9998 count 1 00010000:00010000:1.0:1713481296.779102:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800980cd8c0/0xdfc0fb14868908f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d47 expref: 26878 pid: 16486 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.779103:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779106:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.779107:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.779109:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.779110:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013543df80/0xdfc0fb148802b1e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c6a expref: 20789 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.779113:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.779114:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.779116:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779136:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800980cd8c0/0xdfc0fb14868908f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d47 expref: 26878 pid: 16486 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.779142:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800980cd8c0/0xdfc0fb14868908f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d47 expref: 26878 pid: 16486 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.779142:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013543df80/0xdfc0fb148802b1e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c6a expref: 20789 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.779147:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013543df80/0xdfc0fb148802b1e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c6a expref: 20789 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.779149:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784515008:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.779153:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784515072:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.779161:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800838e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.779164:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800916e2300 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.779174:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779178:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779185:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779189:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779193:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779196:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300e1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.779198:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779201:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779211:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779214:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3ad2a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa943:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.779288:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.779312:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882484992 00000100:00100000:3.0:1713481296.779315:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882484992 00000100:00100000:0.0:1713481296.779317:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.779317:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2784:3490:x1796714784511680:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8920us (9205us total) trans 4295960725 rc 0/0 00000100:00100000:1.0:1713481296.779322:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563169 00000004:00080000:2.0:1713481296.779324:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800881a4a80/2, rc 0, transno 993429 00000100:00100000:2.0:1713481296.779329:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784511680:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.779329:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f932880/0xdfc0fb148802ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bd0 expref: 20790 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.779335:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.779341:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486720 00000100:00100000:1.0:1713481296.779344:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486720 00000100:00100000:2.0:1713481296.779350:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784515136:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.779350:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485184 00000100:00100000:0.0:1713481296.779351:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485312 00000100:00100000:3.0:1713481296.779352:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485184 00000100:00100000:0.0:1713481296.779354:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485312 00000100:00100000:1.0:1713481296.779356:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485845 00000100:00100000:1.0:1713481296.779359:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2375:18963:x1796714882486720:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.779362:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c330900/0xdfc0fb1488e7ea7 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5509 expref: 16886 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.779363:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.779366:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801241eef40/0xdfc0fb148688f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cde expref: 26879 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.779369:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.779371:0:15576:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1713481296.779377:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820384 00010000:00010000:1.0:1713481296.779380:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350f6400/0xdfc0fb148a3ab40 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49635 expref: 2375 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.779383:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20790:1960:x1796714882484992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.779387:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820385 00010000:00010000:1.0:1713481296.779389:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff880092ca5600) 00010000:00010000:3.0:1713481296.779390:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.779391:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16886:1960:x1796714882485184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.779392:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820386 00010000:00010000:3.0:1713481296.779394:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f932880/0xdfc0fb148802ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2703:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bd0 expref: 20790 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.779396:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26879:1960:x1796714882485312:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.779396:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.779400:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c330900/0xdfc0fb1488e7ea7 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5509 expref: 16886 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.779401:0:15576:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.779402:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f932880/0xdfc0fb148802ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2703:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bd0 expref: 20790 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.779403:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.779406:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa63a80/0xdfc0fb148a3ae6c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4975b expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.779406:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c330900/0xdfc0fb1488e7ea7 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5509 expref: 16886 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.779408:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801241eef40/0xdfc0fb148688f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa945:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cde expref: 26879 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.779416:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801241eef40/0xdfc0fb148688f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa945:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cde expref: 26879 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.779419:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c330900/0xdfc0fb1488e7ea7 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5509 expref: 16886 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.779419:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f932880/0xdfc0fb148802ad8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2703:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962bd0 expref: 20790 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.779426:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.779427:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.779429:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800922e5f80/0xdfc0fb148a3ad69 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496eb expref: 16885 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.779431:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.779432:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801241eef40/0xdfc0fb148688f4d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa945:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cde expref: 26879 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.779433:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.779434:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922e5f80/0xdfc0fb148a3ad69 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496eb expref: 16885 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.779436:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779442:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.779443:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.779443:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.779444:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800922e5f80/0xdfc0fb148a3ad69 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496eb expref: 16885 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779446:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.779449:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a238000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784515200:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.779453:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779458:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.779458:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f8bf600 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.779463:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.779463:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.779467:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.779467:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.779469:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.779473:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779474:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15fa80/0xdfc0fb148a3ae7a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c7b:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.779477:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15fa80/0xdfc0fb148a3ae7a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c7b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.779477:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.779479:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20789:1960:x1796714882484992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.779481:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15fa80/0xdfc0fb148a3ae7a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c7b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.779481:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.779482:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26878:1960:x1796714882485312:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (146us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.779484:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.779486:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820384 00010000:00010000:2.0:1713481296.779488:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094003180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.779489:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.779491:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820386 00010000:00010000:2.0:1713481296.779493:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779507:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.779512:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779514:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.779515:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094003180/0xdfc0fb148a3ad54 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779520:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779525:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779531:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779536:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800991dc000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.779538:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779544:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779557:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779563:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3ad77 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa945:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.779607:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784515136 00000100:00100000:3.0:1713481296.779611:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784515136 00000004:00080000:1.0:1713481296.779627:0:15576:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa107:0x0], index 0: 0 00000100:00100000:3.0:1713481296.779628:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563202 00000100:00100000:3.0:1713481296.779633:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2784:3491:x1796714784515136:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.779637:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+185:3492:x1796714784512064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8826us (8891us total) trans 4296040847 rc 0/0 00000100:00100000:2.0:1713481296.779642:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563173 00002000:00080000:3.0:1713481296.779644:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43378 count 1 00010000:00010000:3.0:1713481296.779655:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.779680:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a1f480/2, rc 0, transno 1073551 00010000:00010000:3.0:1713481296.779682:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135867180/0xdfc0fb148689096 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d55 expref: 26877 pid: 16453 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.779684:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784512064:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.779689:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.779690:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.779693:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.779703:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784515264:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.779705:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15cd80/0xdfc0fb148a3ae88 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.779710:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135867180/0xdfc0fb148689096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d55 expref: 26877 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.779711:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15cd80/0xdfc0fb148a3ae88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.779716:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.779718:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15cd80/0xdfc0fb148a3ae88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.779719:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135867180/0xdfc0fb148689096 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d55 expref: 26877 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.779729:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078337480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784515328:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.779730:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784515264 00000100:00100000:2.0:1713481296.779732:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784515264 00010000:00010000:1.0:1713481296.779737:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.779742:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.779742:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563203 00000100:00100000:3.0:1713481296.779744:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.779745:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+185:3492:x1796714784515264:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.779748:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00002000:00080000:2.0:1713481296.779752:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:9999 count 1 00010000:00010000:1.0:1713481296.779753:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.779757:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009aa61440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.779759:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.779759:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779764:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.779766:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c581680/0xdfc0fb148802b25 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c78 expref: 20788 pid: 16497 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.779769:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2785:3490:x1796714784512448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8225us (8250us total) trans 4295960726 rc 0/0 00010000:00010000:2.0:1713481296.779770:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.779770:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.779771:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88008bd1d300) 00010000:00010000:2.0:1713481296.779772:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779773:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.779775:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.779776:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563176 00010000:00010000:1.0:1713481296.779780:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa61440/0xdfc0fb148a3ae73 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.779782:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c581680/0xdfc0fb148802b25 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c78 expref: 20788 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.779791:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c581680/0xdfc0fb148802b25 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c78 expref: 20788 pid: 16497 timeout: 815 lvb_type: 1 00000004:00010000:1.0:1713481296.779796:0:15576:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880136a2bc50 reply state ffff880072b10000 transno 4295107600 ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15fa80/0xdfc0fb148a3ae7a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c7b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.779796:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078da8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784515392:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.779801:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15fa80/0xdfc0fb148a3ae7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c7b:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.779805:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x3931 (ffff88008bd1db00) 00010000:00010000:1.0:1713481296.779806:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.779806:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.779807:0:15576:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.779815:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.779822:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a1fb80/2, rc 0, transno 993430 00010000:00010000:1.0:1713481296.779825:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa63a80/0xdfc0fb148a3ae6c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2c7b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4975b expref: 2377 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.779826:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784512448:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.779839:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.779839:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485440 00000100:00100000:2.0:1713481296.779841:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.779843:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485440 00010000:00010000:1.0:1713481296.779846:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15cd80/0xdfc0fb148a3ae88 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4975b expref: 2376 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.779846:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784515456:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.779852:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d5:0x0].0x0 (ffff88008bd1d600) 00000100:00100000:0.0:1713481296.779853:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.779853:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713481296.779855:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b15cd80, rc 0) 00010000:00010000:3.0:1713481296.779856:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0480/0xdfc0fb148688f54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cec expref: 26878 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.779868:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.779874:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2377:18963:x1796714882486720:12345-192.168.202.24@tcp:101:touch.0 Request processed in 513us (1507us total) trans 4295107600 rc 0/0 00000100:00100000:0.0:1713481296.779877:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486400 00000100:00100000:3.0:1713481296.779879:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882485696 00000100:00100000:0.0:1713481296.779880:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486400 00000100:00100000:1.0:1713481296.779880:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485845 00000100:00100000:3.0:1713481296.779881:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882485696 00000100:00100000:2.0:1713481296.779893:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.779894:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784515456 00010000:00010000:3.0:1713481296.779894:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8faf40/0xdfc0fb148803210 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c16 expref: 20789 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.779897:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784515456 00000100:00100000:1.0:1713481296.779898:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486464 00000100:00100000:1.0:1713481296.779901:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486464 00000100:00100000:2.0:1713481296.779905:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.779912:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820387 00000100:00100000:0.0:1713481296.779914:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563204 00000100:00100000:3.0:1713481296.779917:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26878:1960:x1796714882485440:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.779919:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16886:17935:x1796714882486400:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.779924:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.779926:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.779926:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485846 00010000:00010000:3.0:1713481296.779929:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0480/0xdfc0fb148688f54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa946:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cec expref: 26878 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.779930:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2037:18917:x1796714882486464:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.779937:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc5f80/0xdfc0fb148a3ae9d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4974d expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.779937:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.779938:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0480/0xdfc0fb148688f54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa946:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cec expref: 26878 pid: 15511 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.779940:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078199180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784513728:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.779945:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15eac0/0xdfc0fb148a3aea4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49754 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.779947:0:16509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.779951:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779956:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.779956:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d0480/0xdfc0fb148688f54 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa946:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cec expref: 26878 pid: 15511 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.779958:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.779962:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc5f80/0xdfc0fb148a3ae9d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4974d expref: 16887 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.779969:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.779970:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.779972:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086bc5f80/0xdfc0fb148a3ae9d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4974d expref: 16887 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.779973:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.779979:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086bc5f80, rc 0) 00010000:00010000:3.0:1713481296.779980:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.779981:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a89880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784513280:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.779991:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.779993:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16887:17935:x1796714882486400:12345-192.168.202.24@tcp:101:dd.0 Request processed in 74us (139us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.779995:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.779998:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563204 00010000:00010000:3.0:1713481296.779999:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.780000:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.780000:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20789:1959:x1796714882483840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5620us (5790us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.780004:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.780004:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820369 00000100:00100000:0.0:1713481296.780011:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563205 00010000:00010000:1.0:1713481296.780011:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.780015:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2785:3492:x1796714784515456:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.780015:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:3.0:1713481296.780016:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26877:1960:x1796714882485440:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.780017:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820388 00010000:00010000:1.0:1713481296.780018:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.780019:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20788:1960:x1796714882485696:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.780023:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820387 00002000:00080000:0.0:1713481296.780024:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43380 count 1 00010000:00010000:2.0:1713481296.780024:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.780028:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8faf40/0xdfc0fb148803210 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2708:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c16 expref: 20788 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.780032:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780033:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8faf40/0xdfc0fb148803210 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2708:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c16 expref: 20788 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.780034:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18dd40/0xdfc0fb148a3aec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.780037:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18dd40/0xdfc0fb148a3aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.780040:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18dd40/0xdfc0fb148a3aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.780041:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f31b00/0xdfc0fb14868909d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d63 expref: 26876 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.780043:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8faf40/0xdfc0fb148803210 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2708:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c16 expref: 20788 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.780046:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.780047:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00010000:1.0:1713481296.780047:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18dd40/0xdfc0fb148a3aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.780050:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780050:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.780051:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.780052:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.780052:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780055:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.780057:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780059:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.780062:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092f31b00/0xdfc0fb14868909d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d63 expref: 26876 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.780062:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.780064:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b15f840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.780066:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.780066:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.780067:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784513216:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.780069:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092f31b00/0xdfc0fb14868909d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d63 expref: 26876 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.780069:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.780072:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.780073:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.780074:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20787:1960:x1796714882485696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (234us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.780075:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.780077:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15f840/0xdfc0fb148a3aeab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.780078:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784515520:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.780078:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820388 00010000:00010000:1.0:1713481296.780086:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.780089:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.780091:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091dc6000 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.780092:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.780092:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.780093:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780094:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e18df80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.780096:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.780097:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780101:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.780104:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88008bd1d200) 00010000:00010000:2.0:1713481296.780104:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780105:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.780106:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1959:x1796714882484224:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5819us (5905us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.780107:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486592 00010000:00010000:1.0:1713481296.780107:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.780108:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780109:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18df80/0xdfc0fb148a3aeb2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.780110:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486592 00010000:00010000:2.0:1713481296.780112:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.780112:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820368 00010000:00010000:2.0:1713481296.780115:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009654dd40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.780117:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780136:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780144:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780148:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15eac0/0xdfc0fb148a3aea4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49754 expref: 2039 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780148:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009654dd40/0xdfc0fb148a3ad93 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa946:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780160:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18dd40/0xdfc0fb148a3aec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49754 expref: 2038 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.780163:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88008bd1de00) 00010000:00010000:1.0:1713481296.780164:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.780165:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e18dd40, rc 0) 00000100:00100000:1.0:1713481296.780178:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:18917:x1796714882486464:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 248us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.780182:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485846 00000100:00100000:0.0:1713481296.780198:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125690 00000100:00100000:0.0:1713481296.780201:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18953:x1796714882486592:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1713481296.780204:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2037:18578:x1796714882481408:12345-192.168.202.24@tcp:36:rm.0 Request processed in 12307us (12384us total) trans 4295107598 rc 0/0 00000100:00100000:1.0:1713481296.780208:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485835 00000100:00100000:2.0:1713481296.780233:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007db7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2786:3490:x1796714784512960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7845us (7881us total) trans 4295960727 rc 0/0 00000100:00100000:2.0:1713481296.780237:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563180 00000004:00080000:2.0:1713481296.780260:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007db7ea00/2, rc 0, transno 993431 00000100:00100000:2.0:1713481296.780264:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784512960:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.780274:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18953:x1796714882486592:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 71us (367us total) trans 4295105918 rc 0/0 00000100:00100000:0.0:1713481296.780281:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125690 00000100:00100000:2.0:1713481296.780281:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713481296.780285:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784515584:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.780296:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.780303:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784515584 00000100:00100000:0.0:1713481296.780306:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784515584 00010000:00010000:2.0:1713481296.780314:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780318:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.780319:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563206 00000100:00100000:0.0:1713481296.780322:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2786:3491:x1796714784515584:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.780322:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780326:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780330:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.780333:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43382 count 1 00010000:00010000:2.0:1713481296.780333:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa0240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.780334:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780338:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780344:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780348:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780352:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121aa0240/0xdfc0fb148a3ada1 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780355:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800980cc6c0/0xdfc0fb1486890a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d71 expref: 26876 pid: 16486 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.780361:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.780362:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.780365:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780380:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800980cc6c0/0xdfc0fb1486890a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d71 expref: 26876 pid: 16486 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.780388:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800980cc6c0/0xdfc0fb1486890a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d71 expref: 26876 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.780396:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007994ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784515648:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.780408:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134e21540 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.780432:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784513536:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.780445:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.780483:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.780501:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800783f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+186:3491:x1796714784513088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7142us (7186us total) trans 4296040848 rc 0/0 00000004:00080000:2.0:1713481296.780502:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800783f8e00/2, rc 0, transno 1073552 00000100:00100000:2.0:1713481296.780506:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800783f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784513088:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.780508:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563182 00000100:00100000:0.0:1713481296.780518:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079709500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784513856:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.780523:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.780527:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784515712:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.780531:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.780540:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.780554:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.780561:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784515712 00000100:00100000:3.0:1713481296.780565:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784515712 00000100:00100000:0.0:1713481296.780569:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486784 00000100:00100000:0.0:1713481296.780572:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486784 00010000:00010000:0.0:1713481296.780583:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c203600/0xdfc0fb148688fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d08 expref: 26877 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.780584:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563207 00000100:00100000:3.0:1713481296.780589:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+186:3490:x1796714784515712:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.780597:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.780601:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487040 00002000:00080000:3.0:1713481296.780601:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10000 count 1 00000100:00100000:0.0:1713481296.780604:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487040 00010000:00010000:0.0:1713481296.780613:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007347f3c0/0xdfc0fb148688f5b lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa968:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cfa expref: 26878 pid: 16484 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.780613:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.780616:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.780624:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092302640/0xdfc0fb148802b2c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c86 expref: 20786 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.780629:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.780631:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.780633:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.780636:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820389 00000100:00100000:2.0:1713481296.780640:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820390 00000100:00100000:0.0:1713481296.780642:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26878:1959:x1796714882486784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.780644:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26878:1959:x1796714882487040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.780648:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.780648:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092302640/0xdfc0fb148802b2c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c86 expref: 20786 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.780649:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.780652:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007347f3c0/0xdfc0fb148688f5b lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa968:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cfa expref: 26878 pid: 16484 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.780653:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c203600/0xdfc0fb148688fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d08 expref: 26878 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.780658:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007347f3c0/0xdfc0fb148688f5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa968:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cfa expref: 26878 pid: 16484 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.780658:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092302640/0xdfc0fb148802b2c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c86 expref: 20786 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.780661:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c203600/0xdfc0fb148688fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d08 expref: 26878 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.780682:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.780682:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078336680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784515776:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.780684:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.780686:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780690:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c203600/0xdfc0fb148688fd2 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d08 expref: 26878 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.780690:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780698:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.780700:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042c00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.780705:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.780706:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.780708:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.780708:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26877:1959:x1796714882487040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.780711:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820390 00010000:00010000:0.0:1713481296.780715:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780728:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.780729:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780733:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780738:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.780740:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:1959:x1796714882486784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (185us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.780741:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780745:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.780746:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820389 00010000:00010000:2.0:1713481296.780748:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2a6f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.780749:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780754:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780760:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780764:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a6f40/0xdfc0fb148a3add2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.780769:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487104 00000100:00100000:0.0:1713481296.780773:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487104 00000100:00100000:0.0:1713481296.780787:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563208 00000100:00100000:0.0:1713481296.780791:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:18817:x1796714882487104:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.780798:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.780807:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b06df80/0xdfc0fb148a3aed5 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49762 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780820:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007deb46c0/0xdfc0fb1489cfafc lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22273 expref: 24479 pid: 16483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780825:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.780827:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.780830:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b06df80/0xdfc0fb148a3aed5 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49762 expref: 26877 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780845:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007deb46c0/0xdfc0fb1489cfafc lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22273 expref: 24479 pid: 16483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.780854:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007deb46c0/0xdfc0fb1489cfafc lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22273 expref: 24479 pid: 16483 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.780859:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2787:3491:x1796714784513664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5783us (5816us total) trans 4295960728 rc 0/0 00000100:00100000:0.0:1713481296.780862:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784515840:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.780864:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563186 00000100:00100000:0.0:1713481296.780876:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21f00 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.780885:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078198380/2, rc 0, transno 993432 00000100:00100000:2.0:1713481296.780889:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784513664:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.780909:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784515904:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.780921:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.780946:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784515904 00000100:00100000:2.0:1713481296.780949:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784515904 00000100:00100000:2.0:1713481296.780958:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563209 00000100:00100000:0.0:1713481296.780960:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.780960:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2787:3492:x1796714784515904:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.780968:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43383 count 1 00000100:00100000:0.0:1713481296.780975:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486912 00010000:00010000:2.0:1713481296.780975:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.780978:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486912 00010000:00010000:2.0:1713481296.780982:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009059ad00/0xdfc0fb1486890ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d7f expref: 26877 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.780986:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.780987:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.780989:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c5821c0/0xdfc0fb148802afb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c24 expref: 20787 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.780989:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.780998:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009059ad00/0xdfc0fb1486890ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d7f expref: 26877 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.781003:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009059ad00/0xdfc0fb1486890ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d7f expref: 26877 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.781006:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820391 00000100:00100000:2.0:1713481296.781008:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784515968:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.781010:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20787:1959:x1796714882486912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.781017:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.781017:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086971e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.781020:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c5821c0/0xdfc0fb148802afb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2709:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c24 expref: 20787 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.781029:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c5821c0/0xdfc0fb148802afb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2709:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c24 expref: 20787 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.781042:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.781045:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c5821c0/0xdfc0fb148802afb lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2709:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c24 expref: 20787 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.781051:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487296 00000100:00100000:2.0:1713481296.781053:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487296 00010000:00010000:0.0:1713481296.781058:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.781060:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.781063:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781063:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563210 00000100:00100000:2.0:1713481296.781065:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20787:18792:x1796714882487296:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.781069:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781070:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.781076:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013300d8c0/0xdfc0fb148a3aee3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc519:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49769 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.781084:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc519:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.781088:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.781090:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781091:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781094:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013300d8c0/0xdfc0fb148a3aee3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49769 expref: 20788 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781100:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013300d8c0/0xdfc0fb148a3aee3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc519:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49769 expref: 20788 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.781102:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20788:1959:x1796714882486912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 90us (141us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.781104:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013300d8c0, rc 0) 00000100:00100000:0.0:1713481296.781108:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820391 00000100:00100000:2.0:1713481296.781113:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20788:18792:x1796714882487296:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 47us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.781117:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563210 00010000:00010000:2.0:1713481296.781146:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781151:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781155:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.781157:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.781159:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781162:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781165:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800942a8240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.781167:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781171:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.781172:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.781179:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781183:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8240/0xdfc0fb148a3adc4 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.781198:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487424 00000100:00100000:3.0:1713481296.781202:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487424 00000100:00100000:0.0:1713481296.781208:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.781219:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.781224:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487488 00000100:00100000:3.0:1713481296.781226:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487488 00000100:00100000:0.0:1713481296.781231:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.781240:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487168 00000100:00100000:3.0:1713481296.781241:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485847 00000100:00100000:0.0:1713481296.781242:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487168 00000100:00100000:3.0:1713481296.781246:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007db7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2377:18887:x1796714882487424:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.781252:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd88fc0/0xdfc0fb148802b02 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c32 expref: 20787 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.781255:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.781264:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3aeea lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49777 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.781267:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820392 00000100:00100000:0.0:1713481296.781271:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20787:1960:x1796714882487168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.781277:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+187:3492:x1796714784513472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6387us (6417us total) trans 4296040849 rc 0/0 00010000:00010000:0.0:1713481296.781279:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.781281:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563184 00010000:00010000:0.0:1713481296.781283:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd88fc0/0xdfc0fb148802b02 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c32 expref: 20787 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.781291:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd88fc0/0xdfc0fb148802b02 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c32 expref: 20787 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.781293:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487360 00000100:00100000:2.0:1713481296.781295:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487360 00000100:00100000:2.0:1713481296.781303:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487552 00000100:00100000:2.0:1713481296.781304:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487552 00010000:00010000:0.0:1713481296.781309:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd88fc0/0xdfc0fb148802b02 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x270a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c32 expref: 20787 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.781314:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563211 00000100:00100000:2.0:1713481296.781317:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007db7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16887:11388:x1796714882487360:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.781321:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.781322:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.781324:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.781326:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781328:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013300eac0/0xdfc0fb148a3aef8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49770 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781329:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.781332:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781337:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3600/0xdfc0fb148942179 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03bf expref: 20786 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.781337:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781341:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781342:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781344:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013300eac0/0xdfc0fb148a3aef8 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49770 expref: 16888 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781344:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.781345:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.781354:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3600/0xdfc0fb148942179 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03bf expref: 20786 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.781355:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.781356:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20786:1960:x1796714882487168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 83us (124us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.781360:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3600/0xdfc0fb148942179 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03bf expref: 20786 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.781360:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.781361:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820392 00000100:00100000:2.0:1713481296.781365:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784516032:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.781366:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.781375:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091a286c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.781378:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.781384:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.781390:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781392:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784513984:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.781400:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.781406:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781406:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ae11 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4971c expref: 16888 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.781410:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800991dd200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.781412:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2a4000, rc 0) 00010000:00010000:0.0:1713481296.781413:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781415:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120721d40/0xdfc0fb148a3af06 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.781418:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781419:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16888:18836:x1796714882484736:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4907us (4928us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.781420:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120721d40/0xdfc0fb148a3af06 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.781422:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563191 00010000:00010000:3.0:1713481296.781424:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120721d40/0xdfc0fb148a3af06 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.781427:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 2/0,0 mode: --/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781432:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563212 00010000:00010000:0.0:1713481296.781433:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991dd200/0xdfc0fb148a3adcb lrc: 0/0,0 mode: --/PW res: [0x280000408:0x270a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781435:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:15045:x1796714882487552:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.781440:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1713481296.781443:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c39:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.781445:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713481296.781446:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3af0d lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49785 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713481296.781454:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880120721d40/0xdfc0fb148a3af06 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00002000:00010000:2.0:1713481296.781456:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.781460:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781462:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781463:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.781463:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781466:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3af0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49785 expref: 24481 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781466:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781469:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781471:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013300dd40/0xdfc0fb148a3af0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49785 expref: 24481 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781472:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800922e7840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.781475:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013300dd40, rc 0) 00010000:00010000:3.0:1713481296.781475:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781478:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.781481:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:15045:x1796714882487552:12345-192.168.202.24@tcp:101:dd.0 Request processed in 46us (273us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.781483:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:2.0:1713481296.781485:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563212 00010000:00010000:3.0:1713481296.781485:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.781487:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781491:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3aef1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781501:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781503:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781506:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000004:00080000:2.0:1713481296.781508:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a8ad80/2, rc 0, transno 1073553 00010000:00010000:3.0:1713481296.781509:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122ad3180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.781511:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.781512:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784513472:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.781513:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781517:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff88009852f800) 00010000:00010000:3.0:1713481296.781518:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.781519:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781522:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122ad3180/0xdfc0fb148a3aeff lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.781530:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.781533:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784516096:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.781545:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+187:3490:x1796714784513600:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6509us (6547us total) trans 4296040850 rc 0/0 00000100:00100000:2.0:1713481296.781547:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.781552:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563185 00010000:00010000:3.0:1713481296.781556:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009227ba80/0xdfc0fb148a3aeea lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49777 expref: 2379 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781560:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784516096 00000100:00100000:2.0:1713481296.781562:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784516096 00010000:00010000:3.0:1713481296.781566:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880120721d40/0xdfc0fb148a3af06 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49777 expref: 2378 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781570:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff88009852f700) 00010000:00010000:3.0:1713481296.781572:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.781573:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120721d40, rc 0) 00000100:00100000:2.0:1713481296.781574:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563213 00000100:00100000:2.0:1713481296.781576:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+187:3492:x1796714784516096:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.781583:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10001 count 1 00000004:00080000:0.0:1713481296.781585:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078199f80/2, rc 0, transno 1073554 00000100:00100000:3.0:1713481296.781585:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007db7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2378:18887:x1796714882487424:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 340us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.781589:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485847 00000100:00100000:0.0:1713481296.781591:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784513600:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.781591:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781600:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd89440/0xdfc0fb148802b33 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c94 expref: 20785 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.781604:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781604:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.781605:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485848 00010000:00010000:2.0:1713481296.781606:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.781608:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2037:18678:x1796714882487488:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:0.0:1713481296.781614:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784516160:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.781614:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.781615:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd89440/0xdfc0fb148802b33 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c94 expref: 20785 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.781619:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd89440/0xdfc0fb148802b33 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c94 expref: 20785 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.781619:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120720fc0/0xdfc0fb148a3af1b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4977e expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781625:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784516224:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.781628:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.781634:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095df8540 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.781648:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784516160 00000100:00100000:2.0:1713481296.781650:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784516160 00000100:00100000:2.0:1713481296.781678:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563214 00000100:00100000:2.0:1713481296.781681:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+188:3490:x1796714784516160:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.781683:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00002000:00080000:2.0:1713481296.781687:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10002 count 1 00010000:00010000:3.0:1713481296.781691:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781694:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781695:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781701:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c583840/0xdfc0fb148802b3a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ca2 expref: 20785 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.781703:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.781704:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.781707:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781708:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781709:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781710:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781711:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.781719:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487232 00010000:00010000:2.0:1713481296.781719:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c583840/0xdfc0fb148802b3a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ca2 expref: 20785 pid: 16497 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.781722:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487232 00010000:00010000:2.0:1713481296.781724:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c583840/0xdfc0fb148802b3a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ca2 expref: 20785 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.781729:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784516288:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.781734:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c202f40/0xdfc0fb14868900a lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d1d expref: 26878 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.781736:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120721440/0xdfc0fb148a3af37 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.781738:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f5ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.781741:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120721440/0xdfc0fb148a3af37 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781744:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120721440/0xdfc0fb148a3af37 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.781750:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820393 00000100:00100000:0.0:1713481296.781754:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26878:1960:x1796714882487232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00200000:3.0:1713481296.781756:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c3b:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.781758:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.781760:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.781764:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c202f40/0xdfc0fb14868900a lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d1d expref: 26878 pid: 16485 timeout: 815 lvb_type: 1 00000004:00010000:3.0:1713481296.781764:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880120721440/0xdfc0fb148a3af37 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781768:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781771:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.781773:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c202f40/0xdfc0fb14868900a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d1d expref: 26878 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.781775:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.781777:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.781778:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781780:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120721b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.781782:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781785:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.781786:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.781787:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487616 00010000:00010000:0.0:1713481296.781788:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.781788:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487616 00010000:00010000:3.0:1713481296.781789:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88008ad2f200) 00010000:00010000:0.0:1713481296.781791:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781791:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.781792:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781795:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120721b00/0xdfc0fb148a3af22 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.781798:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.781799:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563215 00000100:00100000:2.0:1713481296.781801:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16888:18844:x1796714882487616:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.781806:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.781808:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.781810:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.781811:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781812:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3af3e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4978c expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781814:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.781816:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120720b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.781818:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00002000:00010000:2.0:1713481296.781820:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.781821:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.781824:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26878:1960:x1796714882487232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (119us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.781825:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.781825:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x3231 (ffff8800837b7400) 00010000:00010000:2.0:1713481296.781826:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.781826:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.781827:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.781829:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3af3e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4978c expref: 16889 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781830:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120720b40/0xdfc0fb148a3af30 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.781833:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820393 00010000:00010000:2.0:1713481296.781835:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012050a1c0/0xdfc0fb148a3af3e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4978c expref: 16889 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781839:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012050a1c0, rc 0) 00000100:00100000:2.0:1713481296.781848:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16889:18844:x1796714882487616:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 46us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.781851:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563215 00010000:00010000:3.0:1713481296.781856:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120720fc0/0xdfc0fb148a3af1b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4977e expref: 2039 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781863:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880120721440/0xdfc0fb148a3af37 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4977e expref: 2038 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.781867:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x0 (ffff880099cf8500) 00010000:00010000:3.0:1713481296.781869:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.781870:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120721440, rc 0) 00000100:00100000:3.0:1713481296.781886:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:18678:x1796714882487488:12345-192.168.202.24@tcp:101:rm.0 Request processed in 277us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.781890:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485848 00000100:00100000:0.0:1713481296.781891:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.781908:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487680 00000100:00100000:0.0:1713481296.781910:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487680 00000100:00100000:2.0:1713481296.781912:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.781921:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a05c900/0xdfc0fb14891eac6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb612 expref: 20786 pid: 16536 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.781921:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784514048:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.781930:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.781936:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487744 00000100:00100000:0.0:1713481296.781938:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487744 00000100:00100000:2.0:1713481296.781938:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487808 00000100:00100000:2.0:1713481296.781940:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487808 00010000:00010000:3.0:1713481296.781940:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097642640/0xdfc0fb148a3ae26 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4973f expref: 24481 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.781946:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007995c000/0xdfc0fb148916da6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c657d expref: 24481 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.781947:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097642640, rc 0) 00000100:00100000:2.0:1713481296.781949:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563216 00000100:00100000:2.0:1713481296.781952:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012015f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16889:17009:x1796714882487808:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.781956:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.781957:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:10479:x1796714882486080:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5209us (5259us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.781959:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820394 00010000:00010000:2.0:1713481296.781962:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3af45 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49793 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.781962:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563193 00000100:00100000:0.0:1713481296.781964:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20786:1960:x1796714882487680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00002000:00010000:2.0:1713481296.781969:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.781971:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.781975:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a05c900/0xdfc0fb14891eac6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb612 expref: 20786 pid: 16536 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.781975:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781976:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.781978:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3af45 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49793 expref: 16890 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.781983:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a05c900/0xdfc0fb14891eac6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb612 expref: 20786 pid: 16536 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.781984:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012050b180/0xdfc0fb148a3af45 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49793 expref: 16890 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.781992:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012050b180, rc 0) 00010000:00010000:0.0:1713481296.782000:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a05c900/0xdfc0fb14891eac6 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb612 expref: 20786 pid: 16536 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.782002:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012015f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16890:17009:x1796714882487808:12345-192.168.202.24@tcp:101:dd.0 Request processed in 49us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.782006:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563216 00010000:00010000:0.0:1713481296.782012:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.782013:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.782017:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ae11 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4971c expref: 16889 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.782025:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ae11 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4971c expref: 16889 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.782037:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.782042:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2a4000/0xdfc0fb148a3ae11 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x805f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4971c expref: 16889 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.782050:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784516352:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.782061:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487872 00000100:00100000:3.0:1713481296.782063:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487872 00000100:00100000:0.0:1713481296.782067:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084b34d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.782078:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485849 00000100:00100000:3.0:1713481296.782081:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012015df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18925:x1796714882487872:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.782084:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784514112:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.782086:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820395 00010000:00010000:3.0:1713481296.782087:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.782091:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1958:x1796714882487744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.782094:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120722640/0xdfc0fb148a3af4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4979a expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782097:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.782098:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.782104:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20785:1960:x1796714882484928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5057us (5153us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.782109:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007995c000/0xdfc0fb148916da6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c657d expref: 24480 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.782109:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820376 00010000:00010000:0.0:1713481296.782118:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007995c000/0xdfc0fb148916da6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c657d expref: 24480 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.782154:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007995c000/0xdfc0fb148916da6 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c657d expref: 24480 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.782163:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.782163:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.782165:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.782166:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.782169:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097642640/0xdfc0fb148a3ae26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4973f expref: 24479 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.782170:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.782173:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882487936 00000100:00100000:2.0:1713481296.782175:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882487936 00010000:00010000:3.0:1713481296.782175:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.782181:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097642640/0xdfc0fb148a3ae26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4973f expref: 24480 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.782182:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.782184:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563217 00000100:00100000:2.0:1713481296.782186:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012015c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:14753:x1796714882487936:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.782186:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782190:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.782191:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.782196:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097642640/0xdfc0fb148a3ae26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4973f expref: 24480 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782197:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb148a3af61 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497a1 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.782203:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e276680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784516416:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.782204:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.782206:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098edf180/0xdfc0fb148a13ea8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38003 expref: 24481 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.782207:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.782210:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.782210:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.782211:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.782213:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb148a3af61 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a1 expref: 24481 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.782213:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.782216:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c86c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.782216:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120720000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.782218:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.782223:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098edf180/0xdfc0fb148a13ea8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38003 expref: 24481 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.782224:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.782228:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098edf180/0xdfc0fb148a13ea8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38003 expref: 24481 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.782228:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.782229:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.782231:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.782233:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012015c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784516480:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.782234:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880120720000/0xdfc0fb148a3af53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782242:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.782243:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.782245:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782248:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782250:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079b38d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.782251:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782254:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782258:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3631 (ffff88009c260d00) 00010000:00010000:3.0:1713481296.782259:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.782261:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782264:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079b38d80/0xdfc0fb148a3af5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.782284:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880120722640/0xdfc0fb148a3af4c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4979a expref: 2204 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.782289:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880120722640/0xdfc0fb148a3af4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4979a expref: 2204 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.782292:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007836f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784514304:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.782301:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120722640, rc 0) 00010000:00010000:2.0:1713481296.782304:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.782314:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012015df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18925:x1796714882487872:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 232us (276us total) trans 0 rc 301/301 00000100:00100000:3.0:1713481296.782317:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485849 00000100:00100000:0.0:1713481296.782321:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.782333:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488000 00000100:00100000:2.0:1713481296.782335:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488000 00000100:00100000:2.0:1713481296.782346:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563218 00000100:00100000:3.0:1713481296.782346:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784514176:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.782349:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16890:11552:x1796714882488000:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.782353:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.782359:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120509200/0xdfc0fb148a3af68 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497a8 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.782365:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.782368:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133bf9200/0xdfc0fb148959c52 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd7 expref: 16891 pid: 16506 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.782372:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.782373:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.782375:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120509200/0xdfc0fb148a3af68 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a8 expref: 16891 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.782375:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26877:1960:x1796714882485056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5336us (5406us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.782380:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820375 00000100:00100000:0.0:1713481296.782383:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.782384:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133bf9200/0xdfc0fb148959c52 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd7 expref: 16891 pid: 16506 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.782389:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133bf9200/0xdfc0fb148959c52 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd7 expref: 16891 pid: 16506 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.782394:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012015f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784516544:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.782399:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488128 00000100:00100000:0.0:1713481296.782403:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488128 00000100:00100000:2.0:1713481296.782404:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800979649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.782420:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125691 00000100:00100000:0.0:1713481296.782424:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:18952:x1796714882488128:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:2.0:1713481296.782462:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.782475:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488192 00000100:00100000:3.0:1713481296.782478:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488192 00010000:00010000:3.0:1713481296.782487:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880079411680/0xdfc0fb148689088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d39 expref: 26877 pid: 16466 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.782499:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820396 00000100:00100000:3.0:1713481296.782502:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012015f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26877:1959:x1796714882488192:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.782507:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.782510:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880079411680/0xdfc0fb148689088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d39 expref: 26877 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.782520:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880079411680/0xdfc0fb148689088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d39 expref: 26877 pid: 16466 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.782522:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2039:18952:x1796714882488128:12345-192.168.202.24@tcp:35:touch.0 Request processed in 96us (138us total) trans 4295107601 rc 0/0 00000100:00100000:0.0:1713481296.782528:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125691 00010000:00010000:3.0:1713481296.782532:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079411680/0xdfc0fb148689088 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d39 expref: 26877 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.782545:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.782546:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.782548:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.782553:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.782572:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.782576:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782581:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.782583:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012015f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:1959:x1796714882488192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 80us (122us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.782586:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.782587:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820396 00010000:00010000:2.0:1713481296.782589:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782593:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782600:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2a5f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.782602:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782606:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782614:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782618:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a5f80/0xdfc0fb148a3ae3b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.782739:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007836ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2788:3492:x1796714784514240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5146us (5186us total) trans 4295960729 rc 0/0 00000100:00100000:2.0:1713481296.782743:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563195 00000004:00080000:2.0:1713481296.782766:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a1d880/2, rc 0, transno 993433 00000100:00100000:2.0:1713481296.782769:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784514240:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.782797:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012015d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784516608:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.782809:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.782828:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784516608 00000100:00100000:2.0:1713481296.782829:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784516608 00000100:00100000:2.0:1713481296.782839:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563219 00000100:00100000:2.0:1713481296.782843:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012015e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2788:3491:x1796714784516608:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.782853:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43385 count 1 00010000:00010000:2.0:1713481296.782864:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782874:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f33600/0xdfc0fb1486890d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d8d expref: 26875 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.782880:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.782881:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.782883:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.782898:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092f33600/0xdfc0fb1486890d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d8d expref: 26875 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.782906:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092f33600/0xdfc0fb1486890d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d8d expref: 26875 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.782915:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012015dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784516672:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.782930:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092c58f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.783131:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784514432:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.783150:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.783162:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784514624:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.783179:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.783213:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120112a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784514688:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.783226:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.783257:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784515072:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.783269:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.783815:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.783841:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.783857:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488256 00000100:00100000:2.0:1713481296.783861:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488256 00000100:00100000:3.0:1713481296.783863:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488384 00000100:00100000:3.0:1713481296.783867:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488384 00010000:00010000:2.0:1713481296.783871:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c580d80/0xdfc0fb148802b09 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c40 expref: 20786 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.783881:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.783882:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013543df80/0xdfc0fb148802b1e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c6a expref: 20786 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.783889:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488320 00000100:00100000:2.0:1713481296.783890:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488320 00010000:00010000:2.0:1713481296.783896:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148802b10 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c4e expref: 20787 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.783902:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820397 00000100:00100000:3.0:1713481296.783908:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20787:1960:x1796714882488256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.783911:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820398 00000100:00100000:2.0:1713481296.783916:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820399 00010000:00010000:3.0:1713481296.783916:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.783917:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20787:1960:x1796714882488384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.783919:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20787:1960:x1796714882488320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.783921:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c580d80/0xdfc0fb148802b09 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c40 expref: 20787 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.783924:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.783925:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.783927:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148802b10 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c4e expref: 20787 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.783931:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013543df80/0xdfc0fb148802b1e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c6a expref: 20787 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.783931:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c580d80/0xdfc0fb148802b09 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c40 expref: 20787 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.783933:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148802b10 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c4e expref: 20787 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.783940:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013543df80/0xdfc0fb148802b1e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c6a expref: 20787 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.783945:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148802b10 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x270c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c4e expref: 20787 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.783952:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c580d80/0xdfc0fb148802b09 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x270b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c40 expref: 20787 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.783956:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013543df80/0xdfc0fb148802b1e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x270e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c6a expref: 20786 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.783956:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.783957:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.783959:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.783963:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.783972:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.783972:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.783974:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.783974:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.783975:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.783977:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.783977:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.783984:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.783985:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.783988:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20784:1960:x1796714882488320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.783992:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820399 00010000:00010000:3.0:1713481296.784003:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.784008:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.784011:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784016:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784020:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784023:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.784025:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20783:1960:x1796714882488256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 115us (210us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.784027:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.784029:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20783:1960:x1796714882488384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 111us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.784032:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820397 00010000:00010000:2.0:1713481296.784033:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300c480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.784035:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.784037:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820398 00010000:00010000:2.0:1713481296.784039:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784046:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784049:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013300c480/0xdfc0fb148a3ae65 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x270e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784065:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.784075:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013499ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784514752:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.784077:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784084:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784090:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784096:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784102:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc46c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.784105:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.784110:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148a3ae57 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49746 expref: 24481 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784111:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.784142:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097640000, rc 0) 00010000:00010000:0.0:1713481296.784144:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784151:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086bc46c0/0xdfc0fb148a3ae49 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x270c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.784163:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+189:3490:x1796714784514944:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5075us (5101us total) trans 4296040851 rc 0/0 00000100:00100000:3.0:1713481296.784164:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:17924:x1796714882486336:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5866us (5897us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.784168:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563201 00000100:00100000:3.0:1713481296.784172:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563199 00000004:00080000:2.0:1713481296.784194:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098359c00/2, rc 0, transno 1073555 00000100:00100000:2.0:1713481296.784199:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784514944:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.784217:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.784221:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012015c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784516736:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.784234:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.784259:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784516736 00000100:00100000:3.0:1713481296.784263:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784516736 00010000:00010000:2.0:1713481296.784265:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784270:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784275:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.784278:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784514816:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.784279:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.784282:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563220 00010000:00010000:2.0:1713481296.784283:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784286:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097640d80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.784287:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+190:3493:x1796714784516736:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.784288:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784291:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784293:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.784299:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.784300:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10003 count 1 00010000:00010000:2.0:1713481296.784303:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097640d80/0xdfc0fb148a3ae42 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x270b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.784309:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120111c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26875:1960:x1796714882484416:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5835us (5893us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.784312:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.784316:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820381 00010000:00010000:3.0:1713481296.784323:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013543d8c0/0xdfc0fb148802b41 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cb0 expref: 20781 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.784330:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.784332:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.784335:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.784350:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013543d8c0/0xdfc0fb148802b41 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cb0 expref: 20781 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.784360:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013543d8c0/0xdfc0fb148802b41 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cb0 expref: 20781 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.784370:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.784371:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078334000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784516800:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.784386:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488448 00000100:00100000:0.0:1713481296.784390:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488448 00000100:00100000:3.0:1713481296.784395:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.784401:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd89200/0xdfc0fb148802b17 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c5c expref: 20782 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.784402:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007836df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+191:3490:x1796714784514368:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6485us (6530us total) trans 4296040853 rc 0/0 00000100:00100000:2.0:1713481296.784407:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563196 00000100:00100000:0.0:1713481296.784418:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820400 00000100:00100000:0.0:1713481296.784423:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:1960:x1796714882488448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.784430:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1713481296.784432:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007836ce00/2, rc 0, transno 1073557 00010000:00010000:0.0:1713481296.784434:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd89200/0xdfc0fb148802b17 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c5c expref: 20782 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.784436:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007836ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784514368:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.784442:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd89200/0xdfc0fb148802b17 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c5c expref: 20782 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.784455:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd89200/0xdfc0fb148802b17 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x270d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c5c expref: 20782 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.784467:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.784468:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.784468:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713481296.784470:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.784473:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784516864:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.784481:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.784483:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+190:3491:x1796714784514496:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6227us (6281us total) trans 4296040852 rc 0/0 00000100:00100000:2.0:1713481296.784487:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.784490:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563197 00010000:00010000:0.0:1713481296.784499:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713481296.784510:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007836f800/2, rc 0, transno 1073556 00000100:00100000:3.0:1713481296.784511:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784516864 00000100:00100000:2.0:1713481296.784514:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007836f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784514496:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.784514:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784516864 00000100:00100000:0.0:1713481296.784520:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20781:1960:x1796714882488448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.784527:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820400 00000100:00100000:3.0:1713481296.784531:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563221 00000100:00100000:2.0:1713481296.784534:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784516928:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.784534:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007836f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+190:3492:x1796714784516864:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.784545:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713481296.784545:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10004 count 1 00010000:00010000:0.0:1713481296.784549:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784556:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.784556:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784563:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.784564:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784516928 00000100:00100000:2.0:1713481296.784566:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784516928 00010000:00010000:3.0:1713481296.784567:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092301440/0xdfc0fb148802b48 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cbe expref: 20780 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.784570:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.784574:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.784575:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.784576:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.784577:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563222 00010000:00010000:3.0:1713481296.784577:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.784579:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+191:3490:x1796714784516928:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.784582:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a949f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.784585:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.784587:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10005 count 1 00010000:00010000:3.0:1713481296.784594:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092301440/0xdfc0fb148802b48 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cbe expref: 20780 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.784595:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784595:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784602:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800868b3cc0/0xdfc0fb148802b4f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ccc expref: 20780 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.784603:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092301440/0xdfc0fb148802b48 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cbe expref: 20780 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.784605:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.784606:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.784607:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.784609:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784610:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3ae50 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x270d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.784613:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013499ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784516992:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.784619:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800868b3cc0/0xdfc0fb148802b4f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ccc expref: 20780 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.784627:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800868b3cc0/0xdfc0fb148802b4f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ccc expref: 20780 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.784633:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784517056:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.784636:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.784647:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800916e2300 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.784750:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+192:3492:x1796714784514560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6463us (6524us total) trans 4296040854 rc 0/0 00000004:00080000:2.0:1713481296.784750:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007836ed80/2, rc 0, transno 1073558 00000100:00100000:2.0:1713481296.784755:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007836ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784514560:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.784757:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563198 00000100:00100000:2.0:1713481296.784775:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784517120:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.784787:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.784813:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784517120 00000100:00100000:0.0:1713481296.784816:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784517120 00000100:00100000:0.0:1713481296.784827:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563223 00000100:00100000:0.0:1713481296.784830:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+192:3491:x1796714784517120:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.784839:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10006 count 1 00010000:00010000:0.0:1713481296.784846:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784853:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148802db7 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cda expref: 20780 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.784857:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.784858:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.784859:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.784870:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148802db7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cda expref: 20780 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.784875:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148802db7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cda expref: 20780 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.784881:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784517184:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.784893:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc49cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.784976:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a238000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784515200:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.784987:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.785000:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16891:1960:x1796714882485184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5609us (5684us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.785005:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820385 00000100:00100000:3.0:1713481296.785012:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078337480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784515328:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.785034:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.785052:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.785057:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078da8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784515392:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.785073:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.785084:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488640 00000100:00100000:2.0:1713481296.785086:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488640 00000100:00100000:0.0:1713481296.785102:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784515520:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.785104:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563224 00000100:00100000:2.0:1713481296.785108:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26875:17935:x1796714882488640:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.785113:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.785134:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785135:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091795200/0xdfc0fb148a3af92 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497af expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.785144:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb795:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.785151:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.785153:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.785155:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091795200/0xdfc0fb148a3af92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497af expref: 26876 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785161:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091795200/0xdfc0fb148a3af92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497af expref: 26876 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785166:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091795200, rc 0) 00000100:00100000:2.0:1713481296.785179:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26876:17935:x1796714882488640:12345-192.168.202.24@tcp:101:dd.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.785183:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563224 00000100:00100000:0.0:1713481296.785186:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.785204:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488704 00000100:00100000:2.0:1713481296.785206:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488704 00000100:00100000:2.0:1713481296.785221:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563225 00000100:00100000:2.0:1713481296.785224:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16891:8499:x1796714882488704:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.785228:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.785232:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.785234:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091794240/0xdfc0fb148a3af99 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497b6 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785243:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dab9d40/0xdfc0fb1488e7e53 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5510 expref: 16892 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.785247:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.785248:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.785250:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091794240/0xdfc0fb148a3af99 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497b6 expref: 16892 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.785253:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488832 00000100:00100000:3.0:1713481296.785257:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488832 00010000:00010000:2.0:1713481296.785259:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dab9d40/0xdfc0fb1488e7e53 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5510 expref: 16892 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.785266:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dab9d40/0xdfc0fb1488e7e53 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5510 expref: 16892 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.785274:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784517248:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.785279:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.785279:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563226 00000100:00100000:3.0:1713481296.785285:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:10409:x1796714882488832:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.785292:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009434e000 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.785292:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.785302:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880078778240/0xdfc0fb148a3afa0 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497bd expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.785317:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093289d40/0xdfc0fb14891d43e lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca701 expref: 24482 pid: 16464 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.785326:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120509d40/0xdfc0fb14893ab8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db41f expref: 26875 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.785333:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.785334:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.785337:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880078778240/0xdfc0fb148a3afa0 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497bd expref: 24482 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.785353:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120509d40/0xdfc0fb14893ab8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db41f expref: 26875 pid: 16495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.785362:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120509d40/0xdfc0fb14893ab8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db41f expref: 26875 pid: 16495 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.785377:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078337480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784517312:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.785395:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784515968:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.785409:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093289d40/0xdfc0fb14891d43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca701 expref: 24482 pid: 16464 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.785415:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.785419:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093289d40/0xdfc0fb14891d43e lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca701 expref: 24482 pid: 16464 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.785428:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784517376:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.785451:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9600 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.785476:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488896 00000100:00100000:3.0:1713481296.785480:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488896 00000100:00100000:3.0:1713481296.785502:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485850 00000100:00100000:3.0:1713481296.785508:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2378:18963:x1796714882488896:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:3.0:1713481296.785537:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.785549:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b15cd80/0xdfc0fb148a3ae88 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4975b expref: 2378 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.785569:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d5:0x0].0x0 (ffff88008bd1d600) 00010000:00010000:3.0:1713481296.785581:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.785646:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880078778000/0xdfc0fb148a3afa7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x34d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.785654:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078778000/0xdfc0fb148a3afa7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.785661:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880078778000/0xdfc0fb148a3afa7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000004:00010000:3.0:1713481296.785741:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880072b78e00 reply state ffff880134f99000 transno 4295107602 ns: mdt-lustre-MDT0001_UUID lock: ffff880078778000/0xdfc0fb148a3afa7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.785750:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880078778000/0xdfc0fb148a3afa7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.785756:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d5:0x0].0x0 (ffff88009ccd2a00) 00010000:00010000:3.0:1713481296.785758:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.785760:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.785772:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.785782:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784516032:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.785784:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.785800:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013300eac0/0xdfc0fb148a3aef8 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49770 expref: 16892 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.785804:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2379:18963:x1796714882488896:12345-192.168.202.24@tcp:36:touch.0 Request processed in 295us (525us total) trans 4295107602 rc 0/0 00010000:00010000:2.0:1713481296.785807:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013300eac0, rc 0) 00000100:00100000:3.0:1713481296.785810:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485850 00000100:00100000:2.0:1713481296.785821:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007db7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16892:11388:x1796714882487360:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4503us (4664us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.785825:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563211 00000100:00100000:3.0:1713481296.785828:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489216 00000100:00100000:3.0:1713481296.785831:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489216 00000100:00100000:2.0:1713481296.785841:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489280 00000100:00100000:2.0:1713481296.785843:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489280 00000100:00100000:3.0:1713481296.785846:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485851 00000100:00100000:3.0:1713481296.785850:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18917:x1796714882489216:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.785855:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563227 00010000:00010000:3.0:1713481296.785857:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.785858:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20781:18792:x1796714882489280:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.785863:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.785867:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078778b40/0xdfc0fb148a3afae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497c4 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785869:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091795d40/0xdfc0fb148a3afb5 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc51a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497cb expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.785877:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc51a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.785883:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.785884:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.785887:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007347f3c0/0xdfc0fb148688f5b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa968:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2cfa expref: 26875 pid: 16484 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.785887:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091795d40/0xdfc0fb148a3afb5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497cb expref: 20782 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785893:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091795d40/0xdfc0fb148a3afb5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497cb expref: 20782 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785897:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091795d40, rc 0) 00000100:00100000:1.0:1713481296.785902:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d286a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784513408:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.785908:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:18792:x1796714882489280:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.785911:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563227 00010000:00010000:1.0:1713481296.785919:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.785922:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007877a640/0xdfc0fb148a3afbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.785924:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.785927:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.785929:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007877a640/0xdfc0fb148a3afbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT0 00000100:00100000:2.0:1713481296.785930:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784516224:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.785932:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.785935:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.785936:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007877a640/0xdfc0fb148a3afbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.785939:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.785942:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa0480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.785944:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785944:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.785947:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.785956:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784516288:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.785960:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.785964:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121aa0480/0xdfc0fb148a3adbd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.785966:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.785970:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784516352:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.785986:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.785999:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20781:1960:x1796714882487680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4035us (4110us total) trans 0 rc 0/0 00000004:00200000:3.0:1713481296.786003:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x50b7:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.786004:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820394 00000004:00200000:3.0:1713481296.786007:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713481296.786035:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078778b40/0xdfc0fb148a3afae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497c4 expref: 2205 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.786062:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007877a640/0xdfc0fb148a3afbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497c4 expref: 2204 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.786069:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88009c8eea00) 00010000:00010000:3.0:1713481296.786071:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1713481296.786073:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e276680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784516416:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.786073:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007877a640, rc 0) 00000100:00100000:1.0:1713481296.786082:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2789:3492:x1796714784513344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11333us (11396us total) trans 4295960730 rc 0/0 00000100:00100000:1.0:1713481296.786087:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563183 00010000:00010000:0.0:1713481296.786092:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.786098:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18917:x1796714882489216:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 247us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.786105:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485851 00000004:00080000:2.0:1713481296.786106:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a8a300/2, rc 0, transno 993434 00000100:00100000:1.0:1713481296.786111:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882486976 00000100:00100000:0.0:1713481296.786113:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1958:x1796714882487744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4020us (4199us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.786113:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882486976 00000100:00100000:2.0:1713481296.786114:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784513344:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.786138:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820395 00000100:00100000:1.0:1713481296.786147:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26105 00000100:00100000:1.0:1713481296.786150:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18878:x1796714882486976:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:1.0:1713481296.786167:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.786177:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800848ef600/0xdfc0fb148a3acf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496a5 expref: 2795 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786191:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff8800799d1900) 00010000:00010000:1.0:1713481296.786202:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.786215:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.786220:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.786222:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786226:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786236:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786240:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786243:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:3.0:1713481296.786243:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489344 00000100:00100000:3.0:1713481296.786247:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489344 00010000:00010000:1.0:1713481296.786252:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786255:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.786257:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.786258:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:3.0:1713481296.786266:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563228 00000100:00100000:0.0:1713481296.786267:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488512 00000100:00100000:0.0:1713481296.786270:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488512 00000100:00100000:3.0:1713481296.786271:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20781:15045:x1796714882489344:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.786277:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.786286:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b226880/0xdfc0fb148a1625e lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3982f expref: 24482 pid: 16469 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.786288:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800787798c0/0xdfc0fb148a3afd8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497d2 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786297:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x51f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00002000:00010000:3.0:1713481296.786300:0:16541:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.786301:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820401 00010000:00010000:1.0:1713481296.786301:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.786304:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882488512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.786304:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.786309:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.786309:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.786311:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b226880/0xdfc0fb148a1625e lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3982f expref: 24482 pid: 16469 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.786311:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713481296.786311:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.786315:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800787798c0/0xdfc0fb148a3afd8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497d2 expref: 20782 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.786316:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b226880/0xdfc0fb148a1625e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3982f expref: 24482 pid: 16469 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.786318:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784517440:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.786324:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800787798c0/0xdfc0fb148a3afd8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497d2 expref: 20782 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.786331:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b226880/0xdfc0fb148a1625e lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3982f expref: 24482 pid: 16469 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.786332:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800787798c0, rc 0) 00000100:00100000:2.0:1713481296.786339:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.786340:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.786341:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.786344:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148a3ae57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49746 expref: 24481 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.786353:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:15045:x1796714882489344:12345-192.168.202.24@tcp:101:dd.0 Request processed in 82us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.786357:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148a3ae57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49746 expref: 24481 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.786360:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563228 00000100:00100000:2.0:1713481296.786367:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784517440 00000100:00100000:2.0:1713481296.786370:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784517440 00010000:00010000:0.0:1713481296.786374:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097640000/0xdfc0fb148a3ae57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49746 expref: 24481 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.786383:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784517504:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.786400:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563229 00000004:00010000:1.0:1713481296.786402:0:15793:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007994ce00 reply state ffff88008fc2e000 transno 4295105919 ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.786404:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084b34d80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.786405:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2789:3493:x1796714784517440:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.786408:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786411:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff88008bd1dc00) 00010000:00010000:1.0:1713481296.786413:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:1.0:1713481296.786415:0:15793:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00002000:00080000:2.0:1713481296.786416:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43387 count 1 00000004:00010000:1.0:1713481296.786417:0:15793:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007994ce00 reply state ffff88008fc2e000 transno 4295105919 ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786420:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786424:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3431 (ffff88008bd1d500) 00010000:00010000:1.0:1713481296.786425:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.786426:0:15793:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1713481296.786427:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786428:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786430:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786433:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786436:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.786437:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f33840/0xdfc0fb1486890b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d9b expref: 26874 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.786439:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2ab840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.786440:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786443:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.786443:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.786445:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.786445:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.786447:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.786447:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786448:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.786449:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.786455:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2ab840/0xdfc0fb148a3afc3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.786457:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488960 00000100:00100000:0.0:1713481296.786460:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488960 00000004:00010000:1.0:1713481296.786463:0:15793:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007994ce00 reply state ffff88008fc2e000 transno 4295105919 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.786463:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092f33840/0xdfc0fb1486890b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d9b expref: 26875 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.786466:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.786469:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135867180/0xdfc0fb148689096 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d55 expref: 26875 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.786469:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88008bd1d900) 00010000:00010000:1.0:1713481296.786471:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.786471:0:15793:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:2.0:1713481296.786472:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092f33840/0xdfc0fb1486890b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d9b expref: 26875 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.786483:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820402 00000100:00100000:2.0:1713481296.786486:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784517568:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.786487:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012015f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26875:1960:x1796714882488960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.786492:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.786492:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:18878:x1796714882486976:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 342us (6009us total) trans 4295105919 rc 0/0 00010000:00010000:0.0:1713481296.786496:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135867180/0xdfc0fb148689096 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa972:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d55 expref: 26875 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.786496:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26105 00010000:00010000:0.0:1713481296.786503:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135867180/0xdfc0fb148689096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa972:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d55 expref: 26875 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.786503:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f5ae40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.786517:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135867180/0xdfc0fb148689096 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa972:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d55 expref: 26875 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.786527:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.786527:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c202f40/0xdfc0fb14868900a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d1d expref: 26874 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.786529:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.786532:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.786535:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784513920:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.786536:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786547:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.786549:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.786551:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786555:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786555:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786559:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.786561:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012015f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26873:1960:x1796714882488960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.786562:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786564:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.786566:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820402 00010000:00010000:1.0:1713481296.786566:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786567:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786569:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786571:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786572:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121aa1200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.786574:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786574:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097640480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.786576:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786577:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786580:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786585:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786588:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121aa1200/0xdfc0fb148a3add9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786590:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786594:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097640480/0xdfc0fb148a3ae81 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.786602:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.786610:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489408 00000100:00100000:0.0:1713481296.786612:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489408 00010000:00010000:0.0:1713481296.786621:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3600/0xdfc0fb148942179 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03bf expref: 20782 pid: 16530 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.786636:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820403 00000100:00100000:0.0:1713481296.786640:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:1960:x1796714882489408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.786647:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.786651:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3600/0xdfc0fb148942179 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6975:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03bf expref: 20782 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.786659:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3600/0xdfc0fb148942179 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6975:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03bf expref: 20782 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.786690:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3600/0xdfc0fb148942179 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6975:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03bf expref: 20782 pid: 16530 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.786702:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.786704:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.786705:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2791:3492:x1796714784513792:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11451us (11491us total) trans 4295960731 rc 0/0 00010000:00010000:0.0:1713481296.786707:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013300eac0/0xdfc0fb148a3aef8 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49770 expref: 16891 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.786711:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563187 00010000:00010000:0.0:1713481296.786715:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013300eac0/0xdfc0fb148a3aef8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49770 expref: 16891 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.786719:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2791:3491:x1796714784515136:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7086us (7354us total) trans 4295960732 rc 0/0 00000100:00100000:2.0:1713481296.786723:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563202 00010000:00010000:0.0:1713481296.786731:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013300eac0/0xdfc0fb148a3aef8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6975:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49770 expref: 16891 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.786740:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a88a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784517632:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.786750:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784515008:192.168.202.24@tcp:104: 00000004:00080000:2.0:1713481296.786750:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a23ad80/2, rc 0, transno 993436 00000100:00100000:2.0:1713481296.786753:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784515136:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.786758:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091dc6000 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.786770:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.786773:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784517696:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.786788:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.786798:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.786808:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007db7d180/2, rc 0, transno 993435 00000100:00100000:2.0:1713481296.786811:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007db7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784513792:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.786825:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489536 00000100:00100000:2.0:1713481296.786826:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784517760:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.786829:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489536 00000100:00100000:2.0:1713481296.786837:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.786842:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c583840/0xdfc0fb148802b3a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ca2 expref: 20782 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.786844:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.786854:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784517696 00000100:00100000:2.0:1713481296.786854:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882488576 00000100:00100000:2.0:1713481296.786856:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882488576 00000100:00100000:1.0:1713481296.786857:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784517696 00000100:00100000:3.0:1713481296.786864:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820404 00010000:00010000:2.0:1713481296.786865:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800980cd8c0/0xdfc0fb14868908f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d47 expref: 26873 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.786870:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:1960:x1796714882489536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.786874:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784517760 00000100:00100000:1.0:1713481296.786876:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784517760 00010000:00010000:3.0:1713481296.786878:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.786882:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c583840/0xdfc0fb148802b3a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ca2 expref: 20782 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.786885:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820405 00000100:00100000:2.0:1713481296.786888:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26873:1960:x1796714882488576:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.786889:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563230 00010000:00010000:3.0:1713481296.786891:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c583840/0xdfc0fb148802b3a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ca2 expref: 20782 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.786893:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.786894:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2791:3493:x1796714784517696:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.786896:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800980cd8c0/0xdfc0fb14868908f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa970:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d47 expref: 26873 pid: 16486 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.786902:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800980cd8c0/0xdfc0fb14868908f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa970:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d47 expref: 26873 pid: 16486 timeout: 815 lvb_type: 1 00002000:00080000:1.0:1713481296.786905:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43389 count 1 00010000:00010000:3.0:1713481296.786908:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c583840/0xdfc0fb148802b3a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ca2 expref: 20782 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.786912:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.786914:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800980cd8c0/0xdfc0fb14868908f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa970:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d47 expref: 26873 pid: 16486 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.786916:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786920:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.786921:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.786923:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.786923:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.786925:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.786926:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090599200/0xdfc0fb1486890c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2da9 expref: 26872 pid: 16546 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.786927:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.786928:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489088 00010000:00010000:3.0:1713481296.786929:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.786930:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489088 00010000:00010000:1.0:1713481296.786931:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.786932:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.786935:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786938:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.786940:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092f31b00/0xdfc0fb14868909d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d63 expref: 26873 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.786941:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.786948:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090599200/0xdfc0fb1486890c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2da9 expref: 26873 pid: 16546 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.786949:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26873:1960:x1796714882488576:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.786953:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820405 00010000:00010000:1.0:1713481296.786955:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090599200/0xdfc0fb1486890c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2da9 expref: 26873 pid: 16546 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.786956:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820406 00000100:00100000:0.0:1713481296.786960:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26873:1960:x1796714882489088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.786961:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.786964:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784517824:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.786967:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.786969:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.786971:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092f31b00/0xdfc0fb14868909d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa974:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d63 expref: 26872 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.786973:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.786978:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092f31b00/0xdfc0fb14868909d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa974:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d63 expref: 26872 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.786978:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.786981:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20781:1960:x1796714882489536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 111us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.786985:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.786985:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786988:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.786989:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820404 00010000:00010000:0.0:1713481296.786990:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f31b00/0xdfc0fb14868909d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa974:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d63 expref: 26872 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.786991:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009fa38000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.786993:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.786997:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787001:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.787002:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.787002:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563231 00010000:00010000:0.0:1713481296.787004:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787005:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2791:3490:x1796714784517760:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.787009:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787011:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.787013:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43391 count 1 00010000:00010000:2.0:1713481296.787013:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa38000/0xdfc0fb148a3af29 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787020:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787025:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.787026:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f33cc0/0xdfc0fb1486890c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2db7 expref: 26871 pid: 16456 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.787030:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.787031:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.787032:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.787039:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26871:1960:x1796714882489088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (128us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.787041:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092f33cc0/0xdfc0fb1486890c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2db7 expref: 26871 pid: 16456 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.787044:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820406 00010000:00010000:1.0:1713481296.787046:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092f33cc0/0xdfc0fb1486890c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2db7 expref: 26871 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.787052:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784517888:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.787060:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787064:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800838e7e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.787066:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787077:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787083:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787088:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787093:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc5680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.787095:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787101:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787111:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787170:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.787187:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+193:3490:x1796714784516160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5503us (5555us total) trans 4296040855 rc 0/0 00000100:00100000:2.0:1713481296.787193:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563214 00000100:00100000:1.0:1713481296.787212:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.787225:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3aeb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787229:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.787229:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299f480/2, rc 0, transno 1073559 00000100:00100000:2.0:1713481296.787236:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784516160:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.787239:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489728 00000100:00100000:1.0:1713481296.787241:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489728 00000100:00100000:1.0:1713481296.787253:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26106 00000100:00100000:1.0:1713481296.787256:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2379:18887:x1796714882489728:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:2.0:1713481296.787264:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784517952:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.787270:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1713481296.787279:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.787280:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120721d40/0xdfc0fb148a3af06 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49777 expref: 2379 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787292:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff88009852f700) 00010000:00010000:1.0:1713481296.787302:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4b840/0xdfc0fb148a37b89 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3487:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4799b expref: 2378 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.787302:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489664 00000100:00100000:2.0:1713481296.787304:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489664 00010000:00010000:1.0:1713481296.787315:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3487:0x0].0x0 (ffff88009d156300) 00000100:00100000:2.0:1713481296.787321:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784517952 00000100:00100000:2.0:1713481296.787322:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784517952 00010000:00010000:1.0:1713481296.787325:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.787334:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.787338:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563232 00010000:00010000:1.0:1713481296.787339:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.787342:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16892:17009:x1796714882489664:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.787344:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787347:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.787347:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563233 00010000:00010000:1.0:1713481296.787350:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.787353:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.787353:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+193:3491:x1796714784517952:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.787354:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091794480/0xdfc0fb148a3b009 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497d9 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787356:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00002000:00010000:2.0:1713481296.787362:0:16490:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.787363:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.787367:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787368:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.787369:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.787370:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787372:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091794480/0xdfc0fb148a3b009 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497d9 expref: 16893 pid: 16490 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.787373:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10007 count 1 00010000:00010000:2.0:1713481296.787378:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091794480/0xdfc0fb148a3b009 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497d9 expref: 16893 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787383:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091794480, rc 0) 00010000:00010000:3.0:1713481296.787386:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.787393:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16893:17009:x1796714882489664:12345-192.168.202.24@tcp:101:dd.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.787397:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563232 00010000:00010000:3.0:1713481296.787397:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880079608480/0xdfc0fb148802dbe lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ce8 expref: 20780 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.787403:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.787405:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.787405:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.787407:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787409:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787412:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000004:00080000:2.0:1713481296.787417:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078dabb80/2, rc 0, transno 993437 00010000:00010000:1.0:1713481296.787420:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.787421:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784515456:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.787423:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.787424:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880079608480/0xdfc0fb148802dbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ce8 expref: 20780 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.787426:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.787433:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880079608480/0xdfc0fb148802dbe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ce8 expref: 20780 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.787438:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.787443:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784518080:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.787449:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784518016:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.787461:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2792:3492:x1796714784515456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7443us (7589us total) trans 4295960733 rc 0/0 00000100:00100000:2.0:1713481296.787462:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.787466:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.787467:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563205 00000100:00100000:3.0:1713481296.787467:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.787469:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787472:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787475:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d746c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.787477:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787480:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.787483:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784518080 00010000:00010000:1.0:1713481296.787485:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff88009759fd00) 00000100:00100000:2.0:1713481296.787485:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784518080 00010000:00010000:1.0:1713481296.787486:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.787487:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787490:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081d746c0/0xdfc0fb148a3b025 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.787503:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563234 00000100:00100000:2.0:1713481296.787506:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2792:3493:x1796714784518080:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.787509:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787512:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00002000:00080000:2.0:1713481296.787514:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43393 count 1 00010000:00010000:1.0:1713481296.787516:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787520:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d74000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.787521:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787522:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787527:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787528:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801349e2f40/0xdfc0fb1486890ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa981:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dc5 expref: 26870 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.787532:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.787533:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3487:0x0].0x0 (ffff88007c296300) 00010000:00010000:2.0:1713481296.787533:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.787534:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787535:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.787537:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787543:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801349e2f40/0xdfc0fb1486890ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa981:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dc5 expref: 26870 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.787546:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74000/0xdfc0fb148a3b01e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3487:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787548:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801349e2f40/0xdfc0fb1486890ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa981:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dc5 expref: 26870 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.787554:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784518144:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.787563:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.787564:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095df8540 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.787568:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489472 00010000:00010000:1.0:1713481296.787568:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.787573:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489472 00010000:00010000:1.0:1713481296.787573:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787574:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787578:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787582:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d76f40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.787582:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787585:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd89440/0xdfc0fb148802b33 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c94 expref: 20781 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.787585:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787586:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787590:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787590:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787593:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787596:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.787597:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.787597:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079bceac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.787598:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787600:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787602:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787604:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76f40/0xdfc0fb148a3affb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787610:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.787612:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820407 00010000:00010000:2.0:1713481296.787614:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079bceac0/0xdfc0fb148a3ae5e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.787616:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20781:1960:x1796714882489472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.787616:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787620:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.787623:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.787626:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd89440/0xdfc0fb148802b33 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c94 expref: 20781 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.787626:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787630:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d76ac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.787632:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.787634:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd89440/0xdfc0fb148802b33 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c94 expref: 20781 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.787635:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787639:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff880133a00e00) 00010000:00010000:1.0:1713481296.787640:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.787642:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787644:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081d76ac0/0xdfc0fb148a3b002 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.787646:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd89440/0xdfc0fb148802b33 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2711:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c94 expref: 20781 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.787656:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.787658:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.787658:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.787660:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787662:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787677:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787680:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d74900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.787682:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.787683:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787684:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787690:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88007c296f00) 00010000:00010000:1.0:1713481296.787692:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.787693:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.787695:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081d74900/0xdfc0fb148a3b010 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.787706:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787711:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787716:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787718:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2377:18887:x1796714882489728:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 460us (487us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713481296.787719:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787721:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26106 00010000:00010000:2.0:1713481296.787723:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787726:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dac1b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.787728:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787732:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 5/0,0 mode: PW/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787740:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.787754:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dac1b00/0xdfc0fb148a3af14 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787755:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.787765:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489792 00000100:00100000:1.0:1713481296.787766:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489792 00000100:00100000:1.0:1713481296.787776:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563235 00000100:00100000:1.0:1713481296.787779:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16893:18836:x1796714882489792:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.787781:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.787784:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.787790:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081d77600/0xdfc0fb148a3b033 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497e0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787800:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960b9200/0xdfc0fb14891eb36 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb64a expref: 20780 pid: 16504 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787804:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.787805:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.787807:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081d77600/0xdfc0fb148a3b033 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e0 expref: 16894 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787820:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800960b9200/0xdfc0fb14891eb36 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb64a expref: 20780 pid: 16504 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.787826:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800960b9200/0xdfc0fb14891eb36 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb64a expref: 20780 pid: 16504 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.787831:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784518208:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.787842:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134616600 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.787865:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+194:3492:x1796714784516096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6286us (6316us total) trans 4296040856 rc 0/0 00000100:00100000:2.0:1713481296.787871:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563213 00000100:00100000:1.0:1713481296.787877:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.787887:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20780:1960:x1796714882489472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 223us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.787888:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489856 00000100:00100000:2.0:1713481296.787891:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489856 00000100:00100000:0.0:1713481296.787895:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820407 00000100:00100000:2.0:1713481296.787908:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563236 00000100:00100000:2.0:1713481296.787912:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20780:10479:x1796714882489856:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.787917:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.787919:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.787921:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078336680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784515776:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.787926:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.787927:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007994ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784515648:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.787927:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133a7c900/0xdfc0fb148a3b03a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497e7 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787935:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.787941:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801320b9440/0xdfc0fb148916dad lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6584 expref: 20781 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.787942:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.787944:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.787947:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.787948:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.787951:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7c900/0xdfc0fb148a3b03a lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e7 expref: 20781 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.787966:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801320b9440/0xdfc0fb148916dad lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6584 expref: 20781 pid: 16453 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.787970:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489984 00000100:00100000:3.0:1713481296.787973:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489984 00010000:00010000:2.0:1713481296.787975:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801320b9440/0xdfc0fb148916dad lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6584 expref: 20781 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.787983:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784518272:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.787987:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092302640/0xdfc0fb148802b2c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c86 expref: 20782 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.787990:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.787999:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097998c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.788004:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489920 00000100:00100000:3.0:1713481296.788007:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489920 00000100:00100000:1.0:1713481296.788014:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.788017:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784515840:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.788017:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800980cc6c0/0xdfc0fb1486890a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d71 expref: 26871 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.788022:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012015c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784516480:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.788023:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.788031:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490048 00000100:00100000:3.0:1713481296.788033:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490048 00000100:00100000:1.0:1713481296.788035:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.788041:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007deb46c0/0xdfc0fb1489cfafc lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22273 expref: 24482 pid: 16483 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.788046:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb148a3af61 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a1 expref: 24482 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788053:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.788057:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489024 00000100:00100000:3.0:1713481296.788059:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489024 00000100:00100000:1.0:1713481296.788062:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.788062:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120508b40, rc 0) 00010000:00010000:3.0:1713481296.788066:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c581680/0xdfc0fb148802b25 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c78 expref: 20783 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.788071:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.788076:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012015c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882487936:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5888us (5912us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.788082:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563217 00000100:00100000:3.0:1713481296.788085:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882489152 00000100:00100000:3.0:1713481296.788088:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882489152 00010000:00010000:3.0:1713481296.788097:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009059ad00/0xdfc0fb1486890ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d7f expref: 26872 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.788103:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.788108:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b06df80/0xdfc0fb148a3aed5 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49762 expref: 26872 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.788115:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b06df80, rc 0) 00000100:00100000:3.0:1713481296.788140:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490176 00000100:00100000:0.0:1713481296.788142:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26872:18817:x1796714882487104:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 7350us (7525us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.788142:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490176 00000100:00100000:2.0:1713481296.788143:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490240 00000100:00100000:1.0:1713481296.788144:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490304 00000100:00100000:0.0:1713481296.788146:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563208 00000100:00100000:1.0:1713481296.788146:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490304 00000100:00100000:2.0:1713481296.788146:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490240 00010000:00010000:3.0:1713481296.788153:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098edf180/0xdfc0fb148a13ea8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38003 expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788157:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120509d40/0xdfc0fb14893ab8a lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db41f expref: 26872 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.788160:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133bf9200/0xdfc0fb148959c52 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd7 expref: 16895 pid: 16506 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.788165:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490432 00000100:00100000:0.0:1713481296.788166:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490368 00000100:00100000:0.0:1713481296.788168:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490368 00000100:00100000:3.0:1713481296.788168:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490432 00000100:00100000:1.0:1713481296.788171:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820408 00000100:00100000:1.0:1713481296.788174:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20783:1960:x1796714882489984:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.788175:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092f33600/0xdfc0fb1486890d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d8d expref: 26873 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.788175:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820409 00010000:00010000:3.0:1713481296.788177:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093289d40/0xdfc0fb14891d43e lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca701 expref: 24483 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788179:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.788181:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26873:1960:x1796714882489920:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.788182:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092302640/0xdfc0fb148802b2c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2710:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c86 expref: 20783 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.788186:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820410 00010000:00010000:1.0:1713481296.788188:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092302640/0xdfc0fb148802b2c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2710:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c86 expref: 20783 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.788188:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.788191:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078410700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1960:x1796714882490048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.788192:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820411 00010000:00010000:2.0:1713481296.788193:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800980cc6c0/0xdfc0fb1486890a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa976:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d71 expref: 26873 pid: 16486 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.788197:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20783:1958:x1796714882489024:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.788198:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.788199:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092302640/0xdfc0fb148802b2c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2710:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c86 expref: 20783 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.788201:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800980cc6c0/0xdfc0fb1486890a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa976:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d71 expref: 26873 pid: 16486 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.788202:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007deb46c0/0xdfc0fb1489cfafc lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22273 expref: 24483 pid: 16483 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.788204:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.788206:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788207:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.788208:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c581680/0xdfc0fb148802b25 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x270f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c78 expref: 20782 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788209:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788214:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.788216:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007deb46c0/0xdfc0fb1489cfafc lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22273 expref: 24483 pid: 16483 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.788217:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800980cc6c0/0xdfc0fb1486890a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa976:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d71 expref: 26873 pid: 16486 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.788217:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c581680/0xdfc0fb148802b25 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x270f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c78 expref: 20782 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788225:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.788226:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.788228:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.788230:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788233:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c581680/0xdfc0fb148802b25 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x270f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962c78 expref: 20782 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.788234:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007deb46c0/0xdfc0fb1489cfafc lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22273 expref: 24483 pid: 16483 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.788234:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:1960:x1796714882489984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.788238:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820408 00010000:00010000:2.0:1713481296.788242:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.788247:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.788249:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.788251:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820412 00010000:00010000:0.0:1713481296.788252:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b06df80/0xdfc0fb148a3aed5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49762 expref: 26872 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788254:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26872:1958:x1796714882489152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.788255:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.788256:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788258:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.788259:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.788260:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b06df80/0xdfc0fb148a3aed5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49762 expref: 26872 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788260:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788261:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009059ad00/0xdfc0fb1486890ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa977:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d7f expref: 26872 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.788266:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788267:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009059ad00/0xdfc0fb1486890ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa977:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d7f expref: 26872 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.788273:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26872:1960:x1796714882489920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (345us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.788275:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009059ad00/0xdfc0fb1486890ab lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa977:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d7f expref: 26872 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.788278:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b06df80/0xdfc0fb148a3aed5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49762 expref: 26872 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788280:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820409 00010000:00010000:3.0:1713481296.788284:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.788287:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784518336:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.788287:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788288:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788289:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788294:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788299:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820413 00000100:00100000:3.0:1713481296.788300:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20780:1958:x1796714882489024:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 101us (283us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.788302:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.788303:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882490176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.788304:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012431acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.788308:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820411 00000100:00100000:1.0:1713481296.788309:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26870:1958:x1796714882489152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (286us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.788310:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.788314:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820412 00010000:00010000:0.0:1713481296.788318:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788319:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098edf180/0xdfc0fb148a13ea8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38003 expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.788325:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788325:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098edf180/0xdfc0fb148a13ea8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38003 expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.788327:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820414 00000100:00100000:1.0:1713481296.788334:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820415 00000100:00100000:3.0:1713481296.788335:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26869:1960:x1796714882490304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.788337:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4019450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:1959:x1796714882490240:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.788337:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098edf180/0xdfc0fb148a13ea8 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38003 expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788341:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.788341:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.788346:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.788346:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120509d40/0xdfc0fb14893ab8a lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db41f expref: 26869 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.788347:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788349:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133bf9200/0xdfc0fb148959c52 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x6e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd7 expref: 16895 pid: 16506 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.788349:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb148a3af61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a1 expref: 24481 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788354:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb148a3af61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a1 expref: 24481 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788354:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120509d40/0xdfc0fb14893ab8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db41f expref: 26869 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788355:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133bf9200/0xdfc0fb148959c52 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd7 expref: 16895 pid: 16506 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.788365:0:16520:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880120508b40/0xdfc0fb148a3af61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a1 expref: 24481 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788365:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.788366:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788366:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788368:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880120509200/0xdfc0fb148a3af68 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a8 expref: 16895 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788371:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:16520:1796714784518400:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.788373:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120509200/0xdfc0fb148a3af68 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a8 expref: 16895 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.788377:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26869:1960:x1796714882490304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 44us (313us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.788383:0:15529:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880120509200/0xdfc0fb148a3af68 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a8 expref: 16895 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.788383:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820414 00000100:00100000:2.0:1713481296.788384:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.788389:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788389:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784518464:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.788396:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788399:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a267f300 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.788400:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820416 00010000:00010000:0.0:1713481296.788402:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.788404:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820417 00000100:00100000:2.0:1713481296.788405:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26868:1959:x1796714882490368:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.788406:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b06eac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.788409:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788409:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788409:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.788409:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800823a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1960:x1796714882490432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.788412:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092f33600/0xdfc0fb1486890d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa979:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d8d expref: 26868 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788413:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.788414:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788416:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.788418:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788418:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092f33600/0xdfc0fb1486890d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa979:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d8d expref: 26868 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.788420:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093289d40/0xdfc0fb14891d43e lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca701 expref: 24481 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788425:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.788426:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788426:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.788427:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788429:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788429:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788429:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093289d40/0xdfc0fb14891d43e lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca701 expref: 24481 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.788431:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b06eac0/0xdfc0fb148a3aec7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788432:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300cfc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.788433:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788433:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788437:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788440:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.788442:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788444:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788444:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788447:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013300cfc0/0xdfc0fb148a3aedc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788447:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880078778240/0xdfc0fb148a3afa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497bd expref: 24481 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788448:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26868:1959:x1796714882490368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.788454:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820416 00010000:00010000:3.0:1713481296.788456:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880078778240/0xdfc0fb148a3afa0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497bd expref: 24481 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788474:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880078778240/0xdfc0fb148a3afa0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497bd expref: 24481 pid: 16462 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.788478:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e33ca80/2, rc 0, transno 1073560 00000100:00100000:2.0:1713481296.788483:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784516096:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.788483:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784518528:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.788500:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042c00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.788502:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784518592:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.788508:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788512:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788516:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.788519:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788525:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788531:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788534:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120509d40/0xdfc0fb14893ab8a lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db41f expref: 26867 pid: 16495 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.788536:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097640b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.788539:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788546:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788546:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784517056:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.788553:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078337480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784517312:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.788558:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788559:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788564:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097640b40/0xdfc0fb148a3aece lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788567:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093289d40/0xdfc0fb14891d43e lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca701 expref: 24481 pid: 16464 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.788572:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2795:3491:x1796714784515584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8247us (8272us total) trans 4295960735 rc 0/0 00010000:00010000:2.0:1713481296.788576:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f33600/0xdfc0fb1486890d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d8d expref: 26866 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.788578:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784517376:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.788579:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563206 00000100:00100000:2.0:1713481296.788587:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012015dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784516672:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.788596:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784518592 00000100:00100000:0.0:1713481296.788598:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784518592 00010000:00010000:2.0:1713481296.788601:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788602:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880078778240/0xdfc0fb148a3afa0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497bd expref: 24480 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788605:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788609:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788610:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880078778240, rc 0) 00010000:00010000:2.0:1713481296.788613:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.788614:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563237 00000100:00100000:0.0:1713481296.788618:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+195:3493:x1796714784518592:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.788620:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788624:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.788626:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:10409:x1796714882488832:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3341us (3393us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.788627:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880089bb0fc0 already unused, calling callback (ffffffffa084eb20) 00002000:00080000:0.0:1713481296.788629:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10008 count 1 00010000:00010000:2.0:1713481296.788629:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788632:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.788632:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563226 00010000:00010000:0.0:1713481296.788638:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788640:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788644:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880089bb0fc0/0xdfc0fb148a3af6f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.788648:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083488480/0xdfc0fb148802dc5 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cf6 expref: 20779 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.788653:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.788654:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.788657:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.788681:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078334000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784516800:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.788688:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083488480/0xdfc0fb148802dc5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cf6 expref: 20779 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.788697:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083488480/0xdfc0fb148802dc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cf6 expref: 20779 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.788698:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+195:3490:x1796714784515712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8107us (8155us total) trans 4296040857 rc 0/0 00010000:00010000:3.0:1713481296.788700:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788705:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563207 00000100:00100000:0.0:1713481296.788706:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784518656:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.788723:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012431a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.788728:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013499ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784516992:192.168.202.24@tcp:104: 00000004:00080000:1.0:1713481296.788741:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078da8e00/2, rc 0, transno 1073561 00000004:00080000:0.0:1713481296.788745:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078daad80/2, rc 0, transno 993439 00010000:00010000:3.0:1713481296.788745:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788748:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784515712:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.788753:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784515584:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.788764:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012015d880/2, rc 0, transno 993441 00000100:00100000:0.0:1713481296.788767:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012015d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784516608:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.788769:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012015e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2795:3491:x1796714784516608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5924us (5957us total) trans 4295960737 rc 0/0 00010000:00010000:3.0:1713481296.788770:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.788771:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713481296.788773:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563219 00000100:00100000:0.0:1713481296.788778:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784518720:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.788778:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788791:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.788798:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.788798:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788803:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784517248:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.788805:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788811:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013300d680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.788814:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.788820:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091794240/0xdfc0fb148a3af99 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497b6 expref: 16895 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.788821:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788830:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2794:3492:x1796714784515904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7867us (7907us total) trans 4295960736 rc 0/0 00010000:00010000:2.0:1713481296.788830:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091794240, rc 0) 00000100:00100000:1.0:1713481296.788834:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563209 00010000:00010000:3.0:1713481296.788837:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788839:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:8499:x1796714882488704:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3614us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.788843:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563225 00010000:00010000:3.0:1713481296.788843:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013300d680/0xdfc0fb148a3ae96 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x270f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788848:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784518720 00000100:00100000:1.0:1713481296.788849:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784518720 00000100:00100000:0.0:1713481296.788857:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784518784:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.788857:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.788860:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563238 00000100:00100000:2.0:1713481296.788861:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800785a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784518848:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.788863:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+195:3491:x1796714784518720:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.788871:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10009 count 1 00000100:00100000:0.0:1713481296.788877:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.788879:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.788886:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784518784 00010000:00010000:1.0:1713481296.788887:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e533c0/0xdfc0fb148802dcc lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d04 expref: 20779 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.788889:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784518784 00010000:00010000:1.0:1713481296.788891:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788891:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.788893:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.788902:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e533c0/0xdfc0fb148802dcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d04 expref: 20779 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.788907:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e533c0/0xdfc0fb148802dcc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d04 expref: 20779 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.788907:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563239 00000100:00100000:2.0:1713481296.788912:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007994ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2794:3491:x1796714784518784:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.788913:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800823a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784518912:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.788916:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1713481296.788923:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43395 count 1 00000100:00100000:1.0:1713481296.788927:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092c58f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.788933:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.788938:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784518848 00000100:00100000:0.0:1713481296.788941:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784518848 00010000:00010000:2.0:1713481296.788942:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090598d80/0xdfc0fb1486890dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dd3 expref: 26865 pid: 16546 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.788947:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078199180/2, rc 0, transno 993440 00010000:00010000:2.0:1713481296.788948:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.788949:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.788951:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.788952:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784515904:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.788957:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563240 00000100:00100000:0.0:1713481296.788961:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2795:3493:x1796714784518848:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.788967:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090598d80/0xdfc0fb1486890dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dd3 expref: 26865 pid: 16546 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713481296.788972:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43397 count 1 00010000:00010000:2.0:1713481296.788975:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090598d80/0xdfc0fb1486890dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dd3 expref: 26865 pid: 16546 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.788978:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a239880/2, rc 0, transno 1073562 00000100:00100000:1.0:1713481296.788981:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784515264:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.788982:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.788983:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+196:3492:x1796714784515264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9236us (9265us total) trans 4296040858 rc 0/0 00000100:00100000:1.0:1713481296.788984:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.788984:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784518976:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.788988:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784519040:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.788991:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563203 00010000:00010000:0.0:1713481296.788993:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135921680/0xdfc0fb1486890e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2de1 expref: 26865 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.788999:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.789001:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.789002:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086971e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.789003:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789006:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.789013:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784519040 00000100:00100000:3.0:1713481296.789016:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784519040 00010000:00010000:0.0:1713481296.789018:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135921680/0xdfc0fb1486890e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2de1 expref: 26865 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.789027:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135921680/0xdfc0fb1486890e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2de1 expref: 26865 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.789028:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784519168:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.789030:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133bf9200/0xdfc0fb148959c52 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebd7 expref: 16894 pid: 16506 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.789035:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563241 00000100:00100000:1.0:1713481296.789037:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.789040:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2796:3492:x1796714784519040:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.789041:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784519104:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.789042:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012015f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784516544:192.168.202.24@tcp:104: 00002000:00080000:3.0:1713481296.789052:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43399 count 1 00000100:00100000:1.0:1713481296.789056:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784519168 00000100:00100000:0.0:1713481296.789057:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097998300 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.789057:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784519168 00010000:00010000:2.0:1713481296.789059:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120509200/0xdfc0fb148a3af68 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x6e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497a8 expref: 16893 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789065:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.789067:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120509200, rc 0) 00000100:00100000:1.0:1713481296.789069:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563242 00000100:00100000:1.0:1713481296.789072:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+196:3490:x1796714784519168:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.789076:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801349e2ac0/0xdfc0fb1486890ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2df6 expref: 26865 pid: 16479 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713481296.789079:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10010 count 1 00000100:00100000:2.0:1713481296.789082:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16893:11552:x1796714882488000:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6731us (6761us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.789082:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.789084:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789086:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789086:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.789088:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563218 00010000:00010000:1.0:1713481296.789093:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008214dd40/0xdfc0fb148802dd3 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d12 expref: 20779 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.789095:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784517184:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.789097:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789098:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789100:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789103:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801349e2ac0/0xdfc0fb1486890ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2df6 expref: 26865 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.789109:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008214dd40/0xdfc0fb148802dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d12 expref: 20779 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.789112:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789112:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801349e2ac0/0xdfc0fb1486890ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2df6 expref: 26865 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.789115:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008214dd40/0xdfc0fb148802dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d12 expref: 20779 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.789137:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784519296:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.789144:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784519232:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.789148:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092c58300 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.789161:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490112 00000100:00100000:3.0:1713481296.789162:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.789163:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490112 00000100:00100000:2.0:1713481296.789179:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2796:3492:x1796714784514880:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10099us (10230us total) trans 4295960734 rc 0/0 00000100:00100000:1.0:1713481296.789184:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485852 00000100:00100000:2.0:1713481296.789184:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563200 00000100:00100000:1.0:1713481296.789187:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18580:x1796714882490112:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:1.0:1713481296.789196:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.789202:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b06b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497ee expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.789225:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.789241:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789246:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789250:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713481296.789250:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490560 00000100:00100000:3.0:1713481296.789254:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490560 00010000:00010000:1.0:1713481296.789256:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789260:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789263:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.789265:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.789267:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092301440/0xdfc0fb148802b48 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cbe expref: 20780 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.789275:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789278:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789282:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789285:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789287:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095f7e640 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.789289:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.789289:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789292:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789296:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000100:00100000:3.0:1713481296.789296:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490496 00010000:00010000:1.0:1713481296.789297:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.789298:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490496 00010000:00010000:1.0:1713481296.789299:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789301:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e640/0xdfc0fb148a3b072 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.789309:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013543d8c0/0xdfc0fb148802b41 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cb0 expref: 20781 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.789311:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789313:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.789314:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.789316:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789319:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095f7f600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.789321:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789324:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713481296.789325:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490688 00010000:00010000:1.0:1713481296.789327:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff88009759f100) 00000100:00100000:3.0:1713481296.789327:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490688 00010000:00010000:1.0:1713481296.789328:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.789329:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.789332:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.789335:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800868b3cc0/0xdfc0fb148802b4f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ccc expref: 20782 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.789348:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.789355:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b06b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497ee expref: 2205 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789359:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b06b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497ee expref: 2205 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.789359:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490624 00000100:00100000:3.0:1713481296.789362:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490624 00010000:00010000:1.0:1713481296.789365:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f7e1c0, rc 0) 00000100:00100000:2.0:1713481296.789371:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820418 00000100:00100000:2.0:1713481296.789375:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077129500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20783:1960:x1796714882490560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.789376:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148802db7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cda expref: 20783 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.789377:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18580:x1796714882490112:12345-192.168.202.24@tcp:101:rm.0 Request processed in 189us (1432us total) trans 0 rc 301/301 00000100:00100000:1.0:1713481296.789380:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485852 00010000:00010000:2.0:1713481296.789381:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.789385:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092301440/0xdfc0fb148802b48 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cbe expref: 20783 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.789388:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.789392:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092301440/0xdfc0fb148802b48 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cbe expref: 20783 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.789395:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490752 00000100:00100000:1.0:1713481296.789397:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490816 00000100:00100000:3.0:1713481296.789398:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490752 00000100:00100000:1.0:1713481296.789399:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490816 00010000:00010000:2.0:1713481296.789403:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092301440/0xdfc0fb148802b48 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2714:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cbe expref: 20783 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.789407:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dab9d40/0xdfc0fb1488e7e53 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5510 expref: 16893 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.789410:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.789411:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.789413:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789414:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485853 00000100:00100000:1.0:1713481296.789418:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2377:18963:x1796714882490816:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:2.0:1713481296.789418:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.789423:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820419 00000100:00100000:0.0:1713481296.789429:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.789429:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.789429:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:1959:x1796714882490496:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.789432:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.789437:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077129500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20782:1960:x1796714882490560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (214us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.789438:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.789442:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122acfcc0/0xdfc0fb148a3b080 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x34d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497f5 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.789442:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820418 00010000:00010000:3.0:1713481296.789442:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013543d8c0/0xdfc0fb148802b41 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cb0 expref: 20782 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.789456:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820420 00010000:00010000:3.0:1713481296.789456:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013543d8c0/0xdfc0fb148802b41 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cb0 expref: 20781 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.789458:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20781:1960:x1796714882490688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.789463:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.789466:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800868b3cc0/0xdfc0fb148802b4f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ccc expref: 20781 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.789467:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122acfcc0/0xdfc0fb148a3b080 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x34d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497f5 expref: 2378 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.789471:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800868b3cc0/0xdfc0fb148802b4f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ccc expref: 20781 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.789472:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013543d8c0/0xdfc0fb148802b41 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2713:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cb0 expref: 20781 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.789476:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122acfcc0/0xdfc0fb148a3b080 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x34d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497f5 expref: 2378 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.789481:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800868b3cc0/0xdfc0fb148802b4f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2715:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ccc expref: 20780 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.789487:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d5:0x0].0x0 (ffff88009ccd2a00) 00010000:00010000:1.0:1713481296.789489:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713481296.789490:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789491:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122acfcc0, rc 0) 00010000:00010000:2.0:1713481296.789491:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.789492:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.789492:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.789493:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789495:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.789498:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789502:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789504:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2378:18963:x1796714882490816:12345-192.168.202.24@tcp:101:touch.0 Request processed in 86us (190us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.789505:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.789510:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485853 00000100:00100000:2.0:1713481296.789512:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20779:1960:x1796714882490688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.789515:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820420 00010000:00010000:3.0:1713481296.789519:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.789530:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820421 00000100:00100000:2.0:1713481296.789532:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20778:1959:x1796714882490624:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.789535:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20778:1959:x1796714882490496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 105us (269us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.789536:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.789540:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148802db7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cda expref: 20778 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.789543:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820419 00010000:00010000:2.0:1713481296.789545:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148802db7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cda expref: 20778 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.789558:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148802db7 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cda expref: 20777 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.789560:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.789563:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820422 00010000:00010000:2.0:1713481296.789566:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.789567:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.789568:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16893:1959:x1796714882490752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.789569:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.789573:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.789573:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789576:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.789580:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dab9d40/0xdfc0fb1488e7e53 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5510 expref: 16893 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.789588:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.789589:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490880 00010000:00010000:3.0:1713481296.789590:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dab9d40/0xdfc0fb1488e7e53 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5510 expref: 16893 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.789591:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490880 00010000:00010000:0.0:1713481296.789596:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.789597:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:1959:x1796714882490624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.789601:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882490944 00000100:00100000:2.0:1713481296.789601:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820421 00000100:00100000:1.0:1713481296.789602:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882490944 00010000:00010000:0.0:1713481296.789603:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789608:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563243 00010000:00010000:0.0:1713481296.789609:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789609:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dab9d40/0xdfc0fb1488e7e53 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5510 expref: 16895 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.789611:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:18844:x1796714882490880:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.789614:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789616:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.789623:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122acf840/0xdfc0fb148a3b087 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa497fc expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789623:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.789624:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789625:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.789629:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b14db00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.789629:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091794240/0xdfc0fb148a3af99 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497b6 expref: 16894 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.789632:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.789632:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.789637:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.789637:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098358e00/2, rc 0, transno 993438 00010000:00010000:3.0:1713481296.789637:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091794240/0xdfc0fb148a3af99 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497b6 expref: 16895 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789639:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789640:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789643:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122acf840/0xdfc0fb148a3b087 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497fc expref: 16895 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.789644:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784514880:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.789647:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789649:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122acf840/0xdfc0fb148a3b087 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497fc expref: 16895 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.789652:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b14db00/0xdfc0fb148a3af8b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789654:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122acf840, rc 0) 00010000:00010000:3.0:1713481296.789657:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091794240/0xdfc0fb148a3af99 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497b6 expref: 16895 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789678:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:18844:x1796714882490880:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.789682:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd2aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784519360:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.789683:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563243 00000100:00100000:2.0:1713481296.789691:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713481296.789697:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563244 00000100:00100000:2.0:1713481296.789698:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784519424:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.789700:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16894:17935:x1796714882490944:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.789703:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9900 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.789704:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.789711:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122acd680/0xdfc0fb148a3b08e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49803 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.789718:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.789720:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.789723:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789724:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789727:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122acd680/0xdfc0fb148a3b08e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49803 expref: 16895 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.789730:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491648 00010000:00010000:1.0:1713481296.789733:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122acd680/0xdfc0fb148a3b08e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49803 expref: 16895 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.789733:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491648 00010000:00010000:1.0:1713481296.789737:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122acd680, rc 0) 00010000:00010000:2.0:1713481296.789745:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789747:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:17935:x1796714882490944:12345-192.168.202.24@tcp:101:dd.0 Request processed in 47us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.789751:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563244 00010000:00010000:2.0:1713481296.789752:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.789758:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485854 00000100:00100000:1.0:1713481296.789759:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784519424 00010000:00010000:2.0:1713481296.789760:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789761:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784519424 00000100:00100000:3.0:1713481296.789762:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2039:18678:x1796714882491648:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1713481296.789766:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.789771:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563245 00000100:00100000:1.0:1713481296.789773:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2796:3490:x1796714784519424:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.789776:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.789781:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43401 count 1 00010000:00010000:2.0:1713481296.789781:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133a7fa80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.789784:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789787:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.789789:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.789790:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789794:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b4480/0xdfc0fb1486890f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e04 expref: 26865 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.789798:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.789799:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.789799:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007877a880/0xdfc0fb148a3b09c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4982d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789800:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.789803:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.789809:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133a7fa80/0xdfc0fb148a3af84 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.789810:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b4480/0xdfc0fb1486890f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e04 expref: 26865 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.789815:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800922b4480/0xdfc0fb1486890f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e04 expref: 26865 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.789817:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+197:3491:x1796714784517120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4983us (5026us total) trans 4296040859 rc 0/0 00000100:00100000:1.0:1713481296.789821:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784519488:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.789823:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563223 00000100:00100000:1.0:1713481296.789831:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e6c0 going to sleep for 11 seconds 00000004:00080000:0.0:1713481296.789854:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a17100/2, rc 0, transno 1073563 00000100:00100000:0.0:1713481296.789868:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784517120:0@lo:6:osp-syn-0-1.0 00000004:00200000:3.0:1713481296.789872:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c3b:0x0]: returning size 4096 00000100:00100000:1.0:1713481296.789883:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.789888:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784519552:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.789906:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.789918:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784517504:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.789933:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.789933:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007877a880/0xdfc0fb148a3b09c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4982d expref: 2041 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.789937:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+197:3490:x1796714784516928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5355us (5389us total) trans 4296040860 rc 0/0 00000100:00100000:1.0:1713481296.789938:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.789941:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007877a880/0xdfc0fb148a3b09c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4982d expref: 2041 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.789944:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882488512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3639us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.789944:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563222 00000100:00100000:0.0:1713481296.789953:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820401 00000100:00100000:1.0:1713481296.789957:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.789962:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784519552 00010000:00010000:3.0:1713481296.789963:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007877a880, rc 0) 00000100:00100000:2.0:1713481296.789965:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784519552 00000100:00100000:0.0:1713481296.789968:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491072 00000100:00100000:0.0:1713481296.789970:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491072 00000100:00100000:1.0:1713481296.789974:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.789981:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2041:18678:x1796714882491648:12345-192.168.202.24@tcp:101:rm.0 Request processed in 218us (420us total) trans 4295107603 rc 301/301 00000100:00100000:0.0:1713481296.789983:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491136 00000100:00100000:0.0:1713481296.789985:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491136 00000100:00100000:2.0:1713481296.789987:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491008 00000100:00100000:3.0:1713481296.789988:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485854 00000100:00100000:1.0:1713481296.789989:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563246 00000100:00100000:2.0:1713481296.789989:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491008 00000100:00100000:1.0:1713481296.789992:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+197:3493:x1796714784519552:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.789995:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98368 00000100:00100000:0.0:1713481296.789999:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2042:1957:x1796714882491072:12345-192.168.202.24@tcp:103:mrename.0 00002000:00080000:1.0:1713481296.790001:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10011 count 1 00000100:00100000:2.0:1713481296.790004:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563247 00010000:00010000:0.0:1713481296.790005:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.790009:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.790009:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:18792:x1796714882491008:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.790014:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e18dd40/0xdfc0fb148a3aec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49754 expref: 2041 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790016:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880079609b00/0xdfc0fb148802dda lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d20 expref: 20776 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.790016:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.790018:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98369 00010000:00010000:1.0:1713481296.790019:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.790020:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.790022:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 4/0,1 mode: --/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.790023:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2040:1957:x1796714882491136:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:0.0:1713481296.790025:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88008bd1de00) 00010000:00010000:2.0:1713481296.790026:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3b0b1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc51b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4980a expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790031:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880079609b00/0xdfc0fb148802dda lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d20 expref: 20776 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.790031:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.790033:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.790036:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880079609b00/0xdfc0fb148802dda lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d20 expref: 20776 pid: 9202 timeout: 815 lvb_type: 1 00002000:00010000:2.0:1713481296.790037:0:16523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc51b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.790041:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079709500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784519616:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.790045:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2040:1957:x1796714882491072:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 44us (85us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.790045:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013300fa80/0xdfc0fb148a3ad62 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c92:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa496e4 expref: 2040 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.790046:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.790047:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.790051:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98368 00010000:00010000:2.0:1713481296.790051:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3b0b1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4980a expref: 20777 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.790052:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3ee40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.790061:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a58c0/0xdfc0fb148a3b0b1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4980a expref: 20777 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.790061:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c92:0x0].0x0 (ffff88008bd1da00) 00010000:00010000:2.0:1713481296.790068:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2a58c0, rc 0) 00010000:00010000:3.0:1713481296.790071:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.790082:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:18792:x1796714882491008:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.790088:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563247 00000100:00100000:3.0:1713481296.790089:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:1957:x1796714882491136:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.790093:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.790095:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98369 00000100:00100000:1.0:1713481296.790110:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491264 00000100:00100000:1.0:1713481296.790112:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491264 00000100:00100000:0.0:1713481296.790138:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.790138:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a1dc00/2, rc 0, transno 1073564 00000100:00100000:1.0:1713481296.790143:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26107 00000100:00100000:2.0:1713481296.790145:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784516928:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.790146:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18917:x1796714882491264:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.790147:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.790154:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.790155:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790159:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.790161:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491328 00000100:00100000:2.0:1713481296.790163:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491328 00010000:00010000:1.0:1713481296.790167:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007877a640/0xdfc0fb148a3afbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497c4 expref: 2204 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.790168:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.790169:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.790175:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.790177:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491456 00000100:00100000:2.0:1713481296.790178:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491456 00010000:00010000:1.0:1713481296.790179:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88009c8eea00) 00000100:00100000:0.0:1713481296.790181:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563248 00010000:00010000:3.0:1713481296.790183:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.790185:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:15045:x1796714882491328:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.790186:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.790188:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563249 00010000:00010000:3.0:1713481296.790189:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078779b00 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.790191:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:17924:x1796714882491456:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.790191:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.790192:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.790196:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.790197:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.790199:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790201:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.790202:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084066d00/0xdfc0fb148a3b0bf lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49811 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.790202:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0d1b00/0xdfc0fb148a3b0c6 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4981f expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790205:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.790212:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.790215:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081e52400/0xdfc0fb148a15fda lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39836 expref: 20778 pid: 16494 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.790218:0:16509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.790218:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.790219:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.790220:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.790220:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880078779b00/0xdfc0fb148a3af7d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.790221:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d1b00/0xdfc0fb148a3b0c6 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4981f expref: 20778 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790224:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.790227:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.790228:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.790229:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.790231:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081e52400/0xdfc0fb148a15fda lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39836 expref: 20778 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.790233:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084066d00/0xdfc0fb148a3b0bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49811 expref: 24480 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.790235:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079709f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784519680:0@lo:101:mdt_io00_014.0 00010000:00010000:2.0:1713481296.790235:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081e52400/0xdfc0fb148a15fda lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39836 expref: 20778 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.790241:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084066d00/0xdfc0fb148a3b0bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49811 expref: 24480 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.790241:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784519744:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.790249:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084066d00, rc 0) 00000100:00100000:1.0:1713481296.790251:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.790253:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.790260:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:15045:x1796714882491328:12345-192.168.202.24@tcp:101:dd.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.790262:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.790265:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563248 00000100:00100000:2.0:1713481296.790271:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784519680 00000100:00100000:2.0:1713481296.790273:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784519680 00000100:00100000:1.0:1713481296.790283:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784519808:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.790288:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82916 00000100:00100000:2.0:1713481296.790291:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+33:15793:x1796714784519680:12345-0@lo:101:mdt_io00_014.0 00000100:00100000:1.0:1713481296.790295:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.790296:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.790302:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b0d4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b0cd expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.790311:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b0d4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b0cd expref: 34 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.790320:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b0d4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b0cd expref: 34 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.790324:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:2.0:1713481296.790325:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.790327:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bae9680, rc 0) 00000100:00100000:2.0:1713481296.790346:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+34:15793:x1796714784519680:12345-0@lo:101:mdt_io00_014.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.790349:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82916 00000100:00100000:1.0:1713481296.790370:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079709f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784519680:0@lo:101:mdt_io00_014.0 00000100:00100000:0.0:1713481296.790377:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.790378:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790385:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.790388:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007836f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+198:3492:x1796714784516864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5851us (5898us total) trans 4296040861 rc 0/0 00000100:00100000:0.0:1713481296.790394:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784519808 00000100:00100000:3.0:1713481296.790396:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563221 00000100:00100000:0.0:1713481296.790397:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784519808 00000004:00080000:1.0:1713481296.790406:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:0.0:1713481296.790412:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563250 00000100:00100000:0.0:1713481296.790416:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+198:3493:x1796714784519808:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.790420:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.790426:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT0 00002000:00080000:0.0:1713481296.790427:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10012 count 1 00010000:00010000:3.0:1713481296.790430:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790432:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.790438:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.790438:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.790441:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784519872:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.790445:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.790448:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088156ac0/0xdfc0fb148802de1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d2e expref: 20778 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.790452:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.790453:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.790455:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.790457:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.790458:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.790460:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.790462:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078779f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.790465:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.790469:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.790471:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.790473:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088156ac0/0xdfc0fb148802de1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d2e expref: 20778 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.790482:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088156ac0/0xdfc0fb148802de1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d2e expref: 20778 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.790482:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.790486:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120112a00/2, rc 0, transno 1073565 00010000:00010000:3.0:1713481296.790488:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880078779f80/0xdfc0fb148a3af76 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.790490:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784516864:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.790491:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784519936:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.790507:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.790513:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491392 00000100:00100000:1.0:1713481296.790515:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491392 00000100:00100000:0.0:1713481296.790519:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.790526:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784520000:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.790529:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491520 00000100:00100000:1.0:1713481296.790530:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491520 00000100:00100000:1.0:1713481296.790540:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485855 00000100:00100000:1.0:1713481296.790543:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:18884:x1796714882491392:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:0.0:1713481296.790545:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.790556:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.790564:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b0e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49818 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.790572:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520000 00000100:00100000:0.0:1713481296.790574:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520000 00000100:00100000:0.0:1713481296.790591:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563251 00000100:00100000:0.0:1713481296.790594:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+200:3491:x1796714784520000:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.790605:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10013 count 1 00010000:00010000:1.0:1713481296.790608:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.790615:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790617:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790623:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.790626:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca22ac0/0xdfc0fb148802de8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d3c expref: 20778 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.790628:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+200:3493:x1796714784516736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6339us (6390us total) trans 4296040862 rc 0/0 00010000:00010000:0.0:1713481296.790632:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.790632:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.790633:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.790634:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563220 00010000:00010000:0.0:1713481296.790636:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790638:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790643:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.790652:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca22ac0/0xdfc0fb148802de8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d3c expref: 20778 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.790659:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca22ac0/0xdfc0fb148802de8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d3c expref: 20778 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.790676:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cc6c0/0xdfc0fb148a3b105 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.790679:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485856 00010000:00010000:1.0:1713481296.790682:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cc6c0/0xdfc0fb148a3b105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.790683:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784520064:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.790685:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2038:18967:x1796714882491520:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1713481296.790687:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cc6c0/0xdfc0fb148a3b105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.790695:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:1.0:1713481296.790698:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cc6c0/0xdfc0fb148a3b105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.790699:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc49cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.790703:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007877b180/0xdfc0fb148a3b10c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49826 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790704:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790707:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790711:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790714:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790716:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bbf180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.790718:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790721:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790725:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.790727:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.790728:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790731:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b0f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790738:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790741:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790743:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790746:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801207cdb00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.790748:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790751:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790754:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x32 (ffff880091ae1c00) 00010000:00010000:1.0:1713481296.790756:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.790757:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.790760:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b0fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.790769:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009b806f40/0xdfc0fb148a3b113 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2ca1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.790777:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009b806f40/0xdfc0fb148a3b113 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2ca1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.790785:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009b806f40/0xdfc0fb148a3b113 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2ca1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.790786:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b0e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49818 expref: 2798 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790793:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cc6c0/0xdfc0fb148a3b105 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49818 expref: 2797 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.790796:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880083968200) 00010000:00010000:1.0:1713481296.790797:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.790798:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207cc6c0, rc 0) 00000004:00200000:3.0:1713481296.790804:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2ca1:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.790806:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713481296.790810:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:18884:x1796714882491392:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 266us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.790814:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485855 00000004:00010000:3.0:1713481296.790815:0:15484:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009b806f40/0xdfc0fb148a3b113 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2ca1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:3.0:1713481296.790839:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007877b180/0xdfc0fb148a3b10c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49826 expref: 2040 pid: 15484 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.790845:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012015c700/2, rc 0, transno 1073566 00000100:00100000:1.0:1713481296.790851:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012015c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784516736:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.790859:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009b806f40/0xdfc0fb148a3b113 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2ca1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49826 expref: 2039 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.790865:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca1:0x0].0x0 (ffff880120760000) 00010000:00010000:3.0:1713481296.790868:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.790871:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b806f40, rc 0) 00000100:00100000:0.0:1713481296.790880:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784520128:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.790891:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2039:18967:x1796714882491520:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 206us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.790897:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485856 00000100:00100000:0.0:1713481296.790906:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.790941:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520128 00000100:00100000:0.0:1713481296.790944:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520128 00000100:00100000:0.0:1713481296.790972:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563252 00000100:00100000:0.0:1713481296.790977:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+200:3491:x1796714784520128:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.790987:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10014 count 1 00010000:00010000:0.0:1713481296.790997:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.791006:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008214cfc0/0xdfc0fb148802def lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d4a expref: 20778 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.791011:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.791013:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.791015:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.791032:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008214cfc0/0xdfc0fb148802def lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d4a expref: 20778 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.791039:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008214cfc0/0xdfc0fb148802def lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d4a expref: 20778 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.791047:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784520192:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.791060:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b21f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.791176:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.791575:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784519872 00000100:00100000:2.0:1713481296.791579:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784519872 00000100:00100000:2.0:1713481296.791598:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82917 00000100:00100000:2.0:1713481296.791603:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+34:15793:x1796714784519872:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:2.0:1713481296.791610:0:15522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.791619:0:15522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3b121 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b0db expref: -99 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.791633:0:15522:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3b121 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b0db expref: 35 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.791642:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3b121 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b0db expref: 35 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.791648:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff880092a12600) 00010000:00010000:2.0:1713481296.791650:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.791652:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013300e1c0, rc 0) 00000100:00100000:2.0:1713481296.791725:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784519872:12345-0@lo:101:mdt_io00_014.0 Request processed in 120us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.791730:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82917 00000100:00100000:0.0:1713481296.791733:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a88a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784517632:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.791748:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.791748:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784519872:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.791757:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.791762:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.791762:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784517568:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.791766:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20778:1960:x1796714882489408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5125us (5163us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.791772:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820403 00000004:00080000:1.0:1713481296.791775:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:2.0:1713481296.791785:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.791792:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520256:0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.791813:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.791821:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.791833:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520256 00000100:00100000:2.0:1713481296.791836:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520256 00000001:00080000:3.0:1713481296.791850:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040842 00000100:00100000:2.0:1713481296.791853:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82918 00000100:00100000:2.0:1713481296.791857:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091227850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784520256:12345-0@lo:1000:mdt_io00_014.0 00000100:00100000:2.0:1713481296.791918:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091227850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784520256:12345-0@lo:1000:mdt_io00_014.0 Request processed in 60us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.791925:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82918 00000100:00100000:1.0:1713481296.791930:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520256:0@lo:1000:mdt_io00_014.0 00002000:00080000:3.0:1713481296.791953:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57042 00000100:00100000:1.0:1713481296.791963:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520320:0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.791976:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.791984:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.791997:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784517824:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.792013:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.792024:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520320 00000100:00100000:1.0:1713481296.792026:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520320 00000100:00100000:1.0:1713481296.792039:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82919 00000100:00100000:0.0:1713481296.792041:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.792042:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784520320:12345-0@lo:1000:mdt_io00_014.0 00000100:00100000:3.0:1713481296.792096:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784518016:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.792101:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784520320:12345-0@lo:1000:mdt_io00_014.0 Request processed in 58us (123us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.792106:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82919 00000100:00100000:0.0:1713481296.792136:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.792146:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784517888:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.792146:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.792151:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491840 00000100:00100000:0.0:1713481296.792154:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491840 00010000:00010000:1.0:1713481296.792158:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792164:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090599200/0xdfc0fb1486890c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2da9 expref: 26866 pid: 16546 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.792172:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784518208:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.792177:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820423 00000100:00100000:0.0:1713481296.792180:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26866:1959:x1796714882491840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.792182:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081d77600/0xdfc0fb148a3b033 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e0 expref: 16894 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792184:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.792187:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090599200/0xdfc0fb1486890c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2da9 expref: 26866 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.792189:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081d77600, rc 0) 00010000:00010000:0.0:1713481296.792193:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090599200/0xdfc0fb1486890c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2da9 expref: 26866 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.792203:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090599200/0xdfc0fb1486890c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2da9 expref: 26866 pid: 16546 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.792203:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16894:18836:x1796714882489792:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4424us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.792207:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563235 00000100:00100000:1.0:1713481296.792220:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491712 00000100:00100000:1.0:1713481296.792221:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491712 00000100:00100000:1.0:1713481296.792231:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563253 00000100:00100000:1.0:1713481296.792233:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16894:17009:x1796714882491712:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.792238:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.792244:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801207ccb40/0xdfc0fb148a3b128 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49834 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.792251:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.792258:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.792259:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.792261:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801207ccb40/0xdfc0fb148a3b128 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49834 expref: 16895 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792267:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801207ccb40/0xdfc0fb148a3b128 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49834 expref: 16895 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792270:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.792271:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.792272:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207ccb40, rc 0) 00010000:00010000:0.0:1713481296.792273:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792278:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.792280:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:17009:x1796714882491712:12345-192.168.202.24@tcp:101:dd.0 Request processed in 46us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.792284:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563253 00010000:00010000:0.0:1713481296.792292:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.792298:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792302:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792306:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792310:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792313:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792317:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d758c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.792318:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792322:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792333:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792337:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081d758c0/0xdfc0fb148a3afed lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.792345:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26865:1959:x1796714882491840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 163us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.792350:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820423 00000100:00100000:0.0:1713481296.792377:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.792390:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491904 00000100:00100000:0.0:1713481296.792392:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491904 00010000:00010000:0.0:1713481296.792399:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092f33cc0/0xdfc0fb1486890c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2db7 expref: 26865 pid: 16456 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.792408:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820424 00000100:00100000:0.0:1713481296.792411:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26865:1959:x1796714882491904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.792415:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.792417:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092f33cc0/0xdfc0fb1486890c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2db7 expref: 26865 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.792422:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092f33cc0/0xdfc0fb1486890c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2db7 expref: 26865 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.792432:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f33cc0/0xdfc0fb1486890c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2db7 expref: 26865 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.792440:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.792441:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.792442:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792447:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792458:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.792460:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2797:3493:x1796714784517696:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5565us (5670us total) trans 4295960738 rc 0/0 00000100:00100000:1.0:1713481296.792464:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563230 00000100:00100000:0.0:1713481296.792469:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26864:1959:x1796714882491904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.792472:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820424 00000004:00080000:1.0:1713481296.792490:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a15f80/2, rc 0, transno 993442 00000100:00100000:1.0:1713481296.792494:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784517696:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.792503:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792508:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792513:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.792516:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.792519:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.792523:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491776 00000100:00100000:0.0:1713481296.792525:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491776 00010000:00010000:1.0:1713481296.792525:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792532:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092f33840/0xdfc0fb1486890b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d9b expref: 26864 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.792535:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d77180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.792537:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792543:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.792544:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820425 00000100:00100000:0.0:1713481296.792546:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26864:1959:x1796714882491776:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.792550:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.792552:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092f33840/0xdfc0fb1486890b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d9b expref: 26864 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.792557:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092f33840/0xdfc0fb1486890b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d9b expref: 26864 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.792558:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.792565:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081d77180/0xdfc0fb148a3aff4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792566:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f33840/0xdfc0fb1486890b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2d9b expref: 26864 pid: 16456 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.792572:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.792573:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.792575:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792579:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792592:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.792605:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:1959:x1796714882491776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.792610:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820425 00010000:00010000:0.0:1713481296.792631:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792638:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792645:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792651:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792657:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792676:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091795440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.792679:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.792679:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2797:3490:x1796714784517760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5672us (5839us total) trans 4295960739 rc 0/0 00000100:00100000:1.0:1713481296.792685:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563231 00010000:00010000:0.0:1713481296.792686:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792699:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792705:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091795440/0xdfc0fb148a3afe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.792716:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784520384:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.792730:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.792755:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520320:0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.792783:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520448:0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.792794:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.792801:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.792814:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520448 00000100:00100000:1.0:1713481296.792816:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520448 00000100:00100000:0.0:1713481296.792818:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2797:3493:x1796714784517440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6411us (6477us total) trans 4295960740 rc 0/0 00000100:00100000:0.0:1713481296.792823:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563229 00000100:00100000:1.0:1713481296.792827:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82920 00000100:00100000:1.0:1713481296.792830:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784520448:12345-0@lo:1000:mdt_io00_014.0 00000100:00100000:0.0:1713481296.792837:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520384 00000100:00100000:0.0:1713481296.792840:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520384 00000100:00100000:0.0:1713481296.792854:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563254 00000100:00100000:0.0:1713481296.792857:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2797:3492:x1796714784520384:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.792864:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43403 count 1 00000100:00100000:1.0:1713481296.792864:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784520448:12345-0@lo:1000:mdt_io00_014.0 Request processed in 34us (69us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.792868:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82920 00010000:00010000:0.0:1713481296.792872:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.792879:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801349e1d40/0xdfc0fb14868910d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e12 expref: 26862 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.792883:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.792884:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.792886:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.792889:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a14700/2, rc 0, transno 993444 00000100:00100000:1.0:1713481296.792893:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784517440:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.792895:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801349e1d40/0xdfc0fb14868910d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e12 expref: 26862 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.792900:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801349e1d40/0xdfc0fb14868910d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e12 expref: 26862 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.792905:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784520512:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.792910:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.792913:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784520576:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.792919:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134e21540 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.792924:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713481296.792935:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a14a80/2, rc 0, transno 993443 00000100:00100000:0.0:1713481296.792940:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784517760:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.792947:0:16525:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520576 00000100:00100000:3.0:1713481296.792951:0:16525:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520576 00000100:00100000:1.0:1713481296.792959:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520448:0@lo:1000:mdt_io00_014.0 00000100:00100000:0.0:1713481296.792960:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784520640:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.792972:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.792972:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563255 00000100:00100000:3.0:1713481296.792977:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2798:3492:x1796714784520576:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.792987:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00002000:00080000:3.0:1713481296.792990:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43405 count 1 00010000:00010000:1.0:1713481296.792991:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.792992:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520640 00000100:00100000:0.0:1713481296.792994:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520640 00010000:00010000:1.0:1713481296.792995:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT0 00000100:00100000:1.0:1713481296.793001:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079709f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520704:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.793002:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.793007:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563256 00000100:00100000:0.0:1713481296.793010:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2799:3490:x1796714784520640:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.793013:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.793013:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b6400/0xdfc0fb148689114 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e20 expref: 26862 pid: 16494 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713481296.793017:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43407 count 1 00010000:00010000:3.0:1713481296.793019:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.793020:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cdb09c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.793021:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.793024:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793024:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.793026:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520704 00000100:00100000:2.0:1713481296.793029:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520704 00010000:00010000:0.0:1713481296.793031:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b6ac0/0xdfc0fb14868914c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e2e expref: 26862 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.793035:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.793036:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.793037:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793041:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b6400/0xdfc0fb148689114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e20 expref: 26862 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.793047:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b6ac0/0xdfc0fb14868914c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e2e expref: 26862 pid: 16453 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.793049:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82921 00010000:00010000:0.0:1713481296.793052:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800922b6ac0/0xdfc0fb14868914c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e2e expref: 26862 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.793052:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784520704:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.793056:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800922b6400/0xdfc0fb148689114 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e20 expref: 26862 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.793057:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784520832:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.793057:0:15522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.793061:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.793065:0:15522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013300c480/0xdfc0fb148a3b14b lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b136 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.793067:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784520768:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.793070:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.793072:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.793074:0:15522:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013300c480/0xdfc0fb148a3b14b lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b136 expref: 36 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793080:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013300c480/0xdfc0fb148a3b14b lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b136 expref: 36 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.793081:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882491968 00000100:00100000:0.0:1713481296.793084:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882491968 00010000:00010000:2.0:1713481296.793084:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c92:0x0].0x0 (ffff88009e7ffe00) 00010000:00010000:2.0:1713481296.793086:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1713481296.793087:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013300c480, rc 0) 00010000:00010000:0.0:1713481296.793094:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880079608480/0xdfc0fb148802dbe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ce8 expref: 20778 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.793094:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.793114:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492032 00000100:00100000:2.0:1713481296.793114:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+36:15793:x1796714784520704:12345-0@lo:101:mdt_io00_014.0 Request processed in 61us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.793116:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492032 00000100:00100000:2.0:1713481296.793117:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82921 00000100:00100000:1.0:1713481296.793131:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079709f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520704:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.793139:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793146:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801349e2f40/0xdfc0fb1486890ce lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa981:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dc5 expref: 26863 pid: 16535 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.793148:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.793153:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:16520:1796714784518400:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.793153:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820426 00000100:00100000:3.0:1713481296.793159:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4b67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20778:1959:x1796714882491968:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.793161:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x2c92:0x0] 00010000:00010000:2.0:1713481296.793163:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.793168:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820427 00010000:00010000:3.0:1713481296.793169:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.793170:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.793172:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:1959:x1796714882492032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.793174:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.793174:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880079608480/0xdfc0fb148802dbe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ce8 expref: 20778 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.793176:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882490176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4873us (5140us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.793178:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.793179:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.793180:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820413 00010000:00010000:0.0:1713481296.793184:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801349e2f40/0xdfc0fb1486890ce lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa981:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dc5 expref: 26863 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.793184:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520896:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.793185:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880079608480/0xdfc0fb148802dbe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ce8 expref: 20778 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.793193:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801349e2f40/0xdfc0fb1486890ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa981:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dc5 expref: 26863 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.793202:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784518272:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.793203:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.793206:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079608480/0xdfc0fb148802dbe lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ce8 expref: 20778 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.793210:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.793211:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.793213:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793213:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cdb09c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.793214:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133a7c900/0xdfc0fb148a3b03a lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e7 expref: 20777 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793220:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793221:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133a7c900, rc 0) 00010000:00010000:3.0:1713481296.793223:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.793225:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.793227:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520896 00010000:00010000:3.0:1713481296.793228:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793230:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520896 00000100:00100000:2.0:1713481296.793230:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:10479:x1796714882489856:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5318us (5354us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.793233:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.793234:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563236 00010000:00010000:3.0:1713481296.793236:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.793247:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:1959:x1796714882492032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.793247:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82922 00000100:00100000:1.0:1713481296.793251:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+36:15793:x1796714784520896:12345-0@lo:101:mdt_io00_014.0 00000100:00100000:0.0:1713481296.793253:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820427 00010000:00010000:2.0:1713481296.793253:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801349e2f40/0xdfc0fb1486890ce lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa981:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dc5 expref: 26863 pid: 16535 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.793256:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.793257:0:15522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.793263:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784518144:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.793267:0:15522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cd200/0xdfc0fb148a3b159 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b152 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.793272:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4b67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:1959:x1796714882491968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 112us (210us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.793278:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793279:0:15522:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cd200/0xdfc0fb148a3b159 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b152 expref: 37 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.793279:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820426 00010000:00010000:2.0:1713481296.793286:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793287:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cd200/0xdfc0fb148a3b159 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b152 expref: 37 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793290:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793294:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.793296:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784518336:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.793297:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793298:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880096fd6a00) 00010000:00010000:1.0:1713481296.793300:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.793301:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793302:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207cd200, rc 0) 00010000:00010000:2.0:1713481296.793304:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800917961c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.793304:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793306:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793309:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793310:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.793312:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793318:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793320:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793322:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800917961c0/0xdfc0fb148a3b02c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.793323:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078410700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1960:x1796714882490048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5132us (5386us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.793326:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+37:15793:x1796714784520896:12345-0@lo:101:mdt_io00_014.0 Request processed in 75us (124us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.793326:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793330:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82922 00000100:00100000:0.0:1713481296.793331:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820410 00010000:00010000:3.0:1713481296.793333:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793338:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078778fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.793341:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793347:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793356:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520896:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.793363:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793365:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793368:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793372:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880078778fc0/0xdfc0fb148a3b017 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793380:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793384:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793388:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:1.0:1713481296.793404:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520960:0@lo:1000:mdt_io00_014.0 00000100:00100000:1.0:1713481296.793420:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.793422:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2800:3493:x1796714784518080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5915us (5959us total) trans 4295960741 rc 0/0 00000100:00100000:1.0:1713481296.793426:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b98900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.793426:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563234 00000004:00080000:1.0:1713481296.793441:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a16a00/2, rc 0, transno 993445 00000100:00100000:1.0:1713481296.793452:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784518080:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.793461:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784520960 00000100:00100000:1.0:1713481296.793463:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784520960 00000100:00100000:1.0:1713481296.793473:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82923 00000100:00100000:0.0:1713481296.793475:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713481296.793475:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+37:15793:x1796714784520960:12345-0@lo:1000:mdt_io00_014.0 00000100:00100000:0.0:1713481296.793482:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784521024:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.793507:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.793518:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+202:3491:x1796714784517952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6163us (6236us total) trans 4296040864 rc 0/0 00000100:00100000:1.0:1713481296.793524:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+37:15793:x1796714784520960:12345-0@lo:1000:mdt_io00_014.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.793525:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563233 00000100:00100000:2.0:1713481296.793527:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784521024 00000100:00100000:1.0:1713481296.793528:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82923 00000100:00100000:2.0:1713481296.793531:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784521024 00000004:00080000:0.0:1713481296.793542:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a15c00/2, rc 0, transno 1073568 00000100:00100000:0.0:1713481296.793546:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784517952:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.793548:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784520960:0@lo:1000:mdt_io00_014.0 00000100:00100000:2.0:1713481296.793549:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563257 00000100:00100000:2.0:1713481296.793553:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2800:3490:x1796714784521024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.793564:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43409 count 1 00010000:00010000:2.0:1713481296.793575:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793584:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013464f180/0xdfc0fb148689153 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e3c expref: 26861 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.793590:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.793591:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.793594:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793599:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793604:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793607:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793610:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801207ccd80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.793610:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013464f180/0xdfc0fb148689153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e3c expref: 26861 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.793611:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793614:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793619:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880099d83a00) 00010000:00010000:2.0:1713481296.793619:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013464f180/0xdfc0fb148689153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e3c expref: 26861 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.793621:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.793622:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793625:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ccd80/0xdfc0fb148a3b160 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.793628:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784521152:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.793640:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793645:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793648:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.793649:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f5ae40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.793662:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1713481296.793675:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x2c92:0x0] 00010000:00010000:1.0:1713481296.793677:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793680:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793680:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.793684:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793686:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793692:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713481296.793692:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801207cfcc0 already unused, calling callback (ffffffffa0efd520) 00000004:00080000:1.0:1713481296.793695:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:2.0:1713481296.793696:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793697:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793700:0:15565:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.793700:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793703:0:15565:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.793703:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793704:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793708:0:15565:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801207cc240 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:0.0:1713481296.793710:0:15565:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793710:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1713481296.793711:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:1.0:1713481296.793713:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.793715:0:15565:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793717:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793720:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793722:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793726:0:15565:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793726:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1713481296.793727:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.793727:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713481296.793729:0:15565:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.793730:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793733:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.793733:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793735:0:15565:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 1/0,0 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793735:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800930a4d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.793737:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.793739:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cfcc0/0xdfc0fb148a3b152 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b159 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793740:0:15565:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801207cc240/0xdfc0fb148a3b136 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b14b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.793740:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793744:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880133a00900) 00010000:00010000:1.0:1713481296.793745:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.793747:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.793749:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b0b8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.793754:0:15565:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1713481296.793756:0:15565:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793759:0:15565:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800930a7180 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:0.0:1713481296.793761:0:15565:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793761:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:0.0:1713481296.793764:0:15565:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793764:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793769:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800922e4000 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:0.0:1713481296.793770:0:15565:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793772:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793773:0:15565:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713481296.793776:0:15565:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793778:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18917:x1796714882491264:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 3631us (3686us total) trans 0 rc -39/-39 00010000:00010000:0.0:1713481296.793779:0:15565:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800930a7180/0xdfc0fb148a3b0cd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b0d4 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793782:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26107 00000004:00010000:2.0:1713481296.793783:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793792:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.793792:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.793797:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793802:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.793806:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 1/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793812:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800922e4000/0xdfc0fb148a3b0db lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b121 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793814:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784521088:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.793826:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.793827:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.793827:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.793829:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.793834:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.793837:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784521408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.793842:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784521088 00000100:00100000:3.0:1713481296.793845:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784521088 00000100:00100000:1.0:1713481296.793846:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.793851:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.793853:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.793855:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784521216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.793856:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.793862:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.793864:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563258 00000100:00100000:0.0:1713481296.793865:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784521280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.793869:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+202:3492:x1796714784521088:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.793878:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784521408 00002000:00080000:3.0:1713481296.793880:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10015 count 1 00000100:00100000:2.0:1713481296.793882:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784521408 00000100:00100000:1.0:1713481296.793885:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.793891:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.793892:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796714784521344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.793894:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.793901:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784521216 00010000:00010000:3.0:1713481296.793901:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007960ad00/0xdfc0fb148802df6 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d58 expref: 20775 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.793903:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784521216 00010000:00010000:3.0:1713481296.793907:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.793908:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.793910:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.793910:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793916:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784521280 00000100:00100000:2.0:1713481296.793916:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492160 00000100:00100000:2.0:1713481296.793918:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492160 00000100:00100000:1.0:1713481296.793919:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784521280 00010000:00010000:3.0:1713481296.793926:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007960ad00/0xdfc0fb148802df6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d58 expref: 20776 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.793928:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801320b9440/0xdfc0fb148916dad lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6584 expref: 20776 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.793938:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784521344 00000100:00100000:1.0:1713481296.793939:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784521344 00010000:00010000:3.0:1713481296.793943:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007960ad00/0xdfc0fb148802df6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d58 expref: 20776 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.793944:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820428 00000100:00100000:2.0:1713481296.793948:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:1960:x1796714882492160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.793950:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98370 00000100:00100000:3.0:1713481296.793952:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784521472:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.793953:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98371 00010000:00010000:2.0:1713481296.793953:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.793954:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0000-mdtlov_UUID+40:3492:x1796714784521408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.793956:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+40:3492:x1796714784521216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.793961:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.793961:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801320b9440/0xdfc0fb148916dad lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6584 expref: 20776 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.793962:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.793967:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cd200/0xdfc0fb148a3b159 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b152 expref: 40 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.793967:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801320b9440/0xdfc0fb148916dad lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6584 expref: 20776 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.793970:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98372 00010000:00010000:0.0:1713481296.793971:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013300e1c0/0xdfc0fb148a3b121 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b0db expref: 40 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.793975:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000-mdtlov_UUID+39:3490:x1796714784521280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.793977:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff880096fd6a00) 00010000:00010000:2.0:1713481296.793978:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801320b9440/0xdfc0fb148916dad lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6584 expref: 20776 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.793982:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.793983:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.793985:0:16582:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff880092a12600) 00010000:00010000:2.0:1713481296.793985:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.793986:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.793988:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133a7c900/0xdfc0fb148a3b03a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e7 expref: 20775 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.793993:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.793993:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133a7c900/0xdfc0fb148a3b03a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e7 expref: 20775 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.793994:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013300c480/0xdfc0fb148a3b14b lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c92:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b136 expref: 38 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.793998:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+38:3492:x1796714784521216:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.794004:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98371 00010000:00010000:2.0:1713481296.794007:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133a7c900/0xdfc0fb148a3b03a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e7 expref: 20775 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.794008:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c92:0x0].0x0 (ffff88009e7ffe00) 00000100:00100000:2.0:1713481296.794012:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784521536:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.794018:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0000-mdtlov_UUID+36:3492:x1796714784521408:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (169us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.794019:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.794020:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98373 00000100:00100000:1.0:1713481296.794022:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+36:3491:x1796714784521344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.794023:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98370 00000100:00100000:2.0:1713481296.794026:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124c6b540 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.794027:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.794032:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b0d4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b0cd expref: 36 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.794040:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.794042:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.794056:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000-mdtlov_UUID+34:3490:x1796714784521280:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.794063:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98372 00000100:00100000:1.0:1713481296.794065:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+34:3491:x1796714784521344:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.794070:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98373 00000100:00100000:1.0:1713481296.794097:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784521280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.794108:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.794138:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784521216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.794141:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796714784521344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.794143:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784521408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.794194:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.794211:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492096 00000100:00100000:2.0:1713481296.794213:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492096 00010000:00010000:2.0:1713481296.794222:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960b9200/0xdfc0fb14891eb36 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb64a expref: 20776 pid: 16504 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.794232:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820429 00000100:00100000:2.0:1713481296.794235:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:1960:x1796714882492096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.794240:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.794242:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960b9200/0xdfc0fb14891eb36 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb64a expref: 20776 pid: 16504 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.794247:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960b9200/0xdfc0fb14891eb36 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb64a expref: 20776 pid: 16504 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.794259:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960b9200/0xdfc0fb14891eb36 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb64a expref: 20776 pid: 16504 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.794264:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.794265:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.794267:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081d77600/0xdfc0fb148a3b033 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e0 expref: 16894 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.794270:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784518464:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.794272:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081d77600/0xdfc0fb148a3b033 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e0 expref: 16894 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.794282:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880081d77600/0xdfc0fb148a3b033 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8060:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa497e0 expref: 16894 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.794285:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.794287:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784521600:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.794302:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784518528:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.794306:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095df8540 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.794310:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4019450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16894:1959:x1796714882490240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5970us (6254us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.794311:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784518656:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.794317:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820415 00010000:00010000:3.0:1713481296.794320:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.794328:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.794338:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800823a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1960:x1796714882490432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5928us (6265us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.794345:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820417 00000100:00100000:1.0:1713481296.794464:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784518912:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.794480:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.794591:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.794613:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492224 00000100:00100000:2.0:1713481296.794617:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492224 00000100:00100000:1.0:1713481296.794618:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784519104:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.794628:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.794632:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.794635:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492416 00000100:00100000:2.0:1713481296.794638:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492416 00000100:00100000:3.0:1713481296.794647:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784519232:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.794649:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784519296:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.794653:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563259 00000100:00100000:2.0:1713481296.794657:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16894:18817:x1796714882492224:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.794677:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.794679:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.794680:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.794687:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148a3b175 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4983b expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.794694:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784519936:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.794695:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563260 00000100:00100000:1.0:1713481296.794699:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:10409:x1796714882492416:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.794701:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973dcfc0/0xdfc0fb1489cfc1b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa222dc expref: 20775 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.794704:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.794705:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.794706:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.794708:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148a3b175 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4983b expref: 16895 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.794710:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207cc900/0xdfc0fb148a3b17c lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49842 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.794717:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd2aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784519360:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.794719:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800973dcfc0/0xdfc0fb1489cfc1b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa222dc expref: 20775 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.794720:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096bac6c0/0xdfc0fb14891d166 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca708 expref: 24478 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.794725:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800973dcfc0/0xdfc0fb1489cfc1b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa222dc expref: 20775 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.794726:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ea5200/0xdfc0fb14893ab2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4b9 expref: 26861 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.794729:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.794730:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.794730:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784521664:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.794732:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207cc900/0xdfc0fb148a3b17c lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49842 expref: 24478 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.794737:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.794746:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098ea5200/0xdfc0fb14893ab2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4b9 expref: 26861 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.794748:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097998300 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.794751:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098ea5200/0xdfc0fb14893ab2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4b9 expref: 26861 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.794756:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:1959:x1796714882490752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5187us (5367us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.794757:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784521728:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.794759:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.794762:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820422 00000100:00100000:2.0:1713481296.794767:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784518976:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.794777:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096bac6c0/0xdfc0fb14891d166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca708 expref: 24478 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.794781:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096bac6c0/0xdfc0fb14891d166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca708 expref: 24478 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.794782:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.794786:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a3d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784521792:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.794797:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092c58300 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.794798:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784520064:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.794800:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784519744:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.794810:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d1b00/0xdfc0fb148a3b0c6 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4981f expref: 20775 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.794811:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784519488:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.794816:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d1b00, rc 0) 00010000:00010000:0.0:1713481296.794819:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.794826:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.794828:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20775:17924:x1796714882491456:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4636us (4660us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.794832:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563249 00000100:00100000:1.0:1713481296.794839:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079709500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784519616:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.794852:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.794882:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784520192:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.794892:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.794903:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493120 00010000:00010000:0.0:1713481296.794904:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.794905:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493120 00000100:00100000:1.0:1713481296.794909:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.794921:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493184 00000100:00100000:2.0:1713481296.794923:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493184 00000100:00100000:1.0:1713481296.794933:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.794937:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563261 00000100:00100000:2.0:1713481296.794940:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:11552:x1796714882493120:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.794944:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563262 00010000:00010000:2.0:1713481296.794945:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.794951:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3b183 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49849 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.794951:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:11388:x1796714882493184:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.794960:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.794961:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f801200/0xdfc0fb148959c13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebde expref: 26864 pid: 16475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.794965:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.794966:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.794968:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3b183 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49849 expref: 26864 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.794970:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148a3b18a lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49850 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.794980:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f801200/0xdfc0fb148959c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebde expref: 26865 pid: 16475 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.794985:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.794987:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f801200/0xdfc0fb148959c13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebde expref: 26865 pid: 16475 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.794987:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800794d3cc0/0xdfc0fb148942419 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03c6 expref: 24478 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.794993:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784521856:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.794994:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.794995:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.794998:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148a3b18a lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49850 expref: 26865 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.794999:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493376 00000100:00100000:0.0:1713481296.795002:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493376 00000100:00100000:1.0:1713481296.795006:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.795007:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097998c00 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.795014:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800794d3cc0/0xdfc0fb148942419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03c6 expref: 24478 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.795017:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493248 00000100:00100000:2.0:1713481296.795018:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493248 00000100:00100000:0.0:1713481296.795020:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563263 00000100:00100000:0.0:1713481296.795024:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16895:8499:x1796714882493376:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.795024:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800794d3cc0/0xdfc0fb148942419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03c6 expref: 24478 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.795028:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563264 00000100:00100000:2.0:1713481296.795031:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20775:1958:x1796714882493248:12345-192.168.202.24@tcp:2:touch.0 00010000:00010000:0.0:1713481296.795032:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.795039:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784521920:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.795041:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008495ba80/0xdfc0fb148a3b191 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4985e expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.795056:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfc9b00/0xdfc0fb1488e7eb5 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5517 expref: 16896 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.795071:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.795072:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.795089:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493312 00000100:00100000:3.0:1713481296.795090:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493440 00000100:00100000:1.0:1713481296.795091:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493312 00000100:00100000:3.0:1713481296.795094:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493440 00000100:00100000:1.0:1713481296.795108:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485857 00000100:00100000:2.0:1713481296.795108:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:1958:x1796714882493248:12345-192.168.202.24@tcp:2:touch.0 Request processed in 75us (101us total) trans 4296040865 rc 0/0 00000100:00100000:1.0:1713481296.795112:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18941:x1796714882493312:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.795112:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563264 00010000:00010000:1.0:1713481296.795117:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.795117:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485858 00010000:00010000:1.0:1713481296.795139:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cd440/0xdfc0fb148a3b198 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49857 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.795144:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2378:18884:x1796714882493440:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.795152:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.795155:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.795157:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.795161:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008495ba80/0xdfc0fb148a3b191 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4985e expref: 16896 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795162:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009b805680/0xdfc0fb148a3b19f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2be4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49865 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.795179:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfc9b00/0xdfc0fb1488e7eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5517 expref: 16896 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.795179:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795184:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.795188:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cfc9b00/0xdfc0fb1488e7eb5 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5517 expref: 16896 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.795188:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795194:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.795198:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121d8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784521984:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.795198:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795202:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.795218:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b26540 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.795221:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3b1b4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.795228:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880078201680/0xdfc0fb148a3b1bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.795229:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3b1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.795232:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078201680/0xdfc0fb148a3b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795235:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078201680/0xdfc0fb148a3b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.795236:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3b1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.795246:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00200000:1.0:1713481296.795250:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x513e:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.795252:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713481296.795258:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880078201680/0xdfc0fb148a3b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.795261:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493504 00010000:00010000:1.0:1713481296.795263:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.795264:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493504 00010000:00010000:1.0:1713481296.795266:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795270:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795273:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795275:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801207ce1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.795277:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795280:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795284:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.795285:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.795287:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000004:00200000:3.0:1713481296.795288:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2be4:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.795290:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801207ce1c0/0xdfc0fb148a3b1a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000004:00200000:3.0:1713481296.795292:0:15484:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1713481296.795301:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795303:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795306:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795309:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801207cf840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.795310:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795313:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795316:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff880099d83900) 00010000:00010000:1.0:1713481296.795317:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.795317:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009b805680/0xdfc0fb148a3b19f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49865 expref: 2380 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.795318:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.795321:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cf840/0xdfc0fb148a3b1ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.795333:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3b1b4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49865 expref: 2379 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795339:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880092a16a00) 00010000:00010000:1.0:1713481296.795342:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cd440/0xdfc0fb148a3b198 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49857 expref: 2205 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795342:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1713481296.795345:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a949f80, rc 0) 00000100:00100000:0.0:1713481296.795349:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563265 00010000:00010000:1.0:1713481296.795352:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880078201680/0xdfc0fb148a3b1bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49857 expref: 2204 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.795355:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:18792:x1796714882493504:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.795356:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x513e:0x0].0x0 (ffff880099d83100) 00010000:00010000:1.0:1713481296.795357:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.795358:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880078201680, rc 0) 00010000:00010000:0.0:1713481296.795362:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.795367:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2379:18884:x1796714882493440:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 222us (294us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.795371:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008495ad00/0xdfc0fb148a3b1c2 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc51c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4986c expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.795373:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485858 00000100:00100000:1.0:1713481296.795374:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18941:x1796714882493312:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 262us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.795378:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485857 00002000:00010000:0.0:1713481296.795382:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc51c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.795390:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.795391:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.795395:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008495ad00/0xdfc0fb148a3b1c2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4986c expref: 20777 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.795404:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008495ad00/0xdfc0fb148a3b1c2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4986c expref: 20777 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.795407:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.795411:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008495ad00, rc 0) 00000100:00100000:1.0:1713481296.795420:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.795428:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493568 00000100:00100000:0.0:1713481296.795430:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:18792:x1796714882493504:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.795432:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493568 00000100:00100000:0.0:1713481296.795437:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563265 00000100:00100000:3.0:1713481296.795449:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493632 00000100:00100000:3.0:1713481296.795451:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493632 00000100:00100000:0.0:1713481296.795456:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563266 00000100:00100000:0.0:1713481296.795460:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16897:18844:x1796714882493568:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.795466:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.795468:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563267 00000100:00100000:3.0:1713481296.795473:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26866:17935:x1796714882493632:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.795480:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.795486:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.795491:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3b1c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb796:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4987a expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.795497:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493696 00000100:00100000:1.0:1713481296.795500:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.795500:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493696 00002000:00010000:3.0:1713481296.795504:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb796:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.795510:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.795514:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.795516:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.795517:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493824 00000100:00100000:2.0:1713481296.795519:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563268 00000100:00100000:1.0:1713481296.795520:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493824 00010000:00010000:3.0:1713481296.795520:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3b1c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4987a expref: 26867 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.795524:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:15045:x1796714882493696:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.795529:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084959f80/0xdfc0fb148a3b1d0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49873 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795530:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880086bc46c0/0xdfc0fb148a3b1c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4987a expref: 26867 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.795531:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493888 00010000:00010000:2.0:1713481296.795531:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.795532:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493888 00010000:00010000:3.0:1713481296.795537:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086bc46c0, rc 0) 00002000:00010000:0.0:1713481296.795538:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.795540:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485859 00010000:00010000:2.0:1713481296.795540:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b1d7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49881 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.795543:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18967:x1796714882493824:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:0.0:1713481296.795545:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.795546:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.795549:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084959f80/0xdfc0fb148a3b1d0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49873 expref: 16898 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.795552:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.795555:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084959f80/0xdfc0fb148a3b1d0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49873 expref: 16898 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.795557:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26867:17935:x1796714882493632:12345-192.168.202.24@tcp:101:dd.0 Request processed in 83us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.795559:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084959f80, rc 0) 00010000:00010000:2.0:1713481296.795562:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.795563:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.795564:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563267 00010000:00010000:2.0:1713481296.795567:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49881 expref: 20778 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.795572:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007970bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-mdtlov_UUID:15479:1796714784522048:0@lo:1000:mdt00_015.0 00010000:00010000:2.0:1713481296.795577:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801207cdb00/0xdfc0fb148a3b1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49881 expref: 20778 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795584:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207cdb00, rc 0) 00000100:00100000:1.0:1713481296.795588:0:15479:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.795597:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485860 00000100:00100000:1.0:1713481296.795598:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a267f300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.795602:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2379:18765:x1796714882493888:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.795604:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20778:15045:x1796714882493696:12345-192.168.202.24@tcp:101:dd.0 Request processed in 80us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.795610:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563268 00010000:00010000:3.0:1713481296.795610:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.795612:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522048 00000100:00100000:1.0:1713481296.795614:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522048 00010000:00010000:3.0:1713481296.795617:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dd200/0xdfc0fb148a3b1de lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49888 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.795624:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82924 00000100:00100000:1.0:1713481296.795627:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+33:15479:x1796714784522048:12345-0@lo:1000:mdt00_015.0 00000100:00100000:0.0:1713481296.795629:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16898:18844:x1796714882493568:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 167us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.795635:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563266 00000100:00100000:1.0:1713481296.795652:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+33:15479:x1796714784522048:12345-0@lo:1000:mdt00_015.0 Request processed in 25us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.795657:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82924 00000100:00100000:0.0:1713481296.795689:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.795692:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.795698:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007970bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-mdtlov_UUID:15479:1796714784522048:0@lo:1000:mdt00_015.0 00010000:00010000:3.0:1713481296.795701:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.795707:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.795710:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.795711:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492352 00000100:00100000:2.0:1713481296.795714:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492352 00010000:00010000:3.0:1713481296.795719:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.795724:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e533c0/0xdfc0fb148802dcc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d04 expref: 20778 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.795724:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.795726:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.795730:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.795733:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007970bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-mdtlov_UUID:15479:1796714784522112:0@lo:1000:mdt00_015.0 00000100:00100000:2.0:1713481296.795742:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492544 00000100:00100000:2.0:1713481296.795743:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492544 00000100:00100000:1.0:1713481296.795746:0:15479:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.795749:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135921680/0xdfc0fb1486890e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2de1 expref: 26867 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.795750:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492672 00000100:00100000:0.0:1713481296.795753:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492672 00000100:00100000:1.0:1713481296.795753:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092c58f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.795758:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820430 00000100:00100000:2.0:1713481296.795761:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20778:1960:x1796714882492352:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.795765:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801349e2ac0/0xdfc0fb1486890ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2df6 expref: 26868 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.795765:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.795767:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820431 00010000:00010000:2.0:1713481296.795767:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e533c0/0xdfc0fb148802dcc lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d04 expref: 20778 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.795769:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e4b40/0xdfc0fb148a3b1f3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.795771:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26868:1960:x1796714882492544:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.795775:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e4b40/0xdfc0fb148a3b1f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.795776:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.795776:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e533c0/0xdfc0fb148802dcc lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d04 expref: 20778 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.795779:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820432 00010000:00010000:1.0:1713481296.795779:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135921680/0xdfc0fb1486890e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa985:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2de1 expref: 26868 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.795781:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e4b40/0xdfc0fb148a3b1f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.795782:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26868:1960:x1796714882492672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.795785:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135921680/0xdfc0fb1486890e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa985:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2de1 expref: 26868 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.795787:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.795789:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801349e2ac0/0xdfc0fb1486890ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa987:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2df6 expref: 26868 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.795789:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e533c0/0xdfc0fb148802dcc lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2719:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d04 expref: 20778 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.795795:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801349e2ac0/0xdfc0fb1486890ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa987:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2df6 expref: 26868 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.795796:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135921680/0xdfc0fb1486890e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa985:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2de1 expref: 26868 pid: 16524 timeout: 815 lvb_type: 1 00000004:00200000:3.0:1713481296.795797:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2caf:0x0]: returning size 4096 00010000:00010000:2.0:1713481296.795798:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.795799:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.795800:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.795800:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713481296.795804:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.795805:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.795805:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.795807:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713481296.795808:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e4b40/0xdfc0fb148a3b1f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795810:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801349e2ac0/0xdfc0fb1486890ea lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa987:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2df6 expref: 26867 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.795811:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795815:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.795816:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795818:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.795819:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.795820:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.795821:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795822:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.795825:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:1960:x1796714882492352:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.795826:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795827:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.795828:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820430 00000100:00100000:1.0:1713481296.795829:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26866:1960:x1796714882492544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.795833:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820431 00010000:00010000:3.0:1713481296.795833:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795836:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.795838:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800991dc000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.795841:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.795844:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795846:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.795848:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26865:1960:x1796714882492672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (122us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.795848:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795848:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.795852:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.795853:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820432 00010000:00010000:2.0:1713481296.795853:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795854:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.795857:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795857:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.795859:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.795860:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795860:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.795864:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795864:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795865:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dc000/0xdfc0fb148a3b1e5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.795867:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b14c900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.795867:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083b59b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.795869:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795869:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.795872:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795872:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.795877:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795878:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.795879:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795879:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.795882:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083b59b00/0xdfc0fb148a3b048 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795884:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795885:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.795886:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b14c900/0xdfc0fb148a3b056 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795890:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795892:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795895:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800922e7840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.795897:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795898:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795903:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795904:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795909:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff880091b3c300) 00010000:00010000:0.0:1713481296.795911:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078778900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.795911:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.795914:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795914:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.795919:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e7840/0xdfc0fb148a3b1ec lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.795921:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.795936:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.795942:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078778900/0xdfc0fb148a3b05d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795953:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800991dd200/0xdfc0fb148a3b1de lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49888 expref: 2381 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795967:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e4b40/0xdfc0fb148a3b1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49888 expref: 2380 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.795973:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff880091b3c000) 00010000:00010000:3.0:1713481296.795975:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713481296.795977:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922e4b40, rc 0) 00000100:00100000:3.0:1713481296.795996:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2380:18765:x1796714882493888:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 394us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.796001:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+203:3491:x1796714784518720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7137us (7203us total) trans 4296040866 rc 0/0 00000100:00100000:1.0:1713481296.796003:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2801:3493:x1796714784518848:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7041us (7086us total) trans 4295960742 rc 0/0 00000100:00100000:3.0:1713481296.796003:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485860 00000100:00100000:2.0:1713481296.796006:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563238 00000100:00100000:1.0:1713481296.796008:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563240 00000004:00080000:2.0:1713481296.796029:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800823a0700/2, rc 0, transno 1073570 00000004:00080000:1.0:1713481296.796033:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800785a9180/2, rc 0, transno 993446 00000100:00100000:2.0:1713481296.796034:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800823a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784518720:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.796037:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800785a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784518848:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.796047:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522112 00000100:00100000:1.0:1713481296.796048:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522112 00000100:00100000:2.0:1713481296.796055:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.796057:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82925 00000100:00100000:1.0:1713481296.796060:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+33:15479:x1796714784522112:12345-0@lo:1000:mdt00_015.0 00000100:00100000:2.0:1713481296.796060:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784522176:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.796073:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.796101:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522176 00000100:00100000:3.0:1713481296.796105:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522176 00000100:00100000:1.0:1713481296.796106:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+33:15479:x1796714784522112:12345-0@lo:1000:mdt00_015.0 Request processed in 44us (358us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.796112:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82925 00000100:00100000:2.0:1713481296.796143:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563269 00000100:00100000:2.0:1713481296.796147:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+203:3492:x1796714784522176:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.796157:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2801:3492:x1796714784519040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7115us (7148us total) trans 4295960743 rc 0/0 00002000:00080000:2.0:1713481296.796158:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10016 count 1 00000100:00100000:0.0:1713481296.796164:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563241 00000100:00100000:1.0:1713481296.796168:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007970bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-mdtlov_UUID:15479:1796714784522112:0@lo:1000:mdt00_015.0 00010000:00010000:2.0:1713481296.796169:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796178:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088155440/0xdfc0fb148802dfd lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d66 expref: 20776 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.796184:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.796185:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.796187:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796203:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088155440/0xdfc0fb148802dfd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d66 expref: 20776 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.796209:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18967:x1796714882493824:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 663us (707us total) trans 0 rc -17/-17 00010000:00010000:2.0:1713481296.796212:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088155440/0xdfc0fb148802dfd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d66 expref: 20776 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.796215:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485859 00000100:00100000:0.0:1713481296.796217:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784522304:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.796221:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784522240:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.796235:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.796241:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713481296.796259:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787c6d80/2, rc 0, transno 993447 00000100:00100000:2.0:1713481296.796264:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784519040:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.796276:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522304 00000100:00100000:0.0:1713481296.796279:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522304 00000100:00100000:2.0:1713481296.796285:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784522368:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.796299:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563270 00000100:00100000:0.0:1713481296.796303:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2801:3490:x1796714784522304:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.796308:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1713481296.796313:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43410 count 1 00010000:00010000:0.0:1713481296.796322:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.796332:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013464f3c0/0xdfc0fb14868915a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa992:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e4a expref: 26864 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.796336:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.796337:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.796337:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522368 00010000:00010000:0.0:1713481296.796339:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.796340:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522368 00010000:00010000:0.0:1713481296.796349:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013464f3c0/0xdfc0fb14868915a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa992:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e4a expref: 26864 pid: 16466 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.796355:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013464f3c0/0xdfc0fb14868915a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa992:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e4a expref: 26864 pid: 16466 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.796356:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563271 00000100:00100000:2.0:1713481296.796360:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2802:3491:x1796714784522368:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.796361:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009de22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784522432:192.168.202.24@tcp:104: 00002000:00080000:2.0:1713481296.796371:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43412 count 1 00000100:00100000:0.0:1713481296.796379:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be180 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.796381:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796391:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800833761c0/0xdfc0fb148689161 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e5f expref: 26864 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.796397:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.796398:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.796400:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.796412:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.796417:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800833761c0/0xdfc0fb148689161 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e5f expref: 26864 pid: 16453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.796423:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492800 00010000:00010000:2.0:1713481296.796425:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800833761c0/0xdfc0fb148689161 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e5f expref: 26864 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.796426:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.796426:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492800 00000100:00100000:2.0:1713481296.796434:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784522496:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.796435:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b4480/0xdfc0fb1486890f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e04 expref: 26865 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.796440:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.796446:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492928 00000100:00100000:3.0:1713481296.796450:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492928 00000100:00100000:1.0:1713481296.796453:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820433 00000100:00100000:1.0:1713481296.796456:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26865:1960:x1796714882492800:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.796458:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097964900 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.796461:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.796463:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800922b4480/0xdfc0fb1486890f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa989:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e04 expref: 26865 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.796466:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088156ac0/0xdfc0fb148802de1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d2e expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.796468:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493952 00010000:00010000:1.0:1713481296.796470:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800922b4480/0xdfc0fb1486890f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa989:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e04 expref: 26865 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.796471:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493952 00010000:00010000:1.0:1713481296.796481:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b4480/0xdfc0fb1486890f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa989:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e04 expref: 26865 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.796488:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820434 00010000:00010000:1.0:1713481296.796490:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.796491:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.796492:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.796493:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:1960:x1796714882492928:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.796496:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125692 00010000:00010000:1.0:1713481296.796497:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.796500:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.796501:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2039:18678:x1796714882493952:12345-192.168.202.24@tcp:37:rm.0 00010000:00010000:3.0:1713481296.796505:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088156ac0/0xdfc0fb148802de1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d2e expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.796507:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.796515:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088156ac0/0xdfc0fb148802de1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d2e expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.796519:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26864:1960:x1796714882492800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.796523:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820433 00010000:00010000:3.0:1713481296.796534:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088156ac0/0xdfc0fb148802de1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x271c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d2e expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.796537:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796541:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.796545:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.796546:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.796546:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.796549:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796550:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796553:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.796556:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796557:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122ace880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.796558:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796562:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796568:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796572:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122ace880/0xdfc0fb148a3b095 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.796579:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.796584:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796592:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796597:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796600:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.796600:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20776:1960:x1796714882492928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (172us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.796604:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796608:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011f98f3c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.796608:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820434 00010000:00010000:2.0:1713481296.796609:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796613:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796623:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.796627:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f98f3c0/0xdfc0fb148a3b0e2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x271c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.796682:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2803:3490:x1796714784519424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6907us (6962us total) trans 4295960744 rc 0/0 00000100:00100000:1.0:1713481296.796687:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563245 00000004:00080000:1.0:1713481296.796713:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072b79180/2, rc 0, transno 993448 00000100:00100000:1.0:1713481296.796718:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784519424:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.796737:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.796760:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+204:3493:x1796714784519808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6342us (6463us total) trans 4296040867 rc 0/0 00000100:00100000:3.0:1713481296.796761:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882493056 00000100:00100000:2.0:1713481296.796765:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563250 00000100:00100000:3.0:1713481296.796765:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882493056 00000100:00100000:1.0:1713481296.796766:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.796774:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492288 00000100:00100000:1.0:1713481296.796776:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492288 00010000:00010000:3.0:1713481296.796779:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008214cfc0/0xdfc0fb148802def lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d4a expref: 20777 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.796785:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083488480/0xdfc0fb148802dc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cf6 expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.796790:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800798fb480/2, rc 0, transno 1073571 00000100:00100000:2.0:1713481296.796794:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784519808:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.796802:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820435 00000100:00100000:1.0:1713481296.796807:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820436 00000100:00100000:3.0:1713481296.796808:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:1960:x1796714882493056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.796813:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20777:1960:x1796714882492288:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.796816:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.796820:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.796821:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008214cfc0/0xdfc0fb148802def lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d4a expref: 20777 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.796824:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083488480/0xdfc0fb148802dc5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2718:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cf6 expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.796830:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008214cfc0/0xdfc0fb148802def lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d4a expref: 20777 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.796831:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784522624:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.796833:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083488480/0xdfc0fb148802dc5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2718:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cf6 expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.796844:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.796850:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083488480/0xdfc0fb148802dc5 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2718:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962cf6 expref: 20777 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.796851:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008214cfc0/0xdfc0fb148802def lrc: 0/0,0 mode: --/PR res: [0x280000408:0x271e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d4a expref: 20777 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.796855:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.796858:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784522560:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.796862:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.796863:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.796864:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.796865:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.796866:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.796867:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796868:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.796874:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796875:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.796880:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522624 00000100:00100000:2.0:1713481296.796882:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522624 00000100:00100000:2.0:1713481296.796890:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522560 00000100:00100000:2.0:1713481296.796892:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522560 00010000:00010000:1.0:1713481296.796895:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.796900:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563272 00010000:00010000:3.0:1713481296.796901:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.796902:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e33c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2803:3493:x1796714784522624:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.796910:0:16463:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43415 count 1 00000100:00100000:1.0:1713481296.796912:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20775:1960:x1796714882492288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.796918:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820436 00010000:00010000:2.0:1713481296.796918:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.796922:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20775:1960:x1796714882493056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 113us (183us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.796925:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083377840/0xdfc0fb148689168 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e6d expref: 26863 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.796929:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.796930:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.796930:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820435 00010000:00010000:2.0:1713481296.796931:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.796940:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563273 00010000:00010000:2.0:1713481296.796940:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083377840/0xdfc0fb148689168 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e6d expref: 26863 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.796943:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+204:3493:x1796714784522560:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.796946:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083377840/0xdfc0fb148689168 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e6d expref: 26863 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.796951:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784522688:192.168.202.24@tcp:104: 00002000:00080000:1.0:1713481296.796952:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10017 count 1 00010000:00010000:1.0:1713481296.796960:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.796965:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092fbf3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.796967:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca23180/0xdfc0fb148802e04 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d74 expref: 20773 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.796970:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.796971:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.796973:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.796983:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca23180/0xdfc0fb148802e04 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d74 expref: 20773 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.796988:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca23180/0xdfc0fb148802e04 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d74 expref: 20773 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.796993:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15560:1796714784522752:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.797004:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797009:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134616600 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.797012:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797020:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797026:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.797026:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797034:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797037:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.797040:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963dc240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.797043:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797044:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492480 00000100:00100000:1.0:1713481296.797045:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492608 00000100:00100000:2.0:1713481296.797046:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492480 00000100:00100000:1.0:1713481296.797047:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492608 00010000:00010000:3.0:1713481296.797050:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797054:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090598d80/0xdfc0fb1486890dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dd3 expref: 26864 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.797055:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008214dd40/0xdfc0fb148802dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d12 expref: 20774 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.797067:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820437 00010000:00010000:3.0:1713481296.797068:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797070:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820438 00000100:00100000:2.0:1713481296.797070:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26864:1960:x1796714882492480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.797072:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20774:1960:x1796714882492608:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.797074:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.797074:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800963dc240/0xdfc0fb148a3b11a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x271e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797076:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.797077:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090598d80/0xdfc0fb1486890dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa983:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dd3 expref: 26864 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.797079:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008214dd40/0xdfc0fb148802dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d12 expref: 20774 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.797082:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090598d80/0xdfc0fb1486890dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa983:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dd3 expref: 26864 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.797084:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008214dd40/0xdfc0fb148802dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d12 expref: 20774 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.797091:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090598d80/0xdfc0fb1486890dc lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa983:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2dd3 expref: 26864 pid: 16546 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.797095:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008214dd40/0xdfc0fb148802dd3 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x271a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d12 expref: 20774 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.797098:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797101:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.797102:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797102:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797102:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.797104:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797105:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797107:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797108:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797109:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797114:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797134:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.797137:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.797139:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797145:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:1960:x1796714882492480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (118us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.797146:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797147:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20773:1960:x1796714882492608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.797151:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820437 00010000:00010000:0.0:1713481296.797152:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b14fcc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.797154:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797154:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820438 00010000:00010000:0.0:1713481296.797166:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797169:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797174:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797178:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797178:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797179:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797181:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797185:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797185:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797186:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b041 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797188:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083b58480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.797189:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797192:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797193:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797198:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797204:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797205:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797208:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083b58480/0xdfc0fb148a3b064 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x271a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797210:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832cd200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.797212:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797223:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797238:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797244:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800832cd200/0xdfc0fb148a3b04f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.797255:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+207:3491:x1796714784520128:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6275us (6347us total) trans 4296040868 rc 0/0 00000100:00100000:3.0:1713481296.797263:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563252 00000100:00100000:1.0:1713481296.797293:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.797345:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+206:3493:x1796714784518592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8725us (8826us total) trans 4296040869 rc 0/0 00000100:00100000:0.0:1713481296.797351:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563237 00000100:00100000:1.0:1713481296.797359:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.797376:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007994ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2804:3491:x1796714784518784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8463us (8497us total) trans 4295960745 rc 0/0 00000100:00100000:1.0:1713481296.797377:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.797383:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563239 00000100:00100000:0.0:1713481296.797392:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492736 00000100:00100000:0.0:1713481296.797394:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492736 00010000:00010000:0.0:1713481296.797403:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880079609b00/0xdfc0fb148802dda lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d20 expref: 20773 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.797407:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+205:3490:x1796714784519168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8332us (8367us total) trans 4296040870 rc 0/0 00000004:00080000:1.0:1713481296.797408:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787c5f80/2, rc 0, transno 1073574 00000100:00100000:2.0:1713481296.797408:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492864 00000100:00100000:2.0:1713481296.797411:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492864 00000100:00100000:1.0:1713481296.797413:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784519168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.797415:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882492992 00000100:00100000:3.0:1713481296.797415:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563242 00000100:00100000:0.0:1713481296.797417:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882492992 00010000:00010000:2.0:1713481296.797421:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081e52400/0xdfc0fb148a15fda lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39836 expref: 20775 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.797425:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca22ac0/0xdfc0fb148802de8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d3c expref: 20775 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.797434:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784522816:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.797437:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820439 00000100:00100000:0.0:1713481296.797441:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820440 00000100:00100000:2.0:1713481296.797442:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20775:1960:x1796714882492736:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.797446:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.797449:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.797453:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880079609b00/0xdfc0fb148802dda lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d20 expref: 20775 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.797461:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880079609b00/0xdfc0fb148802dda lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d20 expref: 20775 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.797465:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784522816 00000100:00100000:3.0:1713481296.797469:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784522816 00010000:00010000:2.0:1713481296.797485:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079609b00/0xdfc0fb148802dda lrc: 0/0,0 mode: --/PR res: [0x280000408:0x271b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d20 expref: 20775 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.797487:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563274 00000100:00100000:1.0:1713481296.797488:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.797491:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+205:3490:x1796714784522816:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.797499:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20774:1960:x1796714882492864:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.797499:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797501:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713481296.797502:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10018 count 1 00010000:00010000:2.0:1713481296.797504:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797505:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.797508:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.797510:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797512:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081e52400/0xdfc0fb148a15fda lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39836 expref: 20774 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.797514:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797518:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081e52400/0xdfc0fb148a15fda lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39836 expref: 20774 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.797520:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.797525:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097fd86c0/0xdfc0fb148802e0b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d82 expref: 20774 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.797529:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081e52400/0xdfc0fb148a15fda lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39836 expref: 20774 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.797531:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.797532:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.797535:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797536:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797536:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.797541:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797543:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.797545:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.797545:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797549:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d1b00/0xdfc0fb148a3b0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4981f expref: 20773 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797551:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797551:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20773:1960:x1796714882492736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 108us (258us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.797555:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797555:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097fd86c0/0xdfc0fb148802e0b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d82 expref: 20773 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.797556:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d1b00/0xdfc0fb148a3b0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4981f expref: 20773 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797558:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800930a4000 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.797558:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820439 00010000:00010000:1.0:1713481296.797560:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797563:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797565:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097fd86c0/0xdfc0fb148802e0b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d82 expref: 20773 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.797570:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 2/0,0 mode: --/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797574:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930a4000/0xdfc0fb148a3b0aa lrc: 0/0,0 mode: --/PW res: [0x280000408:0x271b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797574:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494016 00010000:00010000:0.0:1713481296.797575:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0d1b00/0xdfc0fb148a3b0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4981f expref: 20772 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.797575:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784522880:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.797577:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494016 00000100:00100000:0.0:1713481296.797585:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009de20700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784522944:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.797587:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b6400/0xdfc0fb148689114 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e20 expref: 26863 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.797594:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.797602:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.797603:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820441 00000100:00100000:2.0:1713481296.797608:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20772:1960:x1796714882492992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.797615:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.797619:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca22ac0/0xdfc0fb148802de8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d3c expref: 20772 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.797622:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fd28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784520768:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.797626:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784520512:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.797632:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca22ac0/0xdfc0fb148802de8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d3c expref: 20772 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.797645:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca22ac0/0xdfc0fb148802de8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x271d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d3c expref: 20772 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.797647:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797656:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797659:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797661:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797675:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797681:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+206:3493:x1796714784519552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7687us (7773us total) trans 4296040871 rc 0/0 00000100:00100000:3.0:1713481296.797685:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494080 00000100:00100000:1.0:1713481296.797686:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563246 00000100:00100000:3.0:1713481296.797688:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494080 00010000:00010000:2.0:1713481296.797689:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.797699:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20771:1960:x1796714882492992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (321us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.797701:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797702:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494144 00000100:00100000:2.0:1713481296.797703:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820441 00000100:00100000:1.0:1713481296.797704:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494144 00000100:00100000:3.0:1713481296.797709:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563275 00000100:00100000:2.0:1713481296.797714:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820442 00000100:00100000:3.0:1713481296.797715:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16898:17009:x1796714882494080:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.797717:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26863:1959:x1796714882494016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.797719:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563276 00010000:00010000:2.0:1713481296.797721:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.797722:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20771:14753:x1796714882494144:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.797723:0:16490:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.797724:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800922b6400/0xdfc0fb148689114 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e20 expref: 26863 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.797726:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784520832:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.797727:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.797729:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800922b6400/0xdfc0fb148689114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e20 expref: 26863 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.797734:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c0eac0/0xdfc0fb148a3b22b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49896 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797734:0:16490:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b224 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4988f expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797741:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b6400/0xdfc0fb148689114 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e20 expref: 26863 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.797744:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797744:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098edd8c0/0xdfc0fb148a13f0a lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3800a expref: 20772 pid: 16494 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1713481296.797747:0:16490:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.797748:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797748:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.797749:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797749:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797750:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797751:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c0eac0/0xdfc0fb148a3b22b lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49896 expref: 20772 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797754:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797755:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797758:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.797760:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.797761:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797761:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098edd8c0/0xdfc0fb148a13f0a lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3800a expref: 20772 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.797763:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.797765:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b224 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4988f expref: 16899 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797766:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098edd8c0/0xdfc0fb148a13f0a lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3800a expref: 20772 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.797767:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797770:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26862:1959:x1796714882494016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.797772:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784523008:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.797773:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820442 00010000:00010000:0.0:1713481296.797774:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.797779:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797781:0:16490:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099bbf180/0xdfc0fb148a3b224 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4988f expref: 16899 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797783:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fbf6480 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.797785:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011f98df80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.797788:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797788:0:16490:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099bbf180, rc 0) 00010000:00010000:0.0:1713481296.797794:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.797796:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fdac700/2, rc 0, transno 1073572 00000100:00100000:3.0:1713481296.797804:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16899:17009:x1796714882494080:12345-192.168.202.24@tcp:101:dd.0 Request processed in 89us (314us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.797806:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797807:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784520128:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.797811:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563275 00000004:00080000:2.0:1713481296.797815:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007810c700/2, rc 0, transno 993449 00010000:00010000:0.0:1713481296.797817:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f98df80/0xdfc0fb148a3b0f7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x271d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797819:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784518784:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.797822:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713481296.797826:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784523072:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.797836:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797838:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.797842:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784523136:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.797844:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797852:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797856:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.797859:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797866:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.797866:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.797871:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b805b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.797874:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797884:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523072 00000004:00080000:2.0:1713481296.797884:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079708000/2, rc 0, transno 1073575 00010000:00010000:3.0:1713481296.797886:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797887:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523072 00000100:00100000:2.0:1713481296.797888:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784519552:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713481296.797893:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e33ea00/2, rc 0, transno 1073573 00000100:00100000:2.0:1713481296.797895:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784518592:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.797899:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.797903:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523136 00000100:00100000:2.0:1713481296.797903:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494272 00010000:00010000:3.0:1713481296.797904:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b805b00/0xdfc0fb148a3b13d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.797905:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494272 00000100:00100000:1.0:1713481296.797906:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523136 00010000:00010000:2.0:1713481296.797912:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b6ac0/0xdfc0fb14868914c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e2e expref: 26862 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.797916:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563277 00000100:00100000:1.0:1713481296.797920:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+207:3490:x1796714784523072:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.797922:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820443 00000100:00100000:2.0:1713481296.797924:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26862:1959:x1796714882494272:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.797928:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.797930:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800922b6ac0/0xdfc0fb14868914c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e2e expref: 26862 pid: 16453 timeout: 815 lvb_type: 1 00002000:00080000:1.0:1713481296.797931:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10019 count 1 00010000:00010000:2.0:1713481296.797935:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800922b6ac0/0xdfc0fb14868914c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e2e expref: 26862 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.797941:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+207:3491:x1796714784520000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7345us (7395us total) trans 4296040872 rc 0/0 00010000:00010000:1.0:1713481296.797941:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797944:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b6ac0/0xdfc0fb14868914c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e2e expref: 26862 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.797948:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563251 00010000:00010000:1.0:1713481296.797949:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007960bcc0/0xdfc0fb148802e12 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d90 expref: 20772 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.797950:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797951:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.797952:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797953:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.797953:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.797955:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.797956:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.797965:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007960bcc0/0xdfc0fb148802e12 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d90 expref: 20772 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.797966:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.797967:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563278 00010000:00010000:1.0:1713481296.797970:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007960bcc0/0xdfc0fb148802e12 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d90 expref: 20772 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.797975:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26861:1959:x1796714882494272:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 49us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.797976:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784523200:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.797979:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820443 00000100:00100000:1.0:1713481296.797990:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f869840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.798001:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784521152:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.798016:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.798026:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2805:3492:x1796714784523136:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.798032:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784523264:0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.798039:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43417 count 1 00000100:00100000:2.0:1713481296.798044:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.798048:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784523328:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.798049:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798059:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350aeac0/0xdfc0fb148689176 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e7b expref: 26860 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.798065:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.798067:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713481296.798068:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800798fb100/2, rc 0, transno 993450 00010000:00010000:0.0:1713481296.798069:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.798071:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784520576:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.798076:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.798077:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+2805:3492:x1796714784520576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5099us (5150us total) trans 4295960746 rc 0/0 00000100:00100000:3.0:1713481296.798085:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563255 00010000:00010000:0.0:1713481296.798086:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350aeac0/0xdfc0fb148689176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e7b expref: 26860 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.798089:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.798089:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523264 00000100:00100000:2.0:1713481296.798091:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523264 00000100:00100000:1.0:1713481296.798094:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784523392:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.798095:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350aeac0/0xdfc0fb148689176 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e7b expref: 26860 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.798100:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523328 00000100:00100000:2.0:1713481296.798101:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523328 00000100:00100000:3.0:1713481296.798105:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563279 00000100:00100000:0.0:1713481296.798109:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009de21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784523456:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.798109:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.798110:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+208:3493:x1796714784523264:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.798114:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523392 00000100:00100000:2.0:1713481296.798115:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523392 00000100:00100000:2.0:1713481296.798140:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563280 00000100:00100000:0.0:1713481296.798142:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231becc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.798143:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+208:3490:x1796714784523328:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.798144:0:16525:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10020 count 1 00000100:00100000:1.0:1713481296.798148:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563281 00000100:00100000:1.0:1713481296.798151:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2805:3490:x1796714784523392:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.798152:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10021 count 1 00010000:00010000:0.0:1713481296.798155:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.798155:0:16525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.798160:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43418 count 1 00010000:00010000:0.0:1713481296.798162:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798163:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.798166:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088157600/0xdfc0fb148802e19 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d9e expref: 20772 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.798168:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798169:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.798172:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.798173:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca23cc0/0xdfc0fb148802e20 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dac expref: 20772 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.798173:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.798174:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798176:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083377180/0xdfc0fb14868917d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e89 expref: 26860 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.798176:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798179:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.798180:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798180:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.798180:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.798181:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.798183:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798183:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798186:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008495a880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.798189:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798192:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083377180/0xdfc0fb14868917d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e89 expref: 26860 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.798195:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798197:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083377180/0xdfc0fb14868917d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e89 expref: 26860 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.798197:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088157600/0xdfc0fb148802e19 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d9e expref: 20772 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.798200:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca23cc0/0xdfc0fb148802e20 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dac expref: 20772 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.798203:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784523520:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.798206:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088157600/0xdfc0fb148802e19 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d9e expref: 20772 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.798209:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca23cc0/0xdfc0fb148802e20 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dac expref: 20772 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.798210:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.798213:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d3786c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.798217:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b144 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.798217:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784523584:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.798219:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784523648:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.798236:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.798242:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009434e000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.798252:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.798294:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.798304:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.798312:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494400 00000100:00100000:1.0:1713481296.798314:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494400 00000100:00100000:1.0:1713481296.798328:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485861 00000100:00100000:1.0:1713481296.798331:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2041:18932:x1796714882494400:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:1.0:1713481296.798336:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.798343:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008214f180/0xdfc0fb148a3b255 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4989d expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.798347:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2806:3490:x1796714784520640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5334us (5372us total) trans 4295960747 rc 0/0 00000100:00100000:0.0:1713481296.798353:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563256 00000100:00100000:0.0:1713481296.798374:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494208 00000100:00100000:0.0:1713481296.798377:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494208 00010000:00010000:1.0:1713481296.798382:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.798385:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801349e1d40/0xdfc0fb14868910d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e12 expref: 26861 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.798388:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798392:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.798393:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494336 00000100:00100000:2.0:1713481296.798396:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494336 00000100:00100000:0.0:1713481296.798398:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820444 00010000:00010000:1.0:1713481296.798398:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.798401:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.798402:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26862:1960:x1796714882494208:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.798405:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.798405:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013464f180/0xdfc0fb148689153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e3c expref: 26862 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.798408:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.798411:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801349e1d40/0xdfc0fb14868910d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e12 expref: 26862 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.798416:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820445 00010000:00010000:0.0:1713481296.798418:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801349e1d40/0xdfc0fb14868910d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e12 expref: 26862 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.798419:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26862:1960:x1796714882494336:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.798424:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.798426:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013464f180/0xdfc0fb148689153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa991:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e3c expref: 26862 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.798429:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89f80/0xdfc0fb148a3b26a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.798431:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801349e1d40/0xdfc0fb14868910d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e12 expref: 26862 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.798431:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013464f180/0xdfc0fb148689153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa991:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e3c expref: 26862 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.798432:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89f80/0xdfc0fb148a3b26a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798435:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89f80/0xdfc0fb148a3b26a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.798442:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.798443:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.798443:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013464f180/0xdfc0fb148689153 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa991:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e3c expref: 26861 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.798446:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713481296.798451:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c39:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.798452:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.798453:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798457:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.798458:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00010000:1.0:1713481296.798459:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89f80/0xdfc0fb148a3b26a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.798459:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798463:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.798464:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798466:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.798469:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.798469:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798472:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.798473:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.798475:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008214e400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.798476:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798479:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.798482:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26860:1960:x1796714882494208:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.798483:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:2.0:1713481296.798483:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26860:1960:x1796714882494336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.798485:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.798486:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820445 00010000:00010000:1.0:1713481296.798487:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.798489:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820444 00010000:00010000:1.0:1713481296.798490:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008214e400/0xdfc0fb148a3b25c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798498:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798502:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798505:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798507:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008214df80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.798508:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798511:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.798512:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784521536:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.798514:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff880134601900) 00010000:00010000:1.0:1713481296.798515:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.798516:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.798519:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008214df80/0xdfc0fb148a3b263 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.798529:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.798535:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20772:1960:x1796714882492160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4587us (4650us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.798539:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820428 00010000:00010000:1.0:1713481296.798542:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008214f180/0xdfc0fb148a3b255 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4989d expref: 2043 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798551:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89f80/0xdfc0fb148a3b26a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4989d expref: 2042 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798551:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798555:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff8801356c9000) 00010000:00010000:2.0:1713481296.798555:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798556:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.798557:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133b89f80, rc 0) 00010000:00010000:2.0:1713481296.798560:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798563:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798567:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.798568:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2042:18932:x1796714882494400:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 236us (263us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.798570:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798570:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.798572:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485861 00010000:00010000:2.0:1713481296.798574:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097640d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.798575:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798576:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798579:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798581:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798586:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798586:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798589:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097640d80/0xdfc0fb148a3b167 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798591:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963dc900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.798593:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.798601:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299e680/2, rc 0, transno 993451 00010000:00010000:0.0:1713481296.798604:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.798614:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784520640:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.798615:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.798620:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800963dc900/0xdfc0fb148a3b12f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.798631:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784523712:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.798635:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.798646:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.798680:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494464 00000100:00100000:2.0:1713481296.798682:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494464 00000100:00100000:3.0:1713481296.798690:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784521472:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.798691:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523712 00000100:00100000:2.0:1713481296.798692:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523712 00000100:00100000:2.0:1713481296.798701:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563282 00000100:00100000:2.0:1713481296.798704:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10479:x1796714882494464:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.798707:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784521728:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.798708:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798709:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.798715:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133a7fa80/0xdfc0fb148a3b271 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498a4 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798726:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007995d440/0xdfc0fb148916dc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c658b expref: 24480 pid: 16496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.798729:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.798730:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.798732:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7fa80/0xdfc0fb148a3b271 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498a4 expref: 24480 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.798735:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563283 00000100:00100000:3.0:1713481296.798740:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2807:3492:x1796714784523712:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.798741:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2807:3492:x1796714784520384:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5881us (6008us total) trans 4295960748 rc 0/0 00010000:00010000:2.0:1713481296.798741:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007995d440/0xdfc0fb148916dc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c658b expref: 24480 pid: 16496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.798745:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007995d440/0xdfc0fb148916dc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c658b expref: 24480 pid: 16496 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.798747:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563254 00000100:00100000:1.0:1713481296.798747:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a3d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784521792:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.798751:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784523776:192.168.202.24@tcp:104: 00002000:00080000:3.0:1713481296.798754:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43420 count 1 00000100:00100000:2.0:1713481296.798761:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f5ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.798766:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.798771:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801207cc900/0xdfc0fb148a3b17c lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49842 expref: 24480 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.798777:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350acd80/0xdfc0fb148689184 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e97 expref: 26858 pid: 16453 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.798779:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6918:1796714784521600:192.168.202.24@tcp:105: 00000004:00080000:0.0:1713481296.798780:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800798f9f80/2, rc 0, transno 1073576 00010000:00010000:1.0:1713481296.798781:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207cc900, rc 0) 00010000:00010000:3.0:1713481296.798783:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.798784:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.798787:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784520000:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.798787:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.798794:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:10409:x1796714882492416:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4094us (4165us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.798795:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.798799:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563260 00000100:00100000:2.0:1713481296.798802:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20771:1960:x1796714882492096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4565us (4608us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.798806:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820429 00010000:00010000:3.0:1713481296.798808:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350acd80/0xdfc0fb148689184 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e97 expref: 26858 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.798816:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350acd80/0xdfc0fb148689184 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e97 expref: 26858 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.798826:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784523840:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.798843:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a4e40 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.798844:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800798fa300/2, rc 0, transno 993452 00000100:00100000:2.0:1713481296.798849:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784520384:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.798852:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.798856:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007df4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784523904:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.798868:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.798873:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.798884:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523904 00000100:00100000:1.0:1713481296.798886:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523904 00000100:00100000:0.0:1713481296.798891:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.798903:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563284 00000100:00100000:1.0:1713481296.798906:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+209:3492:x1796714784523904:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.798914:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00080000:1.0:1713481296.798914:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10022 count 1 00010000:00010000:1.0:1713481296.798921:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.798921:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494592 00000100:00100000:0.0:1713481296.798922:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784523968:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.798924:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494592 00010000:00010000:1.0:1713481296.798928:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148802e27 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dba expref: 20771 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.798932:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.798933:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.798935:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.798936:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800973dcfc0/0xdfc0fb1489cfc1b lrc: 5/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa222dc expref: 20771 pid: 16512 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.798940:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.798945:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148802e27 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dba expref: 20771 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.798950:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148802e27 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dba expref: 20771 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.798951:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494720 00000100:00100000:2.0:1713481296.798953:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494720 00000100:00100000:1.0:1713481296.798956:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007df4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784524032:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.798962:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096bac6c0/0xdfc0fb14891d166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca708 expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.798967:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800736ee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.798968:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820446 00000100:00100000:0.0:1713481296.798974:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20771:1960:x1796714882494592:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.798979:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820447 00010000:00010000:0.0:1713481296.798982:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.798984:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e27b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1960:x1796714882494720:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.798986:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800973dcfc0/0xdfc0fb1489cfc1b lrc: 5/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa222dc expref: 20771 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.798991:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.798995:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096bac6c0/0xdfc0fb14891d166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca708 expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.798999:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800973dcfc0/0xdfc0fb1489cfc1b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa222dc expref: 20771 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.799003:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096bac6c0/0xdfc0fb14891d166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca708 expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.799007:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.799013:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799014:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096bac6c0/0xdfc0fb14891d166 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca708 expref: 24480 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.799015:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.799019:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148a3b175 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4983b expref: 16898 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799026:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148a3b175 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4983b expref: 16898 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799027:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.799027:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.799040:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e27b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1960:x1796714882494720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.799044:0:15529:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148a3b175 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4983b expref: 16898 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799046:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820447 00000100:00100000:0.0:1713481296.799052:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a1e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784524096:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.799053:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.799063:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494528 00000100:00100000:2.0:1713481296.799065:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494528 00000100:00100000:0.0:1713481296.799069:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d11ecc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.799074:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007960ad00/0xdfc0fb148802df6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d58 expref: 20772 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.799076:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.799086:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784523968 00000100:00100000:2.0:1713481296.799087:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494656 00000100:00100000:0.0:1713481296.799088:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784523968 00000100:00100000:2.0:1713481296.799089:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494656 00010000:00010000:2.0:1713481296.799096:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098ea5200/0xdfc0fb14893ab2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4b9 expref: 26859 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.799103:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494848 00000100:00100000:0.0:1713481296.799105:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494848 00000100:00100000:2.0:1713481296.799107:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494784 00000100:00100000:2.0:1713481296.799109:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494784 00000100:00100000:0.0:1713481296.799114:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563285 00010000:00010000:2.0:1713481296.799117:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f801200/0xdfc0fb148959c13 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebde expref: 26860 pid: 16475 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.799133:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2807:3491:x1796714784523968:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.799146:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43422 count 1 00000100:00100000:3.0:1713481296.799146:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784521920:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.799148:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.799152:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820448 00010000:00010000:0.0:1713481296.799156:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799157:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20772:1960:x1796714882494528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.799163:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.799167:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007960ad00/0xdfc0fb148802df6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x271f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d58 expref: 20772 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.799167:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148a3b18a lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49850 expref: 26860 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799171:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350aed00/0xdfc0fb14868918b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ea5 expref: 26860 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.799175:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007960ad00/0xdfc0fb148802df6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x271f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d58 expref: 20772 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.799177:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.799177:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b804b40, rc 0) 00010000:00010000:0.0:1713481296.799178:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.799181:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799181:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.799194:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007960ad00/0xdfc0fb148802df6 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x271f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d58 expref: 20772 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.799194:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26860:11388:x1796714882493184:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4244us (4283us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.799197:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350aed00/0xdfc0fb14868918b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ea5 expref: 26860 pid: 16453 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.799200:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563262 00010000:00010000:0.0:1713481296.799206:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350aed00/0xdfc0fb14868918b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ea5 expref: 26860 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.799208:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799210:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799212:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799216:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784524160:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.799216:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.799219:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.799223:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494912 00000100:00100000:3.0:1713481296.799226:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494912 00000100:00100000:0.0:1713481296.799231:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.799234:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.799237:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.799242:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495040 00000100:00100000:3.0:1713481296.799244:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495040 00000100:00100000:0.0:1713481296.799249:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563286 00000100:00100000:2.0:1713481296.799251:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20772:1960:x1796714882494528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.799252:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.799254:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16900:18836:x1796714882494848:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.799257:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820448 00010000:00010000:0.0:1713481296.799261:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.799268:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092dbef40/0xdfc0fb148a3b28d lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498ab expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.799269:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495296 00000100:00100000:3.0:1713481296.799272:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495296 00000100:00100000:2.0:1713481296.799274:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882494976 00000100:00100000:1.0:1713481296.799277:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563287 00000100:00100000:2.0:1713481296.799277:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882494976 00010000:00010000:0.0:1713481296.799281:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007df06400/0xdfc0fb14891ebbb lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb67b expref: 20771 pid: 16472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799281:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20771:18792:x1796714882494912:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.799287:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800794d3cc0/0xdfc0fb148942419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03c6 expref: 24480 pid: 16462 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799288:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.799291:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1713481296.799291:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563288 00010000:00010000:0.0:1713481296.799292:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.799294:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133b8b3c0/0xdfc0fb148a3b294 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc51d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498b2 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799295:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092dbef40/0xdfc0fb148a3b28d lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ab expref: 16901 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.799296:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16901:17935:x1796714882495040:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.799301:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495168 00000100:00100000:2.0:1713481296.799303:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495168 00002000:00010000:1.0:1713481296.799304:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc51d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.799304:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.799307:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007df06400/0xdfc0fb14891ebbb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb67b expref: 20772 pid: 16472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799311:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799311:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088155440/0xdfc0fb148802dfd lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d66 expref: 20773 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799312:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.799313:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007df06400/0xdfc0fb14891ebbb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb67b expref: 20773 pid: 16472 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.799315:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133b8b3c0/0xdfc0fb148a3b294 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498b2 expref: 20773 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.799316:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b06eac0/0xdfc0fb148a3b29b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498b9 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799321:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a1e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784524224:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.799321:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133b8b3c0/0xdfc0fb148a3b294 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498b2 expref: 20773 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799325:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820449 00010000:00010000:1.0:1713481296.799326:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133b8b3c0, rc 0) 00000100:00100000:2.0:1713481296.799330:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26859:1960:x1796714882494656:12345-192.168.202.24@tcp:103:ldlm_bl.0 00002000:00010000:3.0:1713481296.799330:0:16462:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.799332:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134e21540 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.799336:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20773:18792:x1796714882494912:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 55us (188us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.799336:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.799340:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563287 00010000:00010000:2.0:1713481296.799340:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098ea5200/0xdfc0fb14893ab2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4b9 expref: 26859 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.799341:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.799342:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.799346:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b06eac0/0xdfc0fb148a3b29b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498b9 expref: 16902 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799347:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820450 00010000:00010000:2.0:1713481296.799349:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098ea5200/0xdfc0fb14893ab2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4b9 expref: 26859 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.799351:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4018850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26859:1960:x1796714882494784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.799354:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563289 00010000:00010000:0.0:1713481296.799357:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.799357:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:15045:x1796714882495296:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.799357:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b06eac0/0xdfc0fb148a3b29b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498b9 expref: 16902 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799361:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.799363:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ea5200/0xdfc0fb14893ab2f lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4b9 expref: 26859 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.799365:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b06eac0, rc 0) 00010000:00010000:0.0:1713481296.799366:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f801200/0xdfc0fb148959c13 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebde expref: 26859 pid: 16475 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799367:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133b89680/0xdfc0fb148a3b2a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498c0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799374:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f801200/0xdfc0fb148959c13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebde expref: 26858 pid: 16475 timeout: 815 lvb_type: 1 00002000:00010000:1.0:1713481296.799374:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.799377:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.799379:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799379:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.799380:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.799380:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16902:17935:x1796714882495040:12345-192.168.202.24@tcp:101:dd.0 Request processed in 84us (198us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.799382:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207cc900/0xdfc0fb148a3b17c lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49842 expref: 24481 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799383:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133b89680/0xdfc0fb148a3b2a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498c0 expref: 24481 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799387:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.799387:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563288 00010000:00010000:0.0:1713481296.799388:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799390:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207cc900/0xdfc0fb148a3b17c lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49842 expref: 24481 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799391:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3b183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49849 expref: 26858 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799391:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133b89680/0xdfc0fb148a3b2a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498c0 expref: 24481 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799395:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133b89680, rc 0) 00010000:00010000:0.0:1713481296.799398:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3b183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49849 expref: 26858 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799404:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:15045:x1796714882495296:12345-192.168.202.24@tcp:101:dd.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.799407:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563289 00010000:00010000:2.0:1713481296.799408:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801207cc900/0xdfc0fb148a3b17c lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49842 expref: 24481 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799415:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3b183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49849 expref: 26858 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799417:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784524288:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.799417:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799423:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a1e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784524352:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.799425:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799433:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124c6b540 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.799433:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799439:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135c58e40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.799440:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799444:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.799449:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495104 00000100:00100000:2.0:1713481296.799451:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495104 00010000:00010000:3.0:1713481296.799451:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.799457:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b8073c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.799460:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfc9b00/0xdfc0fb1488e7eb5 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5517 expref: 16902 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.799460:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799463:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121d8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784521984:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.799466:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.799468:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820451 00010000:00010000:3.0:1713481296.799468:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799471:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1957:x1796714882494976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.799475:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.799478:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008495ba80/0xdfc0fb148a3b191 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4985e expref: 16902 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799478:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800794d3cc0/0xdfc0fb148942419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03c6 expref: 24480 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.799480:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.799481:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799483:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800794d3cc0/0xdfc0fb148942419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03c6 expref: 24480 pid: 16462 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.799485:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008495ba80, rc 0) 00010000:00010000:3.0:1713481296.799487:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8073c0/0xdfc0fb148a3b16e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x271f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799493:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800794d3cc0/0xdfc0fb148942419 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03c6 expref: 24480 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.799495:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16902:8499:x1796714882493376:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4471us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.799498:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.799499:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563263 00010000:00010000:2.0:1713481296.799504:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799505:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799507:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148a3b18a lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49850 expref: 26858 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799512:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495424 00010000:00010000:2.0:1713481296.799512:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148a3b18a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49850 expref: 26858 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799513:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.799514:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495424 00000100:00100000:1.0:1713481296.799521:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495488 00010000:00010000:2.0:1713481296.799522:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b804b40/0xdfc0fb148a3b18a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49850 expref: 26858 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799523:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495488 00000100:00100000:2.0:1713481296.799526:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784524416:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.799531:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563290 00000100:00100000:0.0:1713481296.799534:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16902:18844:x1796714882495424:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.799535:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.799539:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.799546:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092dbcb40/0xdfc0fb148a3b2a9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498c7 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799548:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485862 00000100:00100000:2.0:1713481296.799549:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495232 00000100:00100000:1.0:1713481296.799550:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2380:18765:x1796714882495488:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.799551:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495232 00010000:00010000:1.0:1713481296.799556:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1713481296.799557:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.799557:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013464f3c0/0xdfc0fb14868915a lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa992:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e4a expref: 26859 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799562:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89b00/0xdfc0fb148a3b2b0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498ce expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799563:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.799564:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.799567:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092dbcb40/0xdfc0fb148a3b2a9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498c7 expref: 16903 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799568:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495360 00000100:00100000:2.0:1713481296.799569:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495360 00010000:00010000:0.0:1713481296.799573:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092dbcb40/0xdfc0fb148a3b2a9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498c7 expref: 16903 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799576:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98374 00010000:00010000:0.0:1713481296.799577:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dbcb40, rc 0) 00000100:00100000:2.0:1713481296.799578:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2382:1959:x1796714882495360:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.799582:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.799586:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16903:18844:x1796714882495424:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 51us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.799589:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563290 00010000:00010000:2.0:1713481296.799589:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a949f80/0xdfc0fb148a3b1b4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49865 expref: 2382 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799599:0:16624:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880092a16a00) 00010000:00010000:1.0:1713481296.799601:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.799601:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.799605:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820452 00010000:00010000:1.0:1713481296.799606:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.799608:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20772:1957:x1796714882495168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.799610:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.799610:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2381:1959:x1796714882495360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 31us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.799613:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.799613:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98374 00010000:00010000:0.0:1713481296.799616:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088155440/0xdfc0fb148802dfd lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d66 expref: 20772 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799617:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.799621:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088155440/0xdfc0fb148802dfd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d66 expref: 20772 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799621:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.799622:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820453 00010000:00010000:1.0:1713481296.799624:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.799625:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16902:1957:x1796714882495104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.799628:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.799629:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.799630:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799631:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cfc9b00/0xdfc0fb1488e7eb5 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5517 expref: 16902 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.799632:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.799632:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+210:3492:x1796714784521088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5761us (5802us total) trans 4296040873 rc 0/0 00010000:00010000:0.0:1713481296.799636:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799636:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cfc9b00/0xdfc0fb1488e7eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5517 expref: 16902 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.799640:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563258 00010000:00010000:0.0:1713481296.799644:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.799647:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cfc9b00/0xdfc0fb1488e7eb5 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5517 expref: 16902 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799651:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801243598c0/0xdfc0fb148a3b2c5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.799652:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20772:1957:x1796714882495168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 43us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.799655:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820452 00010000:00010000:1.0:1713481296.799655:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801243598c0/0xdfc0fb148a3b2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.799659:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801243598c0/0xdfc0fb148a3b2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.799659:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799660:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799675:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008495ba80/0xdfc0fb148a3b191 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4985e expref: 16901 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799681:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820454 00010000:00010000:2.0:1713481296.799681:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008495ba80/0xdfc0fb148a3b191 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4985e expref: 16901 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799683:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a3db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26859:1957:x1796714882495232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00200000:1.0:1713481296.799688:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cb0:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.799689:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:1.0:1713481296.799691:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.799693:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013464f3c0/0xdfc0fb14868915a lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa992:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e4a expref: 26859 pid: 16466 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.799693:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008495ba80/0xdfc0fb148a3b191 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4985e expref: 16901 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799698:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0000_UUID:16624:1796714784524480:192.168.202.24@tcp:105: 00000004:00010000:1.0:1713481296.799700:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801243598c0/0xdfc0fb148a3b2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.799701:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013464f3c0/0xdfc0fb14868915a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa992:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e4a expref: 26859 pid: 16466 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.799704:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121d8bb80/2, rc 0, transno 1073577 00010000:00010000:1.0:1713481296.799707:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.799708:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861e40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.799712:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.799713:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.799713:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784521088:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.799715:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.799717:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799717:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.799722:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.799723:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799728:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088155440/0xdfc0fb148802dfd lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d66 expref: 20771 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.799730:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800733798c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.799733:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.799735:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.799735:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784522240:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.799738:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.799743:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff880091b3c000) 00010000:00010000:1.0:1713481296.799745:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.799746:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799747:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.799748:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26859:1957:x1796714882495232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (280us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.799750:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800733798c0/0xdfc0fb148a3b2b7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.799751:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.799754:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820454 00010000:00010000:2.0:1713481296.799755:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799760:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.799762:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.799762:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799765:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.799766:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.799766:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784524544:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.799768:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007337ba80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.799770:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.799770:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799773:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.799773:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095f7e1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.799774:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799776:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x37 (ffff88009c0ead00) 00010000:00010000:1.0:1713481296.799777:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.799778:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799779:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.799782:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007337ba80/0xdfc0fb148a3b2be lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.799784:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799788:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b1fa lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799792:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013464f3c0/0xdfc0fb14868915a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa992:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e4a expref: 26858 pid: 16466 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.799798:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.799804:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009de22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784522432:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.799806:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89b00/0xdfc0fb148a3b2b0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2caf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ce expref: 2381 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799817:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801243598c0/0xdfc0fb148a3b2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ce expref: 2380 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.799821:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x0 (ffff8801322ecf00) 00010000:00010000:1.0:1713481296.799822:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1713481296.799823:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801243598c0, rc 0) 00010000:00010000:0.0:1713481296.799829:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799836:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.799836:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2380:18765:x1796714882495488:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 284us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.799841:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485862 00010000:00010000:0.0:1713481296.799842:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799849:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799856:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799862:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799868:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084958d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.799871:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799881:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799893:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.799901:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+210:3492:x1796714784522176:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3752us (3825us total) trans 4296040874 rc 0/0 00000100:00100000:2.0:1713481296.799907:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563269 00000004:00080000:3.0:1713481296.799910:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072b7b800/2, rc 0, transno 1073578 00000100:00100000:1.0:1713481296.799913:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.799918:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784522176:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.799924:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784524544 00000100:00100000:2.0:1713481296.799927:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784524544 00000100:00100000:1.0:1713481296.799928:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495552 00000100:00100000:1.0:1713481296.799930:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495552 00000100:00100000:2.0:1713481296.799939:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563291 00000100:00100000:2.0:1713481296.799941:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+210:3491:x1796714784524544:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.799946:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485863 00002000:00080000:2.0:1713481296.799949:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10023 count 1 00000100:00100000:1.0:1713481296.799950:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007286ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2380:18927:x1796714882495552:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:3.0:1713481296.799952:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713481296.799956:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.799956:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.799959:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784524608:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.799963:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012435a1c0/0xdfc0fb148a3b2d3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498d5 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799963:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097fd9d40/0xdfc0fb148802e2e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dc8 expref: 20770 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.799967:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799968:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.799969:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.799976:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084958d80/0xdfc0fb148a3b201 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.799978:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097fd9d40/0xdfc0fb148802e2e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dc8 expref: 20770 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.799981:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.799983:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097fd9d40/0xdfc0fb148802e2e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dc8 expref: 20770 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.799989:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e33d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784524672:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.800001:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978616c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.800007:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800014:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.800016:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784524608 00010000:00010000:1.0:1713481296.800018:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.800020:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784524608 00010000:00010000:1.0:1713481296.800024:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.800026:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973dcfc0/0xdfc0fb1489cfc1b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa222dc expref: 20770 pid: 16512 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.800027:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800031:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.800034:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784521664:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.800038:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563292 00000100:00100000:3.0:1713481296.800042:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+211:3493:x1796714784524608:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.800053:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880086833600/0xdfc0fb148a3b2e8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00002000:00080000:3.0:1713481296.800053:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10024 count 1 00010000:00010000:1.0:1713481296.800056:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880086833600/0xdfc0fb148a3b2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.800058:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092302ac0/0xdfc0fb148a3b175 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4983b expref: 16901 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.800060:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880086833600/0xdfc0fb148a3b2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.800063:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092302ac0, rc 0) 00010000:00010000:3.0:1713481296.800065:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.800070:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16901:18817:x1796714882492224:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 5414us (5480us total) trans 0 rc 0/0 00000004:00200000:1.0:1713481296.800072:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c7b:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.800074:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713481296.800075:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563259 00010000:00010000:3.0:1713481296.800076:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb81d40/0xdfc0fb148802e35 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dd6 expref: 20769 pid: 16538 timeout: 0 lvb_type: 1 00000004:00010000:1.0:1713481296.800078:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880086833600/0xdfc0fb148a3b2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800082:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.800083:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.800084:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.800086:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.800087:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.800091:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800094:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800096:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124359440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.800098:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.800099:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2808:3490:x1796714784522304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3794us (3856us total) trans 4295960749 rc 0/0 00010000:00010000:1.0:1713481296.800101:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.800103:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f801200/0xdfc0fb148959c13 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebde expref: 26857 pid: 16475 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.800103:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb81d40/0xdfc0fb148802e35 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dd6 expref: 20769 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.800105:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563270 00010000:00010000:1.0:1713481296.800105:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.800106:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.800107:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800110:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124359440/0xdfc0fb148a3b2da lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:3.0:1713481296.800113:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb81d40/0xdfc0fb148802e35 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dd6 expref: 20769 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.800115:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784521856:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.800135:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800138:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800140:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800143:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124358b40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.800145:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00000100:00100000:3.0:1713481296.800146:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784524736:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.800150:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.800151:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a8240/0xdfc0fb148a3b183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x82d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49849 expref: 26856 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.800153:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88009a48ae00) 00010000:00010000:1.0:1713481296.800154:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.800156:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.800158:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124358b40/0xdfc0fb148a3b2e1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.800159:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a8240, rc 0) 00000100:00100000:3.0:1713481296.800165:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378c00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.800175:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26856:11552:x1796714882493120:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5233us (5281us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.800181:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563261 00010000:00010000:1.0:1713481296.800183:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012435a1c0/0xdfc0fb148a3b2d3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498d5 expref: 2382 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.800192:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880086833600/0xdfc0fb148a3b2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498d5 expref: 2381 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.800195:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88009852ed00) 00010000:00010000:1.0:1713481296.800196:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.800197:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086833600, rc 0) 00000100:00100000:1.0:1713481296.800208:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007286ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2381:18927:x1796714882495552:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 258us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.800212:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485863 00000100:00100000:0.0:1713481296.800218:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.800228:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495680 00000100:00100000:1.0:1713481296.800230:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495680 00000100:00100000:1.0:1713481296.800248:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485864 00000100:00100000:1.0:1713481296.800251:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2797:18890:x1796714882495680:12345-192.168.202.24@tcp:36:mkdir.0 00000100:00100000:0.0:1713481296.800253:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.800277:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496000 00010000:00010000:1.0:1713481296.800278:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:3.0:1713481296.800281:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496000 00010000:00010000:1.0:1713481296.800284:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800288:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800294:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3631 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800297:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.800297:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800785ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2808:3490:x1796714784521024:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6742us (6788us total) trans 4295960750 rc 0/0 00010000:00010000:1.0:1713481296.800300:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.800303:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563257 00000100:00100000:3.0:1713481296.800304:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485865 00000100:00100000:3.0:1713481296.800310:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2041:18979:x1796714882496000:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.800318:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.800320:0:15576:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713481296.800332:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009b806f40/0xdfc0fb148a3b113 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2ca1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49826 expref: 2041 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.800346:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca1:0x0].0x0 (ffff880120760000) 00010000:00010000:3.0:1713481296.800349:0:15576:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.800356:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007dac1b00/0xdfc0fb148a3b304 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498e3 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.800423:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.800429:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800433:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800442:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00b40/0xdfc0fb148a3b312 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2ca1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.800446:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00b40/0xdfc0fb148a3b312 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2ca1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800450:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00b40/0xdfc0fb148a3b312 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2ca1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.800534:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800539:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800543:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000004:00010000:1.0:1713481296.800550:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a1e1880 reply state ffff8800922dd000 transno 4295105920 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800554:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800558:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5230:0x0].0x0 (ffff88009852ee00) 00010000:00010000:1.0:1713481296.800559:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.800560:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1713481296.800561:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5230:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.800565:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800568:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800571:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800574:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800576:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086831f80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.800578:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800581:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800584:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.800585:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.800586:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800589:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880086831f80/0xdfc0fb148a3b2f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000004:00010000:1.0:1713481296.800601:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a1e1880 reply state ffff8800922dd000 transno 4295105920 ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800607:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.800612:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3631 (ffff88009c260d00) 00010000:00010000:1.0:1713481296.800614:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.800616:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1713481296.800635:0:15576:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba52:0x0], index 1: 0 00000100:00100000:1.0:1713481296.800641:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2799:18890:x1796714882495680:12345-192.168.202.24@tcp:36:mkdir.0 Request processed in 387us (422us total) trans 4295105920 rc 0/0 00000100:00100000:1.0:1713481296.800647:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485864 00000004:00080000:1.0:1713481296.800698:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fdaf800/2, rc 0, transno 993453 00000100:00100000:1.0:1713481296.800712:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784522304:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.800723:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007810ed80/2, rc 0, transno 993454 00010000:00010000:3.0:1713481296.800727:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00240/0xdfc0fb148a3b320 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.800728:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784521024:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.800733:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00240/0xdfc0fb148a3b320 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800737:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00240/0xdfc0fb148a3b320 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800752:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800756:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.800757:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784524864:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.800759:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800762:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800765:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086bc5680 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.800766:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784524800:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.800767:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800770:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.800773:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.800774:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca1:0x0].0x0 (ffff880120760000) 00010000:00010000:3.0:1713481296.800775:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.800777:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.800783:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.800783:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086bc5680/0xdfc0fb148a3b30b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000004:00010000:3.0:1713481296.800792:0:15576:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a1e3480 reply state ffff880078080000 transno 4295107604 ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00b40/0xdfc0fb148a3b312 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2ca1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.800796:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.800796:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00b40/0xdfc0fb148a3b312 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2ca1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.800800:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca1:0x0].0x33 (ffff880083828800) 00010000:00010000:3.0:1713481296.800801:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.800802:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784524864 00000100:00100000:3.0:1713481296.800802:0:15576:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713481296.800804:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784524864 00000100:00100000:2.0:1713481296.800813:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784524800 00000100:00100000:2.0:1713481296.800815:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784524800 00010000:00010000:3.0:1713481296.800820:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007dac1b00/0xdfc0fb148a3b304 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2ca1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498e3 expref: 2043 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.800826:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563293 00010000:00010000:3.0:1713481296.800829:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00240/0xdfc0fb148a3b320 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498e3 expref: 2042 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.800831:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007286f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2809:3490:x1796714784524864:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.800833:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbe:0x0].0x0 (ffff880083828400) 00010000:00010000:3.0:1713481296.800834:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713481296.800836:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc00240, rc 0) 00002000:00080000:2.0:1713481296.800841:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43427 count 1 00000100:00100000:3.0:1713481296.800849:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2043:18979:x1796714882496000:12345-192.168.202.24@tcp:101:touch.0 Request processed in 540us (598us total) trans 4295107604 rc 0/0 00000100:00100000:1.0:1713481296.800851:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.800854:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.800854:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485865 00000100:00100000:1.0:1713481296.800863:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495872 00010000:00010000:2.0:1713481296.800864:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350af180/0xdfc0fb148689199 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ec1 expref: 26855 pid: 16453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.800866:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495872 00010000:00010000:2.0:1713481296.800870:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.800871:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.800874:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.800884:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485866 00000100:00100000:1.0:1713481296.800887:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007286e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18941:x1796714882495872:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:2.0:1713481296.800889:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350af180/0xdfc0fb148689199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ec1 expref: 26855 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.800893:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.800898:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac2ac0/0xdfc0fb148a3b335 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498dc expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.800898:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350af180/0xdfc0fb148689199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ec1 expref: 26855 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.800907:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784524928:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.800923:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861540 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.800937:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.800939:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563294 00010000:00010000:1.0:1713481296.800942:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.800943:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2809:3493:x1796714784524800:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.800946:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.800954:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00002000:00080000:2.0:1713481296.800954:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43424 count 1 00010000:00010000:1.0:1713481296.800957:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.800960:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.800965:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.800973:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801349e1b00/0xdfc0fb148689192 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2eb3 expref: 26855 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.800979:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.800980:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.800982:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.800985:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a833180/0xdfc0fb148a3b351 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.800988:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a833180/0xdfc0fb148a3b351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.800992:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a833180/0xdfc0fb148a3b351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.800997:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801349e1b00/0xdfc0fb148689192 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2eb3 expref: 26855 pid: 16485 timeout: 0 lvb_type: 1 00000004:00200000:1.0:1713481296.801003:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x3866:0x0]: returning size 4096 00010000:00010000:2.0:1713481296.801004:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801349e1b00/0xdfc0fb148689192 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2eb3 expref: 26855 pid: 16485 timeout: 815 lvb_type: 1 00000004:00200000:1.0:1713481296.801005:0:15642:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713481296.801010:0:15642:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a833180/0xdfc0fb148a3b351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.801013:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784524992:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.801014:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801017:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801020:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801023:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801027:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009aac0480 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.801028:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.801029:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801033:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801037:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.801038:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.801039:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801042:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac0480/0xdfc0fb148a3b33c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801052:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801055:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801058:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801060:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a831680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.801061:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801064:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801067:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff8800907b5600) 00010000:00010000:1.0:1713481296.801068:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.801069:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801072:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a831680/0xdfc0fb148a3b343 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.801095:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac2ac0/0xdfc0fb148a3b335 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498dc expref: 2206 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.801105:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a833180/0xdfc0fb148a3b351 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498dc expref: 2205 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.801109:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff880090802b00) 00010000:00010000:1.0:1713481296.801110:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.801111:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a833180, rc 0) 00000100:00100000:1.0:1713481296.801141:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007286e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:18941:x1796714882495872:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 252us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.801145:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485866 00000100:00100000:2.0:1713481296.801156:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882495808 00000100:00100000:2.0:1713481296.801160:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882495808 00000100:00100000:2.0:1713481296.801189:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125693 00000100:00100000:2.0:1713481296.801193:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007286e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2381:18963:x1796714882495808:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:2.0:1713481296.801313:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007286e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2382:18963:x1796714882495808:12345-192.168.202.24@tcp:35:touch.0 Request processed in 118us (514us total) trans 4295107605 rc 0/0 00000100:00100000:2.0:1713481296.801319:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125693 00000100:00100000:0.0:1713481296.801606:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2042:18678:x1796714882493952:12345-192.168.202.24@tcp:37:rm.0 Request processed in 5033us (5094us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.801613:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125692 00000100:00100000:2.0:1713481296.801653:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784522496:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.801678:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.801987:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0001_UUID:16463:1796714784522688:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.801992:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.802009:0:16463:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.802025:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496064 00000100:00100000:2.0:1713481296.802028:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496064 00010000:00010000:2.0:1713481296.802039:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800833761c0/0xdfc0fb148689161 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e5f expref: 26856 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.802044:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15560:1796714784522752:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.802060:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.802065:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820455 00000100:00100000:2.0:1713481296.802070:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26856:1959:x1796714882496064:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.802077:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.802081:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800833761c0/0xdfc0fb148689161 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa994:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e5f expref: 26856 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.802089:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800833761c0/0xdfc0fb148689161 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa994:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e5f expref: 26856 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.802102:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784522880:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.802104:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800833761c0/0xdfc0fb148689161 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa994:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e5f expref: 26856 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.802112:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.802116:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.802117:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.802139:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.802145:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802146:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802162:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.802180:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26855:1959:x1796714882496064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 109us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.802184:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820455 00000100:00100000:1.0:1713481296.802281:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496128 00000100:00100000:1.0:1713481296.802284:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496128 00010000:00010000:2.0:1713481296.802290:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802294:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083377840/0xdfc0fb148689168 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e6d expref: 26855 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.802295:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802299:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802303:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802306:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.802307:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820456 00000100:00100000:1.0:1713481296.802310:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26855:1960:x1796714882496128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.802310:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095f7f600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.802311:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802315:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.802317:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083377840/0xdfc0fb148689168 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa997:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e6d expref: 26855 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.802318:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802322:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083377840/0xdfc0fb148689168 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa997:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e6d expref: 26855 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.802327:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802330:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f7f600/0xdfc0fb148a3b208 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802333:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083377840/0xdfc0fb148689168 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa997:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e6d expref: 26855 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.802341:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.802342:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.802344:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802349:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.802354:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009de20700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784522944:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.802360:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.802373:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26854:1960:x1796714882496128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.802377:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820456 00010000:00010000:1.0:1713481296.802392:0:16463:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802396:0:16463:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802404:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802407:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802411:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802414:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095f7e640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.802417:0:16463:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802422:0:16463:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.802423:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.802424:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2810:3491:x1796714784522368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6063us (6116us total) trans 4295960751 rc 0/0 00000100:00100000:2.0:1713481296.802428:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563271 00010000:00010000:1.0:1713481296.802433:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802439:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f7e640/0xdfc0fb148a3b20f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.802440:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20769:1960:x1796714882492864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4993us (5080us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.802445:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820440 00000100:00100000:1.0:1713481296.802560:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e33c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:lustre-MDT0001-mdtlov_UUID+2810:3493:x1796714784522624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5656us (5714us total) trans 4295960752 rc 0/0 00000100:00100000:1.0:1713481296.802564:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563272 00000004:00080000:1.0:1713481296.802589:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e33f480/2, rc 0, transno 993456 00000100:00100000:1.0:1713481296.802594:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784522624:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.802615:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1713481296.802617:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e33f800/2, rc 0, transno 993455 00000100:00100000:1.0:1713481296.802619:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007286c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784525056:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.802622:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784522368:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.802631:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.802646:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784525056 00000100:00100000:2.0:1713481296.802649:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784525056 00000100:00100000:1.0:1713481296.802661:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.802675:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563295 00000100:00100000:2.0:1713481296.802679:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2810:3490:x1796714784525056:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.802682:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007286dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784525120:0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.802690:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43429 count 1 00000100:00100000:1.0:1713481296.802695:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.802701:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802711:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009916d8c0/0xdfc0fb14868925d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ed6 expref: 26853 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.802717:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.802717:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.802719:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.802721:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.802736:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.802737:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009916d8c0/0xdfc0fb14868925d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ed6 expref: 26853 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.802744:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496256 00000100:00100000:1.0:1713481296.802746:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496256 00010000:00010000:2.0:1713481296.802746:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009916d8c0/0xdfc0fb14868925d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ed6 expref: 26853 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.802755:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097fd86c0/0xdfc0fb148802e0b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d82 expref: 20769 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.802755:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784525184:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.802764:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496192 00000100:00100000:1.0:1713481296.802765:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496192 00010000:00010000:1.0:1713481296.802769:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca23180/0xdfc0fb148802e04 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d74 expref: 20770 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.802774:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092fbf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.802777:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820457 00000100:00100000:1.0:1713481296.802780:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20770:1960:x1796714882496256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.802784:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.802787:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097fd86c0/0xdfc0fb148802e0b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d82 expref: 20770 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.802787:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784525120 00000100:00100000:2.0:1713481296.802789:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784525120 00010000:00010000:1.0:1713481296.802792:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097fd86c0/0xdfc0fb148802e0b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d82 expref: 20770 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.802803:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563296 00010000:00010000:1.0:1713481296.802807:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097fd86c0/0xdfc0fb148802e0b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d82 expref: 20770 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.802808:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2811:3493:x1796714784525120:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.802817:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713481296.802817:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43431 count 1 00010000:00010000:1.0:1713481296.802818:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.802820:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802825:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802827:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.802836:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091834b40/0xdfc0fb148689264 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ee4 expref: 26853 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.802842:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.802843:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.802844:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.802846:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.802848:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.802856:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20769:1960:x1796714882496256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (138us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.802856:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.802859:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820458 00010000:00010000:2.0:1713481296.802860:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091834b40/0xdfc0fb148689264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ee4 expref: 26853 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.802863:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820457 00010000:00010000:3.0:1713481296.802864:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.802866:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20769:1960:x1796714882496192:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.802869:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091834b40/0xdfc0fb148689264 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ee4 expref: 26853 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.802871:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.802873:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.802878:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca23180/0xdfc0fb148802e04 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d74 expref: 20768 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.802878:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784525248:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.802878:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.802883:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bbc000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.802886:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca23180/0xdfc0fb148802e04 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d74 expref: 20768 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.802886:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.802892:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.802898:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097998c00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.802902:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca23180/0xdfc0fb148802e04 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d74 expref: 20768 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.802904:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.802911:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099bbc000/0xdfc0fb148a3b21d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.802912:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.802913:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.802914:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.802919:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.802920:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784523008:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.802932:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.802934:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c0eac0/0xdfc0fb148a3b22b lrc: 3/0,0 mode: --/PW res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49896 expref: 20767 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802940:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c0eac0, rc 0) 00000100:00100000:0.0:1713481296.802945:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20767:1960:x1796714882496192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.802948:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820458 00000100:00100000:1.0:1713481296.802951:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20767:14753:x1796714882494144:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5228us (5445us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.802955:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563276 00010000:00010000:1.0:1713481296.802972:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802979:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802984:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802988:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802991:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.802994:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120998240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.802996:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803000:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803007:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803010:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880120998240/0xdfc0fb148a3b216 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.803056:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+213:3490:x1796714784522816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5563us (5606us total) trans 4296040875 rc 0/0 00000100:00100000:0.0:1713481296.803062:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009de21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784523456:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.803063:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563274 00000004:00080000:2.0:1713481296.803069:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a49f80/2, rc 0, transno 1073579 00000100:00100000:2.0:1713481296.803078:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784522816:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.803082:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.803109:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+212:3493:x1796714784522560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6165us (6242us total) trans 4296040876 rc 0/0 00000100:00100000:1.0:1713481296.803114:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563273 00000100:00100000:3.0:1713481296.803143:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.803152:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784525312:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.803153:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.803163:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496448 00000100:00100000:1.0:1713481296.803166:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496448 00000100:00100000:3.0:1713481296.803175:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.803183:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784525312 00000100:00100000:1.0:1713481296.803186:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784525312 00000100:00100000:0.0:1713481296.803188:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.803191:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0000_UUID:16525:1796714784523584:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.803197:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563297 00000100:00100000:1.0:1713481296.803201:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16901:17009:x1796714882496448:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.803203:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496384 00000100:00100000:0.0:1713481296.803206:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496384 00010000:00010000:1.0:1713481296.803208:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.803217:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8318c0/0xdfc0fb148a3b366 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498ea expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.803217:0:16525:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803219:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007960bcc0/0xdfc0fb148802e12 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d90 expref: 20766 pid: 9202 timeout: 815 lvb_type: 1 00002000:00010000:1.0:1713481296.803227:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.803233:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563298 00010000:00010000:1.0:1713481296.803235:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.803236:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+212:3492:x1796714784525312:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.803237:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820459 00010000:00010000:1.0:1713481296.803237:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.803240:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8318c0/0xdfc0fb148a3b366 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ea expref: 16902 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.803241:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20766:1960:x1796714882496384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00002000:00080000:2.0:1713481296.803245:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10025 count 1 00010000:00010000:0.0:1713481296.803248:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.803249:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8318c0/0xdfc0fb148a3b366 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ea expref: 16902 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803252:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007960bcc0/0xdfc0fb148802e12 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d90 expref: 20766 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.803252:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803256:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8318c0, rc 0) 00010000:00010000:2.0:1713481296.803259:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097d63a80/0xdfc0fb148802e3c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2729:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962de4 expref: 20766 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.803260:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007960bcc0/0xdfc0fb148802e12 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d90 expref: 20766 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.803263:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.803264:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.803265:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.803273:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16902:17009:x1796714882496448:12345-192.168.202.24@tcp:101:dd.0 Request processed in 71us (121us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.803276:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.803278:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.803278:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563297 00010000:00010000:2.0:1713481296.803278:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097d63a80/0xdfc0fb148802e3c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2729:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962de4 expref: 20766 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.803280:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.803284:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097d63a80/0xdfc0fb148802e3c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2729:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962de4 expref: 20766 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.803286:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.803289:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784525376:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.803300:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.803302:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097998300 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.803309:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007960bcc0/0xdfc0fb148802e12 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d90 expref: 20766 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.803318:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20766:1960:x1796714882496384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.803324:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820459 00000100:00100000:1.0:1713481296.803330:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784523200:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.803350:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803355:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.803356:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.803359:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803363:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803366:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.803367:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496576 00000100:00100000:0.0:1713481296.803369:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496576 00010000:00010000:1.0:1713481296.803372:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803376:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098c0c480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.803378:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350aeac0/0xdfc0fb148689176 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e7b expref: 26854 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.803379:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803385:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.803391:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820460 00000100:00100000:0.0:1713481296.803394:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26854:1960:x1796714882496576:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.803400:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.803400:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803403:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350aeac0/0xdfc0fb148689176 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa999:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e7b expref: 26854 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.803405:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c0c480/0xdfc0fb148a3b232 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803410:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350aeac0/0xdfc0fb148689176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa999:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e7b expref: 26854 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.803421:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350aeac0/0xdfc0fb148689176 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa999:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e7b expref: 26854 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.803430:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.803431:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.803433:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803439:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803456:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.803465:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26853:1960:x1796714882496576:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.803470:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820460 00010000:00010000:0.0:1713481296.803485:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803491:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803497:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803502:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.803506:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784523520:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.803507:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803512:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008495b600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.803514:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803520:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803522:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803533:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.803539:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b239 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.803543:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e33fb80/2, rc 0, transno 1073580 00000100:00100000:1.0:1713481296.803548:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784522560:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.803557:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+213:3490:x1796714784523072:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5636us (5717us total) trans 4296040877 rc 0/0 00000100:00100000:2.0:1713481296.803561:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563277 00000100:00100000:2.0:1713481296.803593:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784525440:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.803594:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.803604:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.803613:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.803619:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072b2d880/2, rc 0, transno 1073581 00000100:00100000:2.0:1713481296.803623:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784523072:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.803643:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.803648:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784525504:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.803680:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2812:3492:x1796714784523136:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5707us (5821us total) trans 4295960753 rc 0/0 00000100:00100000:1.0:1713481296.803683:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.803686:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563278 00000100:00100000:2.0:1713481296.803693:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.803695:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076879880/2, rc 0, transno 993457 00000100:00100000:1.0:1713481296.803702:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496320 00000100:00100000:0.0:1713481296.803704:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784525440 00000100:00100000:1.0:1713481296.803705:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496320 00000100:00100000:3.0:1713481296.803705:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784523136:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.803706:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784525440 00000100:00100000:0.0:1713481296.803717:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784525504 00010000:00010000:1.0:1713481296.803717:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098edd8c0/0xdfc0fb148a13f0a lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3800a expref: 20765 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.803719:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784525504 00000100:00100000:0.0:1713481296.803729:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563299 00000100:00100000:2.0:1713481296.803729:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784523776:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.803732:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+214:3490:x1796714784525440:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.803732:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496512 00000100:00100000:1.0:1713481296.803734:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496512 00010000:00010000:1.0:1713481296.803740:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083377180/0xdfc0fb14868917d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e89 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00002000:00080000:0.0:1713481296.803742:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10026 count 1 00000100:00100000:1.0:1713481296.803747:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496640 00010000:00010000:2.0:1713481296.803748:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133a7fa80/0xdfc0fb148a3b271 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498a4 expref: 24479 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.803748:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784525568:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.803749:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496640 00010000:00010000:0.0:1713481296.803752:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803753:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088157600/0xdfc0fb148802e19 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d9e expref: 20766 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.803755:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133a7fa80, rc 0) 00010000:00010000:0.0:1713481296.803762:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134681200/0xdfc0fb148802e43 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962df2 expref: 20766 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.803762:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820461 00000100:00100000:1.0:1713481296.803765:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20766:1960:x1796714882496320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.803767:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.803768:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10479:x1796714882494464:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5064us (5133us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.803769:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.803770:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.803771:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.803772:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.803773:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563282 00010000:00010000:1.0:1713481296.803777:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098edd8c0/0xdfc0fb148a13f0a lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc178:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3800a expref: 20766 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.803782:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098edd8c0/0xdfc0fb148a13f0a lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc178:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3800a expref: 20766 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.803787:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784525568 00010000:00010000:0.0:1713481296.803788:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134681200/0xdfc0fb148802e43 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962df2 expref: 20766 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.803789:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784525568 00010000:00010000:1.0:1713481296.803793:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098edd8c0/0xdfc0fb148a13f0a lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc178:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3800a expref: 20766 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.803795:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134681200/0xdfc0fb148802e43 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962df2 expref: 20766 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.803800:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563300 00010000:00010000:1.0:1713481296.803803:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.803803:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+214:3490:x1796714784525504:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.803804:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784525632:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.803804:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.803807:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c0eac0/0xdfc0fb148a3b22b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49896 expref: 20765 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803811:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c0eac0/0xdfc0fb148a3b22b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49896 expref: 20765 pid: 16481 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.803814:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10027 count 1 00000100:00100000:0.0:1713481296.803822:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098746d80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.803822:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c0eac0/0xdfc0fb148a3b22b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49896 expref: 20765 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.803824:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.803831:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096762680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784525696:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.803834:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caacb40/0xdfc0fb148802e4a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x272b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e00 expref: 20765 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.803837:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563301 00010000:00010000:2.0:1713481296.803839:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.803840:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2812:3492:x1796714784525568:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.803840:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.803842:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.803846:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009996a540 going to sleep for 11 seconds 00002000:00080000:0.0:1713481296.803848:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43433 count 1 00010000:00010000:0.0:1713481296.803855:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.803858:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012caacb40/0xdfc0fb148802e4a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e00 expref: 20765 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.803861:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c201680/0xdfc0fb14868926b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ef9 expref: 26853 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.803862:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820462 00010000:00010000:0.0:1713481296.803865:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.803865:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26853:1960:x1796714882496512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.803866:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.803866:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012caacb40/0xdfc0fb148802e4a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e00 expref: 20765 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.803867:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803869:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.803872:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083377180/0xdfc0fb14868917d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e89 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.803875:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784525760:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.803876:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c201680/0xdfc0fb14868926b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ef9 expref: 26853 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.803877:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083377180/0xdfc0fb14868917d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e89 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.803887:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c201680/0xdfc0fb14868926b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ef9 expref: 26853 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.803887:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083377180/0xdfc0fb14868917d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e89 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.803894:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f5ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.803895:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007970bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784525824:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.803896:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.803897:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.803899:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.803906:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.803909:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978610c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.803917:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820463 00010000:00010000:1.0:1713481296.803921:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.803922:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20765:1960:x1796714882496640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.803928:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.803933:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088157600/0xdfc0fb148802e19 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d9e expref: 20765 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.803935:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26852:1960:x1796714882496512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (320us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.803941:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088157600/0xdfc0fb148802e19 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d9e expref: 20765 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.803942:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820462 00000100:00100000:0.0:1713481296.803946:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.803957:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496704 00000100:00100000:1.0:1713481296.803960:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496704 00010000:00010000:2.0:1713481296.803961:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088157600/0xdfc0fb148802e19 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962d9e expref: 20765 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.803968:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca23cc0/0xdfc0fb148802e20 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dac expref: 20765 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.803971:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.803972:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.803975:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.803981:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.803991:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820464 00000100:00100000:1.0:1713481296.803995:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20765:1960:x1796714882496704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.804001:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.804001:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.804001:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784523840:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.804004:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca23cc0/0xdfc0fb148802e20 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dac expref: 20765 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.804011:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca23cc0/0xdfc0fb148802e20 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dac expref: 20765 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.804014:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20765:1960:x1796714882496640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (331us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.804018:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.804020:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820463 00010000:00010000:1.0:1713481296.804023:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.804024:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.804027:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804032:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804042:0:16525:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804045:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.804049:0:16525:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804056:0:16525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.804058:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20764:1960:x1796714882496704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (112us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.804061:0:16525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.804064:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820464 00010000:00010000:2.0:1713481296.804067:0:16525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804071:0:16525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bbd680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.804074:0:16525:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804080:0:16525:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804086:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804092:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804092:0:16525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804096:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b240 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.804099:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.804100:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804106:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804112:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804136:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008214c900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.804138:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804142:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804150:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804154:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008214c900/0xdfc0fb148a3b24e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.804227:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.804237:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:lustre-MDT0001-mdtlov_UUID+215:3493:x1796714784523264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6126us (6191us total) trans 4296040878 rc 0/0 00000100:00100000:2.0:1713481296.804242:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563279 00000100:00100000:0.0:1713481296.804245:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496832 00000100:00100000:0.0:1713481296.804248:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496832 00000004:00080000:3.0:1713481296.804249:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096763b80/2, rc 0, transno 1073582 00000100:00100000:1.0:1713481296.804257:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2813:3490:x1796714784523392:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6104us (6148us total) trans 4295960754 rc 0/0 00000100:00100000:2.0:1713481296.804260:0:16525:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563302 00000100:00100000:3.0:1713481296.804260:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784523264:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.804263:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563281 00000100:00100000:2.0:1713481296.804263:0:16525:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:17924:x1796714882496832:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.804268:0:16525:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.804274:0:16525:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b389 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498f1 expref: -99 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804284:0:16525:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007991e1c0/0xdfc0fb148a16265 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3983d expref: 24480 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.804287:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.804288:0:16525:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.804290:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007df4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784524032:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.804290:0:16525:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b389 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498f1 expref: 24480 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.804292:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.804297:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a1e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784524096:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.804299:0:16525:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007991e1c0/0xdfc0fb148a16265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3983d expref: 24480 pid: 16498 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.804299:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784525888:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.804304:0:16525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007991e1c0/0xdfc0fb148a16265 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3983d expref: 24480 pid: 16498 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.804306:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.804309:0:16525:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784525952:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.804312:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.804320:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497856 00000100:00100000:3.0:1713481296.804322:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.804323:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497856 00000100:00100000:0.0:1713481296.804324:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20763:1960:x1796714882494592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5350us (5452us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.804324:0:16525:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.804329:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820446 00000100:00100000:1.0:1713481296.804347:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784525888 00000100:00100000:1.0:1713481296.804350:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784525888 00000004:00080000:2.0:1713481296.804353:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121aeb100/2, rc 0, transno 993458 00000100:00100000:2.0:1713481296.804362:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784523392:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.804371:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485867 00000100:00100000:1.0:1713481296.804372:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563303 00000100:00100000:1.0:1713481296.804378:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+215:3492:x1796714784525888:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.804378:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2382:18765:x1796714882497856:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.804386:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:1.0:1713481296.804390:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10028 count 1 00000100:00100000:0.0:1713481296.804391:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.804396:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b390 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49922 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804401:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.804404:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496896 00000100:00100000:0.0:1713481296.804407:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496896 00010000:00010000:1.0:1713481296.804411:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f055d40/0xdfc0fb148802e51 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e0e expref: 20763 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.804417:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.804418:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.804420:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.804427:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563304 00000100:00100000:0.0:1713481296.804432:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20763:18792:x1796714882496896:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.804435:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f055d40/0xdfc0fb148802e51 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e0e expref: 20763 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.804439:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.804443:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f055d40/0xdfc0fb148802e51 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e0e expref: 20763 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.804446:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca23cc0/0xdfc0fb148802e20 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dac expref: 20763 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.804449:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c071200/0xdfc0fb148a3b39e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc51e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498f8 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.804451:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784526016:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.804456:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784523648:192.168.202.24@tcp:104: 00002000:00010000:0.0:1713481296.804459:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc51e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.804463:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d3786c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.804468:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.804469:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.804472:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c071200/0xdfc0fb148a3b39e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498f8 expref: 20763 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804472:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804477:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804480:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804481:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007c071200/0xdfc0fb148a3b39e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498f8 expref: 20763 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804484:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804487:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c071200, rc 0) 00010000:00010000:2.0:1713481296.804488:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.804490:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.804491:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804494:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134aa7180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.804496:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.804499:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.804500:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20763:18792:x1796714882496896:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 68us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.804500:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.804504:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563304 00010000:00010000:3.0:1713481296.804506:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.804511:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.804515:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134aa7180/0xdfc0fb148a3b247 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.804517:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.804523:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804529:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804561:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097144b40/0xdfc0fb148a3b3b3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.804568:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097144b40/0xdfc0fb148a3b3b3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.804573:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784524160:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.804574:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097144b40/0xdfc0fb148a3b3b3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000004:00200000:3.0:1713481296.804581:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cb7:0x0]: returning size 5 00000100:00100000:2.0:1713481296.804605:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784524288:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.804606:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.804618:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.804621:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.804624:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.804624:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804633:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.804638:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26851:1960:x1796714882494656:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5307us (5609us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.804638:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804642:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986cc000 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.804644:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820449 00010000:00010000:3.0:1713481296.804644:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804649:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804655:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x0 (ffff8801322ecf00) 00010000:00010000:3.0:1713481296.804657:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.804659:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804677:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b3a5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2cb0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.804692:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784524416:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.804696:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804699:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.804702:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.804702:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.804704:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.804705:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986cd680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.804706:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.804713:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.804716:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1957:x1796714882494976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5244us (5499us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.804718:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb0:0x0].0x37 (ffff88012f807b00) 00010000:00010000:3.0:1713481296.804719:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.804720:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.804722:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.804723:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820451 00010000:00010000:3.0:1713481296.804723:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b3ac lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb0:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.804733:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a1e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784524224:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.804749:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.804750:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092dbef40/0xdfc0fb148a3b28d lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ab expref: 16901 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.804752:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784524992:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.804756:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b390 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cb0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49922 expref: 2385 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.804758:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496960 00010000:00010000:0.0:1713481296.804759:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dbef40, rc 0) 00000100:00100000:1.0:1713481296.804760:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496960 00010000:00010000:3.0:1713481296.804764:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097144b40/0xdfc0fb148a3b3b3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49922 expref: 2384 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.804769:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb7:0x0].0x0 (ffff88009c077100) 00000100:00100000:1.0:1713481296.804770:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497024 00010000:00010000:3.0:1713481296.804770:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1713481296.804771:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16901:18836:x1796714882494848:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 5517us (5693us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.804771:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497024 00010000:00010000:2.0:1713481296.804771:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.804771:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097144b40, rc 0) 00000100:00100000:0.0:1713481296.804776:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563286 00000100:00100000:1.0:1713481296.804776:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497088 00000100:00100000:1.0:1713481296.804777:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497088 00000100:00100000:1.0:1713481296.804783:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497344 00000100:00100000:1.0:1713481296.804784:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497344 00000100:00100000:3.0:1713481296.804785:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2384:18765:x1796714882497856:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 408us (687us total) trans 4295107606 rc 0/0 00000100:00100000:3.0:1713481296.804789:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485867 00000100:00100000:1.0:1713481296.804792:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563305 00000100:00100000:2.0:1713481296.804794:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0000_UUID:16624:1796714784524480:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.804797:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563306 00000100:00100000:1.0:1713481296.804797:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26852:17935:x1796714882496960:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.804801:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20763:15045:x1796714882497024:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.804802:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.804804:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.804807:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.804810:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133daf840/0xdfc0fb148a3b3c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb797:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa498ff expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804815:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afee640/0xdfc0fb148a3b3c8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49906 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.804817:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16901:1957:x1796714882495104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5190us (5372us total) trans 0 rc 0/0 00002000:00010000:1.0:1713481296.804818:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb797:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1713481296.804824:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.804825:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.804826:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.804827:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820453 00010000:00010000:1.0:1713481296.804829:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133daf840/0xdfc0fb148a3b3c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ff expref: 26853 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804831:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.804833:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.804835:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133daf840/0xdfc0fb148a3b3c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ff expref: 26853 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804836:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afee640/0xdfc0fb148a3b3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49906 expref: 20764 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.804840:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133daf840, rc 0) 00010000:00010000:0.0:1713481296.804844:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afee640/0xdfc0fb148a3b3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49906 expref: 20764 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804849:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afee640, rc 0) 00000100:00100000:1.0:1713481296.804850:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26853:17935:x1796714882496960:12345-192.168.202.24@tcp:101:dd.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.804854:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563305 00000100:00100000:0.0:1713481296.804859:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20764:15045:x1796714882497024:12345-192.168.202.24@tcp:101:dd.0 Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.804864:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563306 00000100:00100000:1.0:1713481296.804866:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563307 00000100:00100000:1.0:1713481296.804869:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26852:18817:x1796714882497088:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.804873:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.804878:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133dacb40/0xdfc0fb148a3b3cf lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4990d expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.804879:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563308 00000100:00100000:0.0:1713481296.804883:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16900:11552:x1796714882497344:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.804887:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122aec000/0xdfc0fb1489cfd25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2233e expref: 24479 pid: 16506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804889:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.804891:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.804891:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.804893:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133dacb40/0xdfc0fb148a3b3cf lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4990d expref: 26853 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804895:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afee880/0xdfc0fb148a3b3d6 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49914 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.804897:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e33d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784524672:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.804902:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122aec000/0xdfc0fb1489cfd25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2233e expref: 24479 pid: 16506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.804909:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880120960240/0xdfc0fb14895a153 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebe5 expref: 16901 pid: 16476 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.804911:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122aec000/0xdfc0fb1489cfd25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2233e expref: 24479 pid: 16506 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.804913:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.804916:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120077b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784526080:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.804919:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.804920:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.804924:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afee880/0xdfc0fb148a3b3d6 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49914 expref: 16901 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.804925:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800736ee9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.804938:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880120960240/0xdfc0fb14895a153 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebe5 expref: 16901 pid: 16476 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.804939:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784524928:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.804947:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880120960240/0xdfc0fb14895a153 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebe5 expref: 16901 pid: 16476 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.804947:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.804955:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009de20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784526144:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.804957:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.804959:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.804966:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497984 00000100:00100000:0.0:1713481296.804967:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.804968:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497984 00000100:00100000:1.0:1713481296.804977:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563309 00000100:00100000:1.0:1713481296.804980:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16902:8499:x1796714882497984:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.804984:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.804985:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a1e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784524352:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.804989:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133dad8c0/0xdfc0fb148a3b3dd lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49930 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.804997:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713481296.804999:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991deac0/0xdfc0fb1488e7e61 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b551e expref: 16903 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.805003:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.805004:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.805006:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.805006:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133dad8c0/0xdfc0fb148a3b3dd lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49930 expref: 16903 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.805006:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784526208:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.805006:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497664 00000100:00100000:3.0:1713481296.805010:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497664 00000100:00100000:0.0:1713481296.805013:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4018850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26853:1960:x1796714882494784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5662us (5959us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.805015:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991deac0/0xdfc0fb1488e7e61 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b551e expref: 16903 pid: 16467 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.805017:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820450 00010000:00010000:1.0:1713481296.805024:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991deac0/0xdfc0fb1488e7e61 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b551e expref: 16903 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.805028:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.805029:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078343b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784526272:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.805031:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485868 00000100:00100000:3.0:1713481296.805036:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2042:18932:x1796714882497664:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:1.0:1713481296.805041:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084aabf00 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.805045:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.805052:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784526208 00000100:00100000:1.0:1713481296.805053:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784526208 00010000:00010000:3.0:1713481296.805054:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097144000/0xdfc0fb148a3b3e4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4991b expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.805064:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563310 00000100:00100000:1.0:1713481296.805066:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2813:3491:x1796714784526208:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.805073:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43435 count 1 00010000:00010000:1.0:1713481296.805080:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805086:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009916c6c0/0xdfc0fb148689272 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f07 expref: 26852 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.805090:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.805090:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.805092:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805101:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009916c6c0/0xdfc0fb148689272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f07 expref: 26852 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.805104:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.805105:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009916c6c0/0xdfc0fb148689272 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f07 expref: 26852 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.805110:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.805114:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078340380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784526336:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.805136:0:16463:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497920 00010000:00010000:3.0:1713481296.805138:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.805139:0:16463:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497920 00000100:00100000:1.0:1713481296.805141:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f869840 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.805145:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805155:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.805160:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.805161:0:16463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563311 00000100:00100000:2.0:1713481296.805164:0:16463:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16904:11388:x1796714882497920:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.805165:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.805169:0:16463:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.805176:0:16463:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930a7180/0xdfc0fb148a3b400 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49929 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805185:0:16463:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3180/0xdfc0fb148942187 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03cd expref: 20763 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.805189:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.805190:0:16463:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.805192:0:16463:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930a7180/0xdfc0fb148a3b400 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49929 expref: 16905 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.805200:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b407 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.805201:0:16463:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3180/0xdfc0fb148942187 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03cd expref: 20763 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.805204:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b407 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.805207:0:16463:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3180/0xdfc0fb148942187 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03cd expref: 20763 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.805208:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b407 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.805212:0:16463:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007df4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784526400:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.805224:0:16463:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861540 going to sleep for 11 seconds 00000004:00200000:3.0:1713481296.805246:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34a4:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.805248:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1713481296.805254:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b407 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805259:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805263:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805266:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805269:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805272:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800971446c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.805273:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805276:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805280:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.805282:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.805283:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805286:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800971446c0/0xdfc0fb148a3b3f2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805295:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.805296:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.805298:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805301:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805304:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008495a880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.805306:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805309:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.805312:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497152 00010000:00010000:3.0:1713481296.805312:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff88012f807e00) 00010000:00010000:3.0:1713481296.805314:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.805315:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497152 00010000:00010000:3.0:1713481296.805315:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.805317:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008495a880/0xdfc0fb148a3b3f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.805328:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350acd80/0xdfc0fb148689184 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e97 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.805331:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.805336:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097144000/0xdfc0fb148a3b3e4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4991b expref: 2044 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.805342:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b407 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4991b expref: 2043 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.805344:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497408 00010000:00010000:3.0:1713481296.805345:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34a4:0x0].0x0 (ffff88012f807a00) 00000100:00100000:2.0:1713481296.805346:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497408 00010000:00010000:3.0:1713481296.805346:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.805348:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b14fcc0, rc 0) 00000100:00100000:0.0:1713481296.805351:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820465 00010000:00010000:2.0:1713481296.805354:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097fd9d40/0xdfc0fb148802e2e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dc8 expref: 20764 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.805356:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26853:1960:x1796714882497152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.805361:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2043:18932:x1796714882497664:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 325us (413us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.805362:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.805365:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820466 00000100:00100000:3.0:1713481296.805366:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485868 00010000:00010000:0.0:1713481296.805367:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350acd80/0xdfc0fb148689184 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e97 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.805368:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20764:1960:x1796714882497408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.805369:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.805372:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.805374:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097fd9d40/0xdfc0fb148802e2e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dc8 expref: 20764 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.805375:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350acd80/0xdfc0fb148689184 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e97 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.805380:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097fd9d40/0xdfc0fb148802e2e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dc8 expref: 20764 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.805390:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350acd80/0xdfc0fb148689184 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2e97 expref: 26853 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.805390:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097fd9d40/0xdfc0fb148802e2e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dc8 expref: 20764 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.805395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.805402:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.805404:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.805404:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.805405:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.805406:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805407:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.805407:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498112 00000100:00100000:1.0:1713481296.805410:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498112 00010000:00010000:2.0:1713481296.805411:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805413:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.805413:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784524736:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.805421:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.805423:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26108 00000100:00100000:1.0:1713481296.805426:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2384:18927:x1796714882498112:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:3.0:1713481296.805427:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.805429:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20763:1960:x1796714882497408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (100us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.805430:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.805433:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820466 00000100:00100000:0.0:1713481296.805442:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26852:1960:x1796714882497152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.805442:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882496768 00010000:00010000:3.0:1713481296.805443:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805444:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1713481296.805444:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882496768 00000100:00100000:0.0:1713481296.805448:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820465 00010000:00010000:3.0:1713481296.805448:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805449:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007995d440/0xdfc0fb148916dc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c658b expref: 24480 pid: 16496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.805452:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805455:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800922e4b40/0xdfc0fb148a3b1f3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49888 expref: 2384 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.805456:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.805458:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820467 00010000:00010000:3.0:1713481296.805459:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.805460:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1960:x1796714882496768:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.805462:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b14db00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.805464:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805465:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.805467:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff880091b3c000) 00010000:00010000:3.0:1713481296.805467:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805471:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007995d440/0xdfc0fb148916dc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c658b expref: 24480 pid: 16496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.805476:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007995d440/0xdfc0fb148916dc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c658b expref: 24480 pid: 16496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.805478:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.805479:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.805481:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086833600/0xdfc0fb148a3b2e8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498d5 expref: 2383 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.805484:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b14db00/0xdfc0fb148a3b278 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805488:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007995d440/0xdfc0fb148916dc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c658b expref: 24480 pid: 16496 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.805494:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497280 00010000:00010000:1.0:1713481296.805494:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88009852ed00) 00010000:00010000:2.0:1713481296.805495:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.805496:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.805497:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497280 00010000:00010000:2.0:1713481296.805498:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133a7fa80/0xdfc0fb148a3b271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498a4 expref: 24479 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805502:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.805502:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133a7fa80/0xdfc0fb148a3b271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498a4 expref: 24479 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805507:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350aed00/0xdfc0fb14868918b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ea5 expref: 26852 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.805512:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133a7fa80/0xdfc0fb148a3b271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498a4 expref: 24479 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805516:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.805517:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007df49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784526464:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.805524:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820468 00010000:00010000:1.0:1713481296.805524:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.805526:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.805528:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26852:1960:x1796714882497280:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.805530:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.805534:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.805537:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805538:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350aed00/0xdfc0fb14868918b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ea5 expref: 26852 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.805539:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.805542:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805544:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.805546:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350aed00/0xdfc0fb14868918b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ea5 expref: 26852 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.805546:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805549:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.805550:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805555:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805558:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c07a80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.805559:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.805560:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805561:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350aed00/0xdfc0fb14868918b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ea5 expref: 26852 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.805563:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.805563:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805569:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.805570:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.805570:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805571:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.805573:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.805573:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c07a80/0xdfc0fb148a3b2cc lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805579:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805592:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.805603:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26851:1960:x1796714882497280:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (124us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.805608:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.805610:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820468 00010000:00010000:1.0:1713481296.805612:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805615:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805621:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.805624:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805627:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.805628:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805634:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.805634:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2814:3492:x1796714784523712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6892us (6985us total) trans 4295960755 rc 0/0 00010000:00010000:0.0:1713481296.805641:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.805642:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563283 00010000:00010000:0.0:1713481296.805646:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805651:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.805656:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008362f840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.805658:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805660:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.805677:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805678:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805682:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805685:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133daf180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.805687:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805687:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805690:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.805693:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008362f840/0xdfc0fb148a3b286 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.805695:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009a3fa700) 00010000:00010000:1.0:1713481296.805697:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000004:00080000:3.0:1713481296.805697:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121aeb800/2, rc 0, transno 993459 00010000:00010000:1.0:1713481296.805698:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805701:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b42a lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2caf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000100:00100000:3.0:1713481296.805706:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784523712:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.805719:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805721:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805724:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805727:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133dac000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.805729:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805732:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805735:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88008cf1ff00) 00010000:00010000:1.0:1713481296.805736:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.805737:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805740:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac000/0xdfc0fb148a3b423 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.805746:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784526528:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.805752:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805755:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805757:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805760:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805762:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133dac480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.805764:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805767:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.805769:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.805770:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.805771:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.805773:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805776:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133dac480/0xdfc0fb148a3b40e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805781:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805783:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805786:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805789:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133daed00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.805790:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805793:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00000100:00100000:3.0:1713481296.805793:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784526528 00010000:00010000:1.0:1713481296.805796:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff88009e7ffd00) 00010000:00010000:1.0:1713481296.805797:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.805797:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784526528 00010000:00010000:1.0:1713481296.805798:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805800:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b415 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805811:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805813:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00000100:00100000:3.0:1713481296.805815:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563312 00010000:00010000:1.0:1713481296.805818:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00000100:00100000:3.0:1713481296.805820:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2815:3491:x1796714784526528:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.805821:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133dacfc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.805822:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805825:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.805828:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88008cf1f600) 00010000:00010000:1.0:1713481296.805829:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.805830:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00002000:00080000:3.0:1713481296.805831:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43437 count 1 00010000:00010000:1.0:1713481296.805832:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b41c lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:3.0:1713481296.805845:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.805856:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918373c0/0xdfc0fb148689279 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f15 expref: 26850 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.805857:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2382:18927:x1796714882498112:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 429us (461us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.805861:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26108 00010000:00010000:3.0:1713481296.805863:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.805864:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.805867:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.805878:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+217:3490:x1796714784523328:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7732us (7800us total) trans 4296040879 rc 0/0 00010000:00010000:3.0:1713481296.805883:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918373c0/0xdfc0fb148689279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f15 expref: 26850 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.805884:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563280 00010000:00010000:3.0:1713481296.805892:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918373c0/0xdfc0fb148689279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f15 expref: 26850 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.805897:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+2815:3491:x1796714784523968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6776us (6954us total) trans 4295960756 rc 0/0 00000100:00100000:0.0:1713481296.805903:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563285 00000100:00100000:3.0:1713481296.805907:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784526592:192.168.202.24@tcp:104: 00000004:00080000:2.0:1713481296.805912:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096760000/2, rc 0, transno 1073583 00000100:00100000:2.0:1713481296.805917:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784523328:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.805925:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378c00 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.805931:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121d89880/2, rc 0, transno 993460 00000100:00100000:1.0:1713481296.805932:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.805934:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784523968:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.805952:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.805960:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784526720:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.805962:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784526656:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.805967:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.805976:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.805978:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.805989:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.805991:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.806006:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497600 00000100:00100000:0.0:1713481296.806010:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497600 00000100:00100000:1.0:1713481296.806012:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498176 00000100:00100000:1.0:1713481296.806014:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498176 00010000:00010000:0.0:1713481296.806020:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801349e1b00/0xdfc0fb148689192 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2eb3 expref: 26851 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.806023:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784526720 00000100:00100000:1.0:1713481296.806025:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784526720 00000100:00100000:1.0:1713481296.806032:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784526656 00000100:00100000:1.0:1713481296.806034:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784526656 00000100:00100000:2.0:1713481296.806034:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+216:3491:x1796714784524544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6091us (6237us total) trans 4296040880 rc 0/0 00000100:00100000:0.0:1713481296.806035:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497216 00000100:00100000:0.0:1713481296.806036:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497216 00000100:00100000:3.0:1713481296.806038:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563313 00010000:00010000:0.0:1713481296.806043:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148802e27 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dba expref: 20763 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.806043:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563291 00000100:00100000:3.0:1713481296.806045:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16906:18844:x1796714882498176:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713481296.806049:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563314 00000100:00100000:1.0:1713481296.806052:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2815:3492:x1796714784526720:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.806053:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497536 00010000:00010000:3.0:1713481296.806054:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.806055:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497536 00000100:00100000:2.0:1713481296.806056:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563315 00000100:00100000:2.0:1713481296.806058:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+216:3493:x1796714784526656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.806060:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43439 count 1 00010000:00010000:0.0:1713481296.806062:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb81d40/0xdfc0fb148802e35 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dd6 expref: 20764 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.806065:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ffa1b00/0xdfc0fb148a3b438 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49937 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.806066:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10029 count 1 00010000:00010000:1.0:1713481296.806068:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806070:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497472 00000100:00100000:0.0:1713481296.806072:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497472 00010000:00010000:2.0:1713481296.806073:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806076:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134327180/0xdfc0fb148689280 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f23 expref: 26851 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.806078:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007df06400/0xdfc0fb14891ebbb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb67b expref: 20765 pid: 16472 timeout: 815 lvb_type: 0 00002000:00010000:3.0:1713481296.806078:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.806080:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.806080:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097d63600/0xdfc0fb148802e58 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e1c expref: 20765 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.806081:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.806083:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.806084:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.806085:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.806086:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806087:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820469 00010000:00010000:3.0:1713481296.806087:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.806089:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.806091:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26851:1960:x1796714882497600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.806093:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffa1b00/0xdfc0fb148a3b438 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49937 expref: 16907 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806094:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134327180/0xdfc0fb148689280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f23 expref: 26851 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.806096:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.806096:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097d63600/0xdfc0fb148802e58 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e1c expref: 20765 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.806099:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134327180/0xdfc0fb148689280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f23 expref: 26851 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.806100:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801349e1b00/0xdfc0fb148689192 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2eb3 expref: 26851 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.806101:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097d63600/0xdfc0fb148802e58 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e1c expref: 20765 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.806102:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ffa1b00/0xdfc0fb148a3b438 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49937 expref: 16907 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.806105:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e1da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784526784:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.806107:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801349e1b00/0xdfc0fb148689192 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2eb3 expref: 26851 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.806107:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784526848:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.806110:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffa1b00, rc 0) 00000100:00100000:1.0:1713481296.806116:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.806134:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.806146:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:18844:x1796714882498176:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 101us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.806150:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820470 00000100:00100000:3.0:1713481296.806152:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563313 00000004:00080000:2.0:1713481296.806153:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299f800/2, rc 0, transno 1073584 00000100:00100000:1.0:1713481296.806154:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20765:1957:x1796714882497216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.806159:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.806162:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148802e27 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dba expref: 20765 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.806164:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784524544:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.806168:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148802e27 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dba expref: 20765 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.806180:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148802e27 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dba expref: 20765 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.806192:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.806193:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.806196:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.806197:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784526912:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.806203:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.806215:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.806216:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801349e1b00/0xdfc0fb148689192 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2eb3 expref: 26851 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.806220:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.806226:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.806227:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.806228:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.806233:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.806238:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20764:1957:x1796714882497216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (268us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.806244:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.806244:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820470 00010000:00010000:2.0:1713481296.806251:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806254:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26850:1960:x1796714882497600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 162us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.806255:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784526912 00010000:00010000:2.0:1713481296.806256:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806257:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820469 00000100:00100000:3.0:1713481296.806258:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784526912 00010000:00010000:2.0:1713481296.806260:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.806262:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820471 00010000:00010000:2.0:1713481296.806263:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.806266:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20763:1957:x1796714882497536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.806267:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.806271:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135b3f3c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.806272:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806273:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820472 00010000:00010000:1.0:1713481296.806274:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.806276:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806277:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20763:1957:x1796714882497472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.806278:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb81d40/0xdfc0fb148802e35 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2728:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dd6 expref: 20763 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.806280:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563316 00010000:00010000:0.0:1713481296.806284:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.806284:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+217:3490:x1796714784526912:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.806285:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.806288:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007df06400/0xdfc0fb14891ebbb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb67b expref: 20763 pid: 16472 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.806291:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb81d40/0xdfc0fb148802e35 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2728:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dd6 expref: 20763 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.806292:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b34a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.806296:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10030 count 1 00010000:00010000:0.0:1713481296.806302:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007df06400/0xdfc0fb14891ebbb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb67b expref: 20763 pid: 16472 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.806309:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806310:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb81d40/0xdfc0fb148802e35 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2728:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962dd6 expref: 20763 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.806319:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007df06400/0xdfc0fb14891ebbb lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb67b expref: 20762 pid: 16472 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.806321:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.806321:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801346818c0/0xdfc0fb148802e5f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e2a expref: 20762 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.806322:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.806324:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806327:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.806328:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806329:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.806332:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.806332:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.806333:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.806337:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092dbef40/0xdfc0fb148a3b28d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ab expref: 16906 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806341:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.806351:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20761:1957:x1796714882497536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (372us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.806351:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801346818c0/0xdfc0fb148802e5f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e2a expref: 20761 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.806355:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820471 00010000:00010000:3.0:1713481296.806361:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801346818c0/0xdfc0fb148802e5f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e2a expref: 20761 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.806371:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784526976:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.806372:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806376:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806380:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.806381:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2816:3493:x1796714784524800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5438us (5597us total) trans 4295960757 rc 0/0 00000100:00100000:2.0:1713481296.806385:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563294 00010000:00010000:1.0:1713481296.806388:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.806388:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976a9b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.806392:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806395:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133b8b840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.806396:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806400:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806406:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.806408:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092dbef40/0xdfc0fb148a3b28d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ab expref: 16906 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806410:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133b8b840/0xdfc0fb148a3b27f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.806412:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072b7a680/2, rc 0, transno 993461 00000100:00100000:3.0:1713481296.806419:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784524800:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.806425:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092dbef40/0xdfc0fb148a3b28d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8061:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498ab expref: 16906 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806434:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e27b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784527040:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.806435:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806442:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806448:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231becc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.806448:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806454:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806460:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806465:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007deb46c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.806468:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806474:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806485:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806490:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b2ef lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.806509:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+218:3492:x1796714784523904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7601us (7639us total) trans 4296040881 rc 0/0 00000100:00100000:1.0:1713481296.806513:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563284 00000004:00080000:2.0:1713481296.806534:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007df4aa00/2, rc 0, transno 1073585 00000100:00100000:2.0:1713481296.806541:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007df4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784523904:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.806571:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.806572:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.806579:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784527168:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.806590:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.806591:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498304 00000100:00100000:0.0:1713481296.806595:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498304 00000100:00100000:2.0:1713481296.806602:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.806603:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.806609:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+218:3493:x1796714784524608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6566us (6627us total) trans 4296040882 rc 0/0 00000100:00100000:1.0:1713481296.806612:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498432 00000100:00100000:0.0:1713481296.806614:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125694 00000100:00100000:1.0:1713481296.806614:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498432 00000100:00100000:3.0:1713481296.806615:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563292 00000100:00100000:0.0:1713481296.806620:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2043:18678:x1796714882498304:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:1.0:1713481296.806628:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26109 00000004:00080000:2.0:1713481296.806629:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fdadc00/2, rc 0, transno 1073586 00000100:00100000:3.0:1713481296.806629:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784527168 00000100:00100000:1.0:1713481296.806630:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:18941:x1796714882498432:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:3.0:1713481296.806631:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784527168 00000100:00100000:2.0:1713481296.806635:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784524608:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.806644:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563317 00010000:00010000:1.0:1713481296.806645:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1713481296.806646:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+218:3493:x1796714784527168:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.806652:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a833180/0xdfc0fb148a3b351 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x3866:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498dc expref: 2205 pid: 15642 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.806654:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10031 count 1 00010000:00010000:1.0:1713481296.806661:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff880090802b00) 00000100:00100000:2.0:1713481296.806662:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713481296.806677:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.806684:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007fdae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784527232:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.806684:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caadf80/0xdfc0fb148802e66 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e38 expref: 20760 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.806685:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078201680/0xdfc0fb148a3b1bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x513e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49857 expref: 2204 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806689:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.806690:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.806691:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806694:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x513e:0x0].0x0 (ffff880099d83100) 00010000:00010000:1.0:1713481296.806701:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.806703:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012caadf80/0xdfc0fb148802e66 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e38 expref: 20760 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.806704:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.806708:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012caadf80/0xdfc0fb148802e66 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e38 expref: 20760 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.806709:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806714:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.806714:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784527296:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.806718:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806724:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806727:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.806727:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976a9780 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.806730:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806737:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.806737:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784527104:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.806741:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806744:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.806747:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784527232 00000100:00100000:3.0:1713481296.806749:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784527232 00000100:00100000:2.0:1713481296.806755:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.806760:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2044:18678:x1796714882498304:12345-192.168.202.24@tcp:35:rm.0 Request processed in 87us (134us total) trans 4295107607 rc 0/0 00000100:00100000:3.0:1713481296.806767:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784527104 00000100:00100000:0.0:1713481296.806770:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125694 00000100:00100000:3.0:1713481296.806770:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784527104 00010000:00010000:1.0:1713481296.806775:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806778:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806781:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.806782:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563318 00010000:00010000:1.0:1713481296.806787:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.806787:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+219:3492:x1796714784527232:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.806788:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563319 00010000:00010000:1.0:1713481296.806790:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806793:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.806793:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007fdaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2816:3491:x1796714784527104:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.806802:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882497728 00002000:00080000:3.0:1713481296.806802:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10032 count 1 00000100:00100000:0.0:1713481296.806805:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882497728 00002000:00080000:2.0:1713481296.806806:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43441 count 1 00010000:00010000:3.0:1713481296.806812:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.806815:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350af180/0xdfc0fb148689199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ec1 expref: 26850 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.806816:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.806823:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134681440/0xdfc0fb148802e7b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e46 expref: 20760 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.806829:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820473 00010000:00010000:1.0:1713481296.806829:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.806829:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.806831:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122492ac0/0xdfc0fb148689287 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f31 expref: 26850 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.806831:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.806833:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26850:1957:x1796714882497728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.806833:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806834:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806837:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.806838:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.806838:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.806839:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.806841:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350af180/0xdfc0fb148689199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ec1 expref: 26850 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.806841:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806845:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800982eaac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.806848:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350af180/0xdfc0fb148689199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ec1 expref: 26850 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.806848:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.806850:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134681440/0xdfc0fb148802e7b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e46 expref: 20760 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.806853:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806856:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122492ac0/0xdfc0fb148689287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f31 expref: 26850 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.806858:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134681440/0xdfc0fb148802e7b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e46 expref: 20760 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.806859:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x0 (ffff880121ed7900) 00010000:00010000:0.0:1713481296.806862:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350af180/0xdfc0fb148689199 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ec1 expref: 26850 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.806862:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.806864:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806866:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122492ac0/0xdfc0fb148689287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f31 expref: 26850 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.806867:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075757b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784527360:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.806869:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eaac0/0xdfc0fb148a3b477 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x3866:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.806870:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.806872:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.806874:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.806875:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784527424:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.806880:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.806881:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2180 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.806884:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806889:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.806892:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.806894:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:0.0:1713481296.806897:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.806897:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800982eb840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.806900:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806904:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806907:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806910:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26849:1957:x1796714882497728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (319us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.806910:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x513e:0x0].0x0 (ffff880121ed7a00) 00010000:00010000:1.0:1713481296.806912:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.806914:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806914:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.806916:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820473 00010000:00010000:1.0:1713481296.806921:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982eb840/0xdfc0fb148a3b470 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x513e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806921:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.806927:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.806934:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806935:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806940:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806940:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135b3fa80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.806942:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806945:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806949:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806949:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806953:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081772640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.806956:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806960:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.806961:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.806965:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b32e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.806966:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.806968:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.806970:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.806973:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.806975:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880081772640/0xdfc0fb148a3b45b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806989:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806994:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.806998:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.807002:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081772d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.807004:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.807009:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.807009:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.807014:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880084b53900) 00010000:00010000:1.0:1713481296.807016:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.807018:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.807023:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880081772d00/0xdfc0fb148a3b462 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.807031:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498496 00000100:00100000:3.0:1713481296.807034:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498496 00010000:00010000:1.0:1713481296.807037:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.807042:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.807047:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.807050:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485869 00010000:00010000:1.0:1713481296.807051:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800817733c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.807053:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.807054:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2799:18910:x1796714882498496:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:2.0:1713481296.807056:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007286f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2817:3490:x1796714784524864:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6225us (6281us total) trans 4295960758 rc 0/0 00010000:00010000:1.0:1713481296.807058:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.807060:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563293 00010000:00010000:3.0:1713481296.807064:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.807067:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff880121ed7700) 00010000:00010000:1.0:1713481296.807069:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.807071:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:3.0:1713481296.807072:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b48c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49945 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.807073:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498560 00010000:00010000:1.0:1713481296.807075:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800817733c0/0xdfc0fb148a3b469 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.807075:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498560 00000100:00100000:2.0:1713481296.807093:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563320 00000100:00100000:2.0:1713481296.807096:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:10409:x1796714882498560:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.807100:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.807107:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085dcba80/0xdfc0fb148a3b493 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4993e expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.807112:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18941:x1796714882498432:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 479us (506us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713481296.807134:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083729f80/0xdfc0fb14891d445 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca70f expref: 24481 pid: 15498 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.807137:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26109 00010000:00010000:2.0:1713481296.807139:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097644480/0xdfc0fb14893ab91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4c7 expref: 26848 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.807142:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.807143:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.807143:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.807145:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085dcba80/0xdfc0fb148a3b493 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4993e expref: 24481 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.807149:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.807154:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097644480/0xdfc0fb14893ab91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4c7 expref: 26848 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.807154:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.807159:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097644480/0xdfc0fb14893ab91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4c7 expref: 26848 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.807163:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.807164:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784527488:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.807166:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807170:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.807180:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083729f80/0xdfc0fb14891d445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca70f expref: 24481 pid: 15498 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.807184:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.807185:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083729f80/0xdfc0fb14891d445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca70f expref: 24481 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.807187:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.807189:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784527552:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.807190:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.807195:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.807197:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807200:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978c6640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.807201:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807204:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807208:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000100:00100000:0.0:1713481296.807210:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.807210:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.807211:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000004:00080000:2.0:1713481296.807213:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072b7ad80/2, rc 0, transno 993462 00010000:00010000:3.0:1713481296.807214:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3b49a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.807218:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784524864:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.807225:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807228:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807230:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807233:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978c5440 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.807234:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498688 00000100:00100000:2.0:1713481296.807235:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784527616:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.807235:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.807237:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.807237:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498688 00010000:00010000:3.0:1713481296.807238:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.807244:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff88012f807600) 00010000:00010000:3.0:1713481296.807246:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.807247:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.807247:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.807249:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498752 00010000:00010000:3.0:1713481296.807250:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b4a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.807251:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498752 00000100:00100000:1.0:1713481296.807252:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485870 00000100:00100000:1.0:1713481296.807255:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2044:18979:x1796714882498688:12345-192.168.202.24@tcp:36:touch.0 00010000:00010000:0.0:1713481296.807262:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009916d8c0/0xdfc0fb14868925d lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ed6 expref: 26849 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.807269:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784525248:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.807274:0:15484:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.807276:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b48c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49945 expref: 2800 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807277:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820474 00010000:00010000:3.0:1713481296.807280:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b48c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49945 expref: 2800 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807281:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807282:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26849:1960:x1796714882498752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.807283:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008fc00240/0xdfc0fb148a3b320 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498e3 expref: 2044 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.807289:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.807292:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bd9ba80, rc 0) 00010000:00010000:0.0:1713481296.807294:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009916d8c0/0xdfc0fb14868925d lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ed6 expref: 26849 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.807296:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbe:0x0].0x0 (ffff880083828400) 00000100:00100000:2.0:1713481296.807299:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784525184:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.807302:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009916d8c0/0xdfc0fb14868925d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ed6 expref: 26849 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.807306:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2799:18910:x1796714882498496:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 251us (297us total) trans 0 rc 301/301 00010000:00010000:1.0:1713481296.807307:0:15484:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.807311:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485869 00010000:00010000:2.0:1713481296.807318:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.807320:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009916d8c0/0xdfc0fb14868925d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ed6 expref: 26849 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.807327:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784527616 00000100:00100000:2.0:1713481296.807329:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784527616 00010000:00010000:0.0:1713481296.807336:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.807337:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.807340:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.807343:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563321 00010000:00010000:0.0:1713481296.807347:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.807347:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2817:3490:x1796714784527616:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.807354:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800982eb600/0xdfc0fb148a3b4a8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00002000:00080000:2.0:1713481296.807358:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43443 count 1 00010000:00010000:1.0:1713481296.807362:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800982eb600/0xdfc0fb148a3b4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.807363:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.807368:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800982eb600/0xdfc0fb148a3b4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.807368:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807378:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e78480/0xdfc0fb14868928e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f3f expref: 26848 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.807379:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26848:1960:x1796714882498752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (142us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.807383:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.807385:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820474 00010000:00010000:2.0:1713481296.807385:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.807387:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807402:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091e78480/0xdfc0fb14868928e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f3f expref: 26847 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.807408:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091e78480/0xdfc0fb14868928e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f3f expref: 26847 pid: 16504 timeout: 815 lvb_type: 1 00000004:00010000:1.0:1713481296.807413:0:15484:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a1e3800 reply state ffff88009dfc2000 transno 4295107608 ns: mdt-lustre-MDT0001_UUID lock: ffff8800982eb600/0xdfc0fb148a3b4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.807414:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784527680:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.807419:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800982eb600/0xdfc0fb148a3b4a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.807420:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.807423:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbe:0x0].0x0 (ffff88012bb20100) 00010000:00010000:1.0:1713481296.807424:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.807425:0:15484:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713481296.807426:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861000 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.807436:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807438:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498816 00010000:00010000:2.0:1713481296.807440:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807441:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498816 00010000:00010000:2.0:1713481296.807444:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807448:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.807449:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:18979:x1796714882498688:12345-192.168.202.24@tcp:36:touch.0 Request processed in 193us (240us total) trans 4295107608 rc 0/0 00010000:00010000:0.0:1713481296.807452:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091834b40/0xdfc0fb148689264 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ee4 expref: 26848 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.807452:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.807453:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485870 00010000:00010000:2.0:1713481296.807455:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135b3c000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.807457:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807461:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807468:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820475 00010000:00010000:2.0:1713481296.807470:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807472:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26848:1957:x1796714882498816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.807473:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b358 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.807481:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.807485:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091834b40/0xdfc0fb148689264 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ee4 expref: 26848 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.807489:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.807494:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091834b40/0xdfc0fb148689264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ee4 expref: 26848 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.807499:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498880 00000100:00100000:1.0:1713481296.807501:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498880 00010000:00010000:0.0:1713481296.807507:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091834b40/0xdfc0fb148689264 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ee4 expref: 26848 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.807512:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563322 00000100:00100000:1.0:1713481296.807514:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:17009:x1796714882498880:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.807518:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.807519:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807519:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.807521:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.807526:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009716d680/0xdfc0fb148a3b4b6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xce9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4994c expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.807527:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.807535:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xce9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.807541:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.807541:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807542:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807545:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009716d680/0xdfc0fb148a3b4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4994c expref: 16908 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.807551:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009716d680/0xdfc0fb148a3b4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xce9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4994c expref: 16908 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807552:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26847:1957:x1796714882498816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.807556:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820475 00010000:00010000:1.0:1713481296.807556:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009716d680, rc 0) 00000100:00100000:1.0:1713481296.807565:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16908:17009:x1796714882498880:12345-192.168.202.24@tcp:101:dd.0 Request processed in 50us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.807569:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563322 00000100:00100000:2.0:1713481296.807585:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2818:3490:x1796714784525056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4904us (4950us total) trans 4295960759 rc 0/0 00000100:00100000:2.0:1713481296.807591:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563295 00000004:00080000:2.0:1713481296.807624:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007286c700/2, rc 0, transno 993463 00000100:00100000:2.0:1713481296.807631:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007286c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784525056:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.807643:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079708e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784525632:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.807660:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.807680:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807683:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807689:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807695:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807702:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807707:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135b3df80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.807709:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007970bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784525824:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.807710:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807717:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.807721:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096762680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784525696:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.807728:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807729:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.807735:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b3df80/0xdfc0fb148a3b35f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.807736:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.807744:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20760:1960:x1796714882496320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3978us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.807748:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820461 00000100:00100000:0.0:1713481296.807758:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.807774:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499072 00000100:00100000:0.0:1713481296.807777:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499072 00010000:00010000:0.0:1713481296.807788:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012caacb40/0xdfc0fb148802e4a lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x272b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e00 expref: 20760 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.807811:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820476 00000100:00100000:0.0:1713481296.807816:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20760:1960:x1796714882499072:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.807822:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.807825:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012caacb40/0xdfc0fb148802e4a lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x272b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e00 expref: 20760 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.807831:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.807833:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012caacb40/0xdfc0fb148802e4a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e00 expref: 20760 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.807838:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499008 00000100:00100000:1.0:1713481296.807840:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499008 00010000:00010000:0.0:1713481296.807845:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.807845:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2818:3493:x1796714784525120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5037us (5148us total) trans 4295960760 rc 0/0 00010000:00010000:0.0:1713481296.807847:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807848:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097d63a80/0xdfc0fb148802e3c lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2729:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962de4 expref: 20761 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.807849:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.807849:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563296 00010000:00010000:0.0:1713481296.807855:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.807858:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820477 00000100:00100000:1.0:1713481296.807861:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20761:1960:x1796714882499008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.807865:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.807865:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.807868:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097d63a80/0xdfc0fb148802e3c lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962de4 expref: 20761 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.807873:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097d63a80/0xdfc0fb148802e3c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962de4 expref: 20761 pid: 15499 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.807873:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007286dc00/2, rc 0, transno 993464 00000100:00100000:0.0:1713481296.807876:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20761:1960:x1796714882499072:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.807876:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007286dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784525120:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.807880:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820476 00010000:00010000:1.0:1713481296.807890:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807891:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807893:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.807895:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784527808:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.807898:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.807906:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.807908:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.807908:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.807915:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20760:1960:x1796714882499008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.807918:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820477 00000100:00100000:0.0:1713481296.807922:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882498944 00000100:00100000:0.0:1713481296.807924:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882498944 00000100:00100000:2.0:1713481296.807927:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.807930:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784527744:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.807932:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134681200/0xdfc0fb148802e43 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962df2 expref: 20760 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.807941:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.807953:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820478 00000100:00100000:2.0:1713481296.807954:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784527808 00000100:00100000:1.0:1713481296.807955:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20760:1958:x1796714882498944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.807956:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784527808 00010000:00010000:1.0:1713481296.807960:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.807962:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134681200/0xdfc0fb148802e43 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962df2 expref: 20760 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.807964:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784527744 00000100:00100000:2.0:1713481296.807966:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784527744 00010000:00010000:1.0:1713481296.807968:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134681200/0xdfc0fb148802e43 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962df2 expref: 20760 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.807973:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563323 00000100:00100000:0.0:1713481296.807976:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.807976:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134681200/0xdfc0fb148802e43 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x272a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962df2 expref: 20760 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.807976:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2819:3492:x1796714784527808:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.807984:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43446 count 1 00010000:00010000:1.0:1713481296.807987:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807988:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.807989:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807991:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499136 00010000:00010000:2.0:1713481296.807991:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.807993:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.807994:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499136 00010000:00010000:2.0:1713481296.807997:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097355d40/0xdfc0fb1486892a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f5b expref: 26847 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.808001:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.808002:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808003:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.808003:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808004:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c201680/0xdfc0fb14868926b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ef9 expref: 26847 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.808011:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20759:1958:x1796714882498944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (103us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.808013:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097355d40/0xdfc0fb1486892a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f5b expref: 26847 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.808014:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820478 00010000:00010000:2.0:1713481296.808017:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097355d40/0xdfc0fb1486892a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f5b expref: 26847 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.808021:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820479 00000100:00100000:2.0:1713481296.808023:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784527872:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.808026:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26847:1958:x1796714882499136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.808031:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563324 00010000:00010000:0.0:1713481296.808032:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.808033:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2819:3490:x1796714784527744:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.808033:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861180 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.808036:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c201680/0xdfc0fb14868926b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ef9 expref: 26847 pid: 16522 timeout: 815 lvb_type: 1 00002000:00080000:1.0:1713481296.808041:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43445 count 1 00010000:00010000:0.0:1713481296.808043:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c201680/0xdfc0fb14868926b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ef9 expref: 26847 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.808048:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808049:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caacb40/0xdfc0fb148802e4a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x272b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e00 expref: 20758 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.808055:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c201680/0xdfc0fb14868926b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ef9 expref: 26847 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.808055:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801241ef840/0xdfc0fb148689295 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f4d expref: 26847 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.808059:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808060:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.808060:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784525760:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.808061:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808063:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.808065:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.808067:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808070:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801241ef840/0xdfc0fb148689295 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f4d expref: 26846 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.808073:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808075:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801241ef840/0xdfc0fb148689295 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f4d expref: 26846 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.808077:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808081:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808082:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e1d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784527936:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.808085:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808089:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808090:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.808092:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c6d6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.808092:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808096:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808099:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012bae9680 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.808100:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26846:1958:x1796714882499136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (126us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.808100:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808104:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.808105:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820479 00000100:00100000:1.0:1713481296.808110:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.808115:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808134:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bae9680/0xdfc0fb148a3b37b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x272b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808137:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808143:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808149:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808154:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808155:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784526016:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.808159:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808164:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c071d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.808167:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808172:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808172:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808187:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808189:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.808193:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c071d40/0xdfc0fb148a3b382 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808208:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097d63a80/0xdfc0fb148802e3c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2729:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962de4 expref: 20757 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.808218:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784525376:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.808232:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808237:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808240:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808244:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808247:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808251:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808254:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135b3cd80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.808255:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.808256:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808257:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+220:3490:x1796714784525504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4452us (4563us total) trans 4296040883 rc 0/0 00010000:00010000:2.0:1713481296.808260:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808262:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563300 00000100:00100000:1.0:1713481296.808264:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499264 00000100:00100000:1.0:1713481296.808266:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499264 00010000:00010000:2.0:1713481296.808269:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808275:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f055d40/0xdfc0fb148802e51 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e0e expref: 20757 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.808275:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b36d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808281:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499200 00000100:00100000:1.0:1713481296.808283:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499328 00000100:00100000:3.0:1713481296.808283:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499200 00000100:00100000:1.0:1713481296.808285:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499328 00010000:00010000:1.0:1713481296.808290:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007991e1c0/0xdfc0fb148a16265 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3983d expref: 24483 pid: 16498 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.808293:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563325 00000100:00100000:3.0:1713481296.808296:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:14753:x1796714882499200:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.808298:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820480 00000100:00100000:1.0:1713481296.808301:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20757:1957:x1796714882499264:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.808302:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.808305:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.808307:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f055d40/0xdfc0fb148802e51 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e0e expref: 20757 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.808308:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800978c6400/0xdfc0fb148a3b4cb lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49953 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808315:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f055d40/0xdfc0fb148802e51 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e0e expref: 20757 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.808324:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cb86c0/0xdfc0fb148a13f11 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38011 expref: 24484 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.808326:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f055d40/0xdfc0fb148802e51 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x272c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e0e expref: 20757 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.808328:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.808329:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.808331:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978c6400/0xdfc0fb148a3b4cb lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49953 expref: 24484 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.808332:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2820:3492:x1796714784525568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4489us (4558us total) trans 4295960761 rc 0/0 00010000:00010000:1.0:1713481296.808333:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808334:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808335:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.808338:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563301 00010000:00010000:1.0:1713481296.808340:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.808342:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cb86c0/0xdfc0fb148a13f11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38011 expref: 24484 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.808347:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cb86c0/0xdfc0fb148a13f11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38011 expref: 24484 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.808349:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.808354:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784528000:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.808358:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808359:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1957:x1796714882499264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.808362:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820480 00010000:00010000:0.0:1713481296.808365:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808366:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e29c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.808370:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808373:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820481 00010000:00010000:0.0:1713481296.808376:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808376:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1960:x1796714882499328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.808380:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.808381:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808383:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007991e1c0/0xdfc0fb148a16265 lrc: 5/0,0 mode: PR/PR res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3983d expref: 24484 pid: 16498 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.808386:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c072640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.808388:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808388:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007991e1c0/0xdfc0fb148a16265 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3983d expref: 24484 pid: 16498 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.808388:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078410700/2, rc 0, transno 1073587 00010000:00010000:0.0:1713481296.808394:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808394:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784525504:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.808397:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+220:3492:x1796714784525312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5159us (5220us total) trans 4296040884 rc 0/0 00010000:00010000:1.0:1713481296.808398:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808399:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808401:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b389 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498f1 expref: 24484 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.808404:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563298 00010000:00010000:1.0:1713481296.808405:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b389 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498f1 expref: 24484 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808406:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808413:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c072640/0xdfc0fb148a3b374 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x272a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808416:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b389 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498f1 expref: 24484 pid: 16525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808417:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784528064:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.808421:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784528128:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.808432:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.808436:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713481296.808439:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800728d7800/2, rc 0, transno 993465 00010000:00010000:1.0:1713481296.808443:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808447:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.808447:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784525568:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.808451:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808454:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808458:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.808458:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a15500/2, rc 0, transno 1073588 00010000:00010000:1.0:1713481296.808462:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135352f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.808464:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808467:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808474:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.808474:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784525312:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.808477:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135352f40/0xdfc0fb148a3b397 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x272c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808488:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784528192:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.808501:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.808506:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784528256:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.808520:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784528064 00000100:00100000:3.0:1713481296.808522:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784528064 00000100:00100000:2.0:1713481296.808527:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.808537:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+222:3490:x1796714784525440:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4802us (4930us total) trans 4296040885 rc 0/0 00000100:00100000:3.0:1713481296.808539:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784528192 00000100:00100000:3.0:1713481296.808540:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784528192 00000100:00100000:0.0:1713481296.808542:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563299 00000100:00100000:3.0:1713481296.808549:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784528256 00000100:00100000:3.0:1713481296.808550:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784528256 00000100:00100000:3.0:1713481296.808559:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563326 00000100:00100000:3.0:1713481296.808562:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+222:3493:x1796714784528064:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.808563:0:16525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007991e1c0/0xdfc0fb148a16265 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3983d expref: 24484 pid: 16498 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.808564:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563327 00000100:00100000:0.0:1713481296.808569:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+222:3490:x1796714784528192:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.808571:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10033 count 1 00000100:00100000:1.0:1713481296.808577:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+222:3492:x1796714784525888:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4200us (4255us total) trans 4296040886 rc 0/0 00010000:00010000:3.0:1713481296.808580:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.808581:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10034 count 1 00000100:00100000:1.0:1713481296.808582:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563303 00000100:00100000:2.0:1713481296.808582:0:16525:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_092:lustre-OST0001_UUID:16525:1796714784525952:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.808588:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009068d200/0xdfc0fb148802e82 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e54 expref: 20755 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.808591:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.808592:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.808593:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.808595:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808596:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563328 00000100:00100000:1.0:1713481296.808599:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2820:3491:x1796714784528256:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.808602:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011da133c0/0xdfc0fb148802e89 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e62 expref: 20755 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.808607:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1713481296.808607:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43449 count 1 00010000:00010000:3.0:1713481296.808607:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009068d200/0xdfc0fb148802e82 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e54 expref: 20755 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.808609:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.808610:0:16525:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930a4d80/0xdfc0fb148a3b389 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xb35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa498f1 expref: 24483 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808611:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.808612:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009068d200/0xdfc0fb148802e82 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e54 expref: 20755 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.808614:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.808618:0:16525:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930a4d80, rc 0) 00000100:00100000:3.0:1713481296.808618:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784528320:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.808621:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134325b00/0xdfc0fb14868929c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f69 expref: 26845 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.808625:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808626:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808628:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808631:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.808633:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011da133c0/0xdfc0fb148802e89 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e62 expref: 20755 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.808637:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134325b00/0xdfc0fb14868929c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f69 expref: 26845 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.808638:0:16525:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_092:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:17924:x1796714882496832:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4373us (4411us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.808642:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011da133c0/0xdfc0fb148802e89 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e62 expref: 20755 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.808642:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134325b00/0xdfc0fb14868929c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f69 expref: 26845 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.808644:0:16525:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563302 00000100:00100000:1.0:1713481296.808648:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784528448:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.808652:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007970aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784528384:192.168.202.24@tcp:104: 00000004:00080000:3.0:1713481296.808655:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a15180/2, rc 0, transno 1073589 00000100:00100000:1.0:1713481296.808658:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378840 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.808659:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784525440:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.808683:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be180 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.808698:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1713481296.808700:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299f100/2, rc 0, transno 1073590 00000100:00100000:3.0:1713481296.808702:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784528512:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.808707:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784525888:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.808720:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.808741:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784528512 00000100:00100000:1.0:1713481296.808741:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.808745:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784528512 00000100:00100000:0.0:1713481296.808766:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499392 00000100:00100000:0.0:1713481296.808768:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499392 00000100:00100000:3.0:1713481296.808768:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784528576:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.808775:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563329 00000100:00100000:1.0:1713481296.808778:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+222:3493:x1796714784528512:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.808780:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.808781:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563330 00000100:00100000:0.0:1713481296.808786:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:18792:x1796714882499392:12345-192.168.202.24@tcp:101:dir_create.sh.0 00002000:00080000:1.0:1713481296.808787:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10035 count 1 00010000:00010000:0.0:1713481296.808793:0:16491:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.808794:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808799:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784528576 00010000:00010000:1.0:1713481296.808801:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979c4d80/0xdfc0fb148802e90 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e70 expref: 20756 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.808801:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784528576 00010000:00010000:0.0:1713481296.808802:0:16491:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800830b8b40/0xdfc0fb148a3b4ee lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc51f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4995a expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.808805:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808806:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808807:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.808813:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563331 00002000:00010000:0.0:1713481296.808814:0:16491:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc51f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.808816:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+223:3493:x1796714784528576:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.808818:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979c4d80/0xdfc0fb148802e90 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e70 expref: 20756 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.808823:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.808824:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979c4d80/0xdfc0fb148802e90 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e70 expref: 20757 pid: 15499 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.808824:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10036 count 1 00010000:00010000:0.0:1713481296.808825:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.808829:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800830b8b40/0xdfc0fb148a3b4ee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4995a expref: 20757 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808829:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784528640:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.808833:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808839:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800830b8b40/0xdfc0fb148a3b4ee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc51f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4995a expref: 20757 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.808840:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d3786c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.808841:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801359e8d80/0xdfc0fb148802e97 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e7e expref: 20757 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.808845:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.808846:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.808848:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.808851:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800830b8b40, rc 0) 00010000:00010000:3.0:1713481296.808859:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801359e8d80/0xdfc0fb148802e97 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e7e expref: 20757 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.808864:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801359e8d80/0xdfc0fb148802e97 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e7e expref: 20757 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.808866:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20757:18792:x1796714882499392:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 80us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.808872:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563330 00000100:00100000:3.0:1713481296.808874:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784528704:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.808887:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.809597:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120077b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784526080:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.809606:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009de20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784526144:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.809617:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133dacb40/0xdfc0fb148a3b3cf lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4990d expref: 26845 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.809624:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133dacb40, rc 0) 00010000:00010000:0.0:1713481296.809630:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afee880/0xdfc0fb148a3b3d6 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49914 expref: 16907 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.809640:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afee880, rc 0) 00000100:00100000:1.0:1713481296.809640:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:18817:x1796714882497088:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4770us (4920us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.809645:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563307 00000001:00080000:3.0:1713481296.809653:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040863 00000100:00100000:0.0:1713481296.809655:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:11552:x1796714882497344:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4771us (4904us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.809660:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563308 00000100:00100000:1.0:1713481296.809687:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.809696:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499456 00000100:00100000:1.0:1713481296.809698:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499456 00000100:00100000:1.0:1713481296.809716:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563332 00000100:00100000:1.0:1713481296.809719:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:17935:x1796714882499456:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.809724:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.809731:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009716f600/0xdfc0fb148a3b4fc lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49961 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.809743:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.809749:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.809750:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.809753:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009716f600/0xdfc0fb148a3b4fc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49961 expref: 16908 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.809758:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009716f600/0xdfc0fb148a3b4fc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49961 expref: 16908 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.809763:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009716f600, rc 0) 00002000:00080000:3.0:1713481296.809769:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57170 00000100:00100000:1.0:1713481296.809774:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16908:17935:x1796714882499456:12345-192.168.202.24@tcp:101:dd.0 Request processed in 54us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.809777:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563332 00000100:00100000:1.0:1713481296.809799:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078343b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784526272:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.809814:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133dad8c0/0xdfc0fb148a3b3dd lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49930 expref: 16907 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.809820:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133dad8c0, rc 0) 00000100:00100000:1.0:1713481296.809829:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:8499:x1796714882497984:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4848us (4870us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.809832:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563309 00000100:00100000:1.0:1713481296.809851:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078340380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784526336:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.809867:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.811697:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784527296:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.811706:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784528000:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.811726:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.811734:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800978c6400/0xdfc0fb148a3b4cb lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49953 expref: 24482 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.811736:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.811744:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800978c6400, rc 0) 00000100:00100000:1.0:1713481296.811758:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e1da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784526784:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.811766:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007df49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784526464:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.811784:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.811784:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882499200:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3485us (3672us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.811790:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.811792:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563325 00000100:00100000:2.0:1713481296.811803:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882496768:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6340us (6434us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.811810:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500160 00000100:00100000:2.0:1713481296.811810:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820467 00000100:00100000:1.0:1713481296.811812:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500160 00000100:00100000:1.0:1713481296.811831:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485871 00000100:00100000:3.0:1713481296.811831:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784526592:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.811834:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2382:18765:x1796714882500160:12345-192.168.202.24@tcp:36:dir_create.sh.0 00010000:00010000:3.0:1713481296.811855:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.811858:0:15479:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.811867:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e27b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784527040:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.811868:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097144b40/0xdfc0fb148a3b3b3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49922 expref: 2382 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.811881:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb7:0x0].0x0 (ffff88009c077100) 00010000:00010000:1.0:1713481296.811883:0:15479:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.811883:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784526976:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.811884:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.811893:0:16463:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007df4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_035:lustre-OST0000_UUID:16463:1796714784526400:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.811901:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1957:x1796714882497472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5623us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.811907:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820472 00010000:00010000:3.0:1713481296.811908:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.811916:0:16463:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930a7180/0xdfc0fb148a3b400 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49929 expref: 16906 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.811926:0:16463:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930a7180, rc 0) 00000100:00100000:3.0:1713481296.811937:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075757b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784527360:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.811945:0:16463:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_035:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16906:11388:x1796714882497920:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6779us (6840us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.811950:0:16463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563311 00010000:00010000:3.0:1713481296.811960:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.811983:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784526848:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.811985:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.811994:0:15479:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2044 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812001:0:15479:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.812003:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812017:0:15479:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2044 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812023:0:15479:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2044 pid: 15484 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.812028:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784527424:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.812030:0:15479:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e1d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796714784528768:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.812046:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.812056:0:15479:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f8bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.812069:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784527872:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.812081:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e1d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784527936:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.812085:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.812093:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784528320:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.812095:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.812106:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784527680:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.812135:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784528128:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.812146:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.812156:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.812158:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.812159:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1960:x1796714882499328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3782us (3904us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.812170:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007970aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784528384:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.812171:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820481 00000100:00100000:2.0:1713481296.812187:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784527488:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.812189:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.812198:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784528448:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.812198:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784527552:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.812211:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812224:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085dcba80/0xdfc0fb148a3b493 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4993e expref: 24479 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812238:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085dcba80, rc 0) 00000100:00100000:2.0:1713481296.812255:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10409:x1796714882498560:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5158us (5283us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.812259:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563320 00000100:00100000:1.0:1713481296.812353:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784528640:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.812369:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.812428:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.812445:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501440 00000100:00100000:1.0:1713481296.812449:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501440 00000100:00100000:1.0:1713481296.812477:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485872 00000100:00100000:2.0:1713481296.812489:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784528704:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.812499:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2383:18929:x1796714882501440:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:0.0:1713481296.812501:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.812508:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.812514:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812517:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009716d440/0xdfc0fb148a3b50a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49976 expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812572:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.812578:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.812583:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.812590:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:1.0:1713481296.812594:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.812597:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.812623:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00200000:1.0:1713481296.812637:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x347f:0x0]: returning size 4096 00000100:00100000:0.0:1713481296.812649:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.812649:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500992 00000100:00100000:2.0:1713481296.812652:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500992 00000100:00100000:2.0:1713481296.812677:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563333 00000100:00100000:0.0:1713481296.812682:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.812682:0:15484:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.812683:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16906:18844:x1796714882500992:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.812687:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.812688:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.812690:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.812693:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.812694:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501248 00010000:00010000:2.0:1713481296.812696:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085dc9200/0xdfc0fb148a3b526 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49968 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.812697:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501248 00010000:00010000:1.0:1713481296.812699:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009716ed00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.812701:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.812704:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00002000:00010000:2.0:1713481296.812705:0:16523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.812709:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.812710:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.812712:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.812712:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.812713:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801359e8d80/0xdfc0fb148802e97 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e7e expref: 20756 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.812713:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.812715:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ed00/0xdfc0fb148a3b511 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.812715:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085dc9200/0xdfc0fb148a3b526 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49968 expref: 16907 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812722:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085dc9200/0xdfc0fb148a3b526 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49968 expref: 16907 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.812726:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501120 00010000:00010000:1.0:1713481296.812726:0:15484:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.812728:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501120 00010000:00010000:1.0:1713481296.812729:0:15484:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.812730:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085dc9200, rc 0) 00010000:00010000:1.0:1713481296.812732:0:15484:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:0.0:1713481296.812733:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011da133c0/0xdfc0fb148802e89 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e62 expref: 20757 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.812734:0:15484:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a0b1f80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.812735:0:15484:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.812738:0:15484:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15484 initiator: MDT1 00010000:00010000:1.0:1713481296.812741:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff88009a3faa00) 00010000:00010000:1.0:1713481296.812742:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.812742:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:18844:x1796714882500992:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 60us (120us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.812744:0:15484:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.812746:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563333 00010000:00010000:1.0:1713481296.812747:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b1f80/0xdfc0fb148a3b518 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15484 initiator: MDT1 00000100:00100000:2.0:1713481296.812764:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820482 00000100:00100000:2.0:1713481296.812767:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20757:1958:x1796714882501248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.812771:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.812774:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009716d440/0xdfc0fb148a3b50a lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49976 expref: 2385 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812775:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801359e8d80/0xdfc0fb148802e97 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2734:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e7e expref: 20757 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.812778:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009716d440/0xdfc0fb148a3b50a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49976 expref: 2385 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812780:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801359e8d80/0xdfc0fb148802e97 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2734:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e7e expref: 20757 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.812786:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009716d440, rc 0) 00010000:00010000:2.0:1713481296.812792:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801359e8d80/0xdfc0fb148802e97 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2734:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e7e expref: 20757 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.812800:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.812801:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2384:18929:x1796714882501440:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 319us (374us total) trans 4295107610 rc 301/301 00010000:00010000:2.0:1713481296.812801:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.812803:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.812805:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820483 00000100:00100000:1.0:1713481296.812805:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485872 00010000:00010000:2.0:1713481296.812807:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.812810:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1958:x1796714882501120:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.812817:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.812818:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.812821:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011da133c0/0xdfc0fb148802e89 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e62 expref: 20756 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.812825:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500928 00000100:00100000:2.0:1713481296.812827:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1958:x1796714882501248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.812828:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500928 00010000:00010000:0.0:1713481296.812829:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011da133c0/0xdfc0fb148802e89 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e62 expref: 20756 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.812831:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820482 00000100:00100000:1.0:1713481296.812840:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26110 00000100:00100000:1.0:1713481296.812843:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:18932:x1796714882500928:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:2.0:1713481296.812844:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.812846:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011da133c0/0xdfc0fb148802e89 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e62 expref: 20755 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.812848:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812854:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812855:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713481296.812857:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.812859:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.812860:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.812861:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812863:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b14fcc0/0xdfc0fb148a3b407 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4991b expref: 2045 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812866:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.812868:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812871:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de4900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.812873:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34a4:0x0].0x0 (ffff88012f807a00) 00010000:00010000:2.0:1713481296.812874:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.812880:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.812881:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.812881:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133b89f80/0xdfc0fb148a3b26a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4989d expref: 2044 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812890:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff8801356c9000) 00000100:00100000:0.0:1713481296.812892:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007970bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20754:1958:x1796714882501120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.812896:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.812896:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.812897:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820483 00010000:00010000:1.0:1713481296.812904:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.812907:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124de4900/0xdfc0fb148a3b4f5 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812908:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.812912:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.812915:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812918:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.812921:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812924:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.812927:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812929:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.812932:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.812938:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812940:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.812942:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009afefa80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.812945:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812946:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.812951:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.812955:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.812964:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.812970:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009afefa80/0xdfc0fb148a3b4d9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.812998:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.813005:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813010:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813024:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.813027:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813031:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813071:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.813071:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+226:3493:x1796714784528576:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4252us (4288us total) trans 4296040888 rc 0/0 00010000:00010000:1.0:1713481296.813075:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.813077:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563331 00010000:00010000:1.0:1713481296.813078:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813081:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081ca3840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.813082:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00000004:00080000:3.0:1713481296.813082:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d94e00/2, rc 0, transno 1073592 00010000:00010000:1.0:1713481296.813085:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813089:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34a4:0x0].0x0 (ffff880121ed7e00) 00010000:00010000:1.0:1713481296.813091:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1713481296.813091:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784528576:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.813092:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813095:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca3840/0xdfc0fb148a3b549 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813106:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813110:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813113:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813115:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081ca1440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.813116:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813142:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813148:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff880096fd6a00) 00010000:00010000:1.0:1713481296.813150:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.813152:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813156:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1440/0xdfc0fb148a3b542 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c39:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.813158:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784528832:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.813175:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.813177:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813183:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813188:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.813189:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+225:3490:x1796714784528192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4618us (4684us total) trans 4296040889 rc 0/0 00010000:00010000:1.0:1713481296.813192:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.813195:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563327 00010000:00010000:1.0:1713481296.813196:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a0b0fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.813199:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00000004:00080000:2.0:1713481296.813199:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880075756300/2, rc 0, transno 1073593 00010000:00010000:1.0:1713481296.813203:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813210:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:2.0:1713481296.813210:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784528192:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.813212:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.813213:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784528832 00010000:00010000:1.0:1713481296.813214:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.813216:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784528832 00010000:00010000:1.0:1713481296.813218:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b0fc0/0xdfc0fb148a3b52d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813229:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.813233:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563334 00010000:00010000:1.0:1713481296.813234:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.813238:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+225:3490:x1796714784528832:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.813239:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813243:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a0b06c0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.813244:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784528896:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.813246:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00002000:00080000:0.0:1713481296.813249:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10037 count 1 00010000:00010000:1.0:1713481296.813251:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.813255:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.813257:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff88008adc5f00) 00010000:00010000:0.0:1713481296.813259:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813259:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.813261:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813269:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a0b06c0/0xdfc0fb148a3b534 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.813270:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800771d2ac0/0xdfc0fb148802e9e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e8c expref: 20753 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.813272:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784528896 00000100:00100000:2.0:1713481296.813274:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784528896 00010000:00010000:0.0:1713481296.813275:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.813277:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.813279:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813281:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.813284:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563335 00010000:00010000:1.0:1713481296.813285:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.813286:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+226:3491:x1796714784528896:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.813290:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813294:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081ca33c0 already unused, calling callback (ffffffffa0efc730) 00002000:00080000:2.0:1713481296.813294:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10038 count 1 00010000:00010000:1.0:1713481296.813296:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.813300:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.813302:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813304:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff88008adc5200) 00010000:00010000:1.0:1713481296.813306:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.813308:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.813309:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969a2ac0/0xdfc0fb148802ea5 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e9a expref: 20753 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.813312:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca33c0/0xdfc0fb148a3b53b lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.813313:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.813314:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.813315:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.813325:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969a2ac0/0xdfc0fb148802ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e9a expref: 20753 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.813331:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969a2ac0/0xdfc0fb148802ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e9a expref: 20753 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.813336:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784529024:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.813339:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2043:18932:x1796714882500928:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 494us (839us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.813343:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26110 00000100:00100000:2.0:1713481296.813346:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.813352:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800771d2ac0/0xdfc0fb148802e9e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e8c expref: 20753 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.813362:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800771d2ac0/0xdfc0fb148802e9e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e8c expref: 20753 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.813371:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e27b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784528960:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.813389:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.813396:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.813407:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.813408:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501312 00000100:00100000:2.0:1713481296.813410:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501312 00000100:00100000:1.0:1713481296.813416:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501504 00000100:00100000:1.0:1713481296.813418:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501504 00000100:00100000:2.0:1713481296.813420:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563336 00000100:00100000:2.0:1713481296.813423:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20754:10479:x1796714882501312:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.813427:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.813433:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.813433:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800833761c0/0xdfc0fb148a3b55e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4996f expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.813442:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502016 00010000:00010000:2.0:1713481296.813442:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099012d00/0xdfc0fb148916db4 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6592 expref: 20755 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.813444:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502016 00010000:00010000:2.0:1713481296.813446:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.813447:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.813449:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800833761c0/0xdfc0fb148a3b55e lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4996f expref: 20755 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.813449:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485873 00000100:00100000:3.0:1713481296.813455:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2044:18694:x1796714882501504:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:0.0:1713481296.813456:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.813458:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099012d00/0xdfc0fb148916db4 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6592 expref: 20755 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.813459:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485874 00000100:00100000:1.0:1713481296.813462:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2044:18678:x1796714882502016:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.813464:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.813465:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099012d00/0xdfc0fb148916db4 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6592 expref: 20755 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.813472:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124de6f40/0xdfc0fb148a3b565 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4997d expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.813473:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784529088:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.813475:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.813475:0:15484:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.813482:0:15484:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1200/0xdfc0fb148a3b56c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499ae expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.813487:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.813498:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.813502:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501632 00000100:00100000:2.0:1713481296.813505:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501632 00000100:00100000:0.0:1713481296.813512:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499584 00000100:00100000:0.0:1713481296.813515:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499584 00000100:00100000:2.0:1713481296.813525:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485875 00010000:00010000:0.0:1713481296.813527:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880120960240/0xdfc0fb14895a153 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebe5 expref: 16907 pid: 16476 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.813529:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2799:18910:x1796714882501632:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.813530:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.813535:0:15484:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca0fc0/0xdfc0fb148a3b57a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15484 initiator: MDT0 00010000:00010000:3.0:1713481296.813536:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.813537:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.813540:0:15484:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca0fc0/0xdfc0fb148a3b57a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15484 initiator: MDT1 00000100:00100000:0.0:1713481296.813542:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820484 00010000:00010000:3.0:1713481296.813542:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.813545:0:15484:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca0fc0/0xdfc0fb148a3b57a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15484 initiator: MDT1 00010000:00010000:2.0:1713481296.813546:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b581 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa4998b expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.813547:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:1959:x1796714882499584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00200000:1.0:1713481296.813549:0:15484:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c3b:0x0]: returning size 4096 00010000:00010000:3.0:1713481296.813549:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.813553:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.813554:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.813557:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.813564:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880120960240/0xdfc0fb14895a153 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebe5 expref: 16907 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.813573:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880120960240/0xdfc0fb14895a153 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebe5 expref: 16907 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.813575:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.813578:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.813581:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.813584:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.813586:0:15484:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca1200/0xdfc0fb148a3b56c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ae expref: 2048 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.813587:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de73c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.813588:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880120960240/0xdfc0fb14895a153 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eebe5 expref: 16907 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.813589:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.813592:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.813592:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.813595:0:15484:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca0fc0/0xdfc0fb148a3b57a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ae expref: 2047 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.813597:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6d:0x0].0x0 (ffff880120977900) 00010000:00010000:3.0:1713481296.813598:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.813599:0:15484:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x0 (ffff880099cf8500) 00010000:00010000:2.0:1713481296.813599:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.813600:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.813600:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.813601:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.813601:0:15484:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713481296.813602:0:15484:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081ca0fc0, rc 0) 00010000:00010000:3.0:1713481296.813603:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124de73c0/0xdfc0fb148a3b573 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.813605:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afee880/0xdfc0fb148a3b3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49914 expref: 16906 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.813606:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.813612:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afee880/0xdfc0fb148a3b3d6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49914 expref: 16906 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.813613:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18678:x1796714882502016:12345-192.168.202.24@tcp:101:rm.0 Request processed in 150us (181us total) trans 4295107611 rc 0/0 00010000:00010000:2.0:1713481296.813616:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.813616:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.813619:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485874 00010000:00010000:3.0:1713481296.813619:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.813622:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.813622:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.813625:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de5440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.813627:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.813627:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.813629:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009afee880/0xdfc0fb148a3b3d6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49914 expref: 16906 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.813630:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.813633:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6d:0x0].0x31 (ffff880091a05300) 00010000:00010000:3.0:1713481296.813634:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.813635:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.813638:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135b59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784529152:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.813638:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b588 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c6d:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.813648:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.813648:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.813654:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.813654:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.813658:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.813659:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499712 00000100:00100000:1.0:1713481296.813661:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499712 00010000:00010000:2.0:1713481296.813680:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.813683:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880124de6f40/0xdfc0fb148a3b565 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4997d expref: 2046 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813684:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009916c6c0/0xdfc0fb148689272 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f07 expref: 26845 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.813685:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095f7e1c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.813688:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.813688:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124de6f40/0xdfc0fb148a3b565 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4997d expref: 2046 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.813693:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.813698:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.813701:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820485 00010000:00010000:2.0:1713481296.813701:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.813702:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124de6f40, rc 0) 00000100:00100000:1.0:1713481296.813704:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:1959:x1796714882499712:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.813704:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.813707:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.813709:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.813711:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7e1c0/0xdfc0fb148a3b596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.813712:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009916c6c0/0xdfc0fb148689272 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f07 expref: 26845 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.813714:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499840 00000100:00100000:3.0:1713481296.813716:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:18694:x1796714882501504:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 262us (308us total) trans 0 rc 301/301 00000100:00100000:0.0:1713481296.813717:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499840 00010000:00010000:1.0:1713481296.813718:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009916c6c0/0xdfc0fb148689272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f07 expref: 26845 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.813721:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485873 00010000:00010000:2.0:1713481296.813725:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.813728:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3180/0xdfc0fb148942187 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03cd expref: 20756 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.813729:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009916c6c0/0xdfc0fb148689272 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f07 expref: 26845 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.813731:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.813736:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.813737:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.813739:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.813741:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.813741:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a949f80 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.813743:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820486 00010000:00010000:2.0:1713481296.813743:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.813745:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.813747:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1959:x1796714882499840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.813747:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501568 00010000:00010000:2.0:1713481296.813748:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.813750:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501568 00010000:00010000:2.0:1713481296.813754:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff88009c0ead00) 00010000:00010000:0.0:1713481296.813755:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.813756:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.813758:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.813759:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3180/0xdfc0fb148942187 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6976:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03cd expref: 20756 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.813759:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.813762:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a949f80/0xdfc0fb148a3b59d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.813764:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563337 00000100:00100000:3.0:1713481296.813767:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16907:18836:x1796714882501568:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.813768:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3180/0xdfc0fb148942187 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6976:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03cd expref: 20756 pid: 15507 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.813769:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26844:1959:x1796714882499712:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.813773:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820485 00010000:00010000:3.0:1713481296.813774:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.813783:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124de7840/0xdfc0fb148a3b5a4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49984 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.813784:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b9c3180/0xdfc0fb148942187 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6976:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03cd expref: 20756 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.813787:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813791:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.813794:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ddd40/0xdfc0fb14891ed89 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb6e4 expref: 20755 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.813796:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.813796:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.813797:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.813798:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.813799:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.813799:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.813800:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930a7180/0xdfc0fb148a3b400 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49929 expref: 16908 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.813800:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b581 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4998b expref: 2800 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.813802:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de7840/0xdfc0fb148a3b5a4 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49984 expref: 16908 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813803:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813806:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133dad200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.813807:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f7f600/0xdfc0fb148a3b581 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4998b expref: 2800 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.813808:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930a7180/0xdfc0fb148a3b400 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49929 expref: 16908 pid: 16463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813808:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.813811:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.813813:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800919ddd40/0xdfc0fb14891ed89 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb6e4 expref: 20755 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.813818:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f7f600, rc 0) 00010000:00010000:3.0:1713481296.813818:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800919ddd40/0xdfc0fb14891ed89 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb6e4 expref: 20755 pid: 16488 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.813821:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.813824:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784529216:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.813825:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133dad200/0xdfc0fb148a3b3eb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.813826:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930a7180/0xdfc0fb148a3b400 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6976:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49929 expref: 16908 pid: 16463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.813834:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2799:18910:x1796714882501632:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 303us (358us total) trans 0 rc 301/301 00000100:00100000:0.0:1713481296.813835:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135b59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784529280:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.813838:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.813840:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485875 00000100:00100000:0.0:1713481296.813853:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007c1eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.813878:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.813892:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.813894:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499968 00000100:00100000:2.0:1713481296.813897:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499968 00000100:00100000:0.0:1713481296.813902:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500224 00000100:00100000:0.0:1713481296.813904:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500224 00010000:00010000:2.0:1713481296.813910:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918373c0/0xdfc0fb148689279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f15 expref: 26844 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.813914:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097d63600/0xdfc0fb148802e58 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e1c expref: 20756 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.813934:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2821:3491:x1796714784526208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8866us (8905us total) trans 4295960762 rc 0/0 00000100:00100000:2.0:1713481296.813934:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820487 00000100:00100000:0.0:1713481296.813938:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820488 00000100:00100000:1.0:1713481296.813938:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563310 00000100:00100000:2.0:1713481296.813939:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26844:1959:x1796714882499968:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.813942:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1959:x1796714882500224:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.813946:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.813947:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.813950:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097d63600/0xdfc0fb148802e58 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e1c expref: 20756 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.813950:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918373c0/0xdfc0fb148689279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f15 expref: 26844 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.813958:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097d63600/0xdfc0fb148802e58 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e1c expref: 20756 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.813959:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918373c0/0xdfc0fb148689279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f15 expref: 26844 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.813967:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.813973:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918373c0/0xdfc0fb148689279 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f15 expref: 26844 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.813974:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097d63600/0xdfc0fb148802e58 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x272d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e1c expref: 20756 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.813974:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500352 00000100:00100000:1.0:1713481296.813976:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500352 00010000:00010000:0.0:1713481296.813983:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.813984:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.813984:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134681440/0xdfc0fb148802e7b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e46 expref: 20756 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.813984:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.813985:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.813986:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.813988:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.813992:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.813994:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820489 00010000:00010000:2.0:1713481296.813995:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.813996:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1959:x1796714882500352:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.814001:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.814003:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134681440/0xdfc0fb148802e7b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e46 expref: 20756 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.814005:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.814009:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134681440/0xdfc0fb148802e7b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e46 expref: 20756 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.814015:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20756:1959:x1796714882500224:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.814020:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820488 00010000:00010000:2.0:1713481296.814020:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.814021:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134681440/0xdfc0fb148802e7b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e46 expref: 20756 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.814025:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814030:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.814031:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.814033:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814034:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.814035:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26843:1959:x1796714882499968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.814037:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814041:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.814042:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820487 00000100:00100000:0.0:1713481296.814048:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.814048:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.814049:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814056:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.814059:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500480 00000100:00100000:1.0:1713481296.814062:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20754:1959:x1796714882500352:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.814062:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500480 00010000:00010000:3.0:1713481296.814062:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ffa0240 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.814065:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820489 00010000:00010000:3.0:1713481296.814065:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814071:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097644480/0xdfc0fb14893ab91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4c7 expref: 26843 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.814072:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.814075:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.814086:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500608 00010000:00010000:3.0:1713481296.814087:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.814088:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500608 00000100:00100000:0.0:1713481296.814092:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.814093:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b431 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.814096:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500736 00010000:00010000:2.0:1713481296.814096:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091e78480/0xdfc0fb14868928e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f3f expref: 26844 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.814098:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500736 00000100:00100000:0.0:1713481296.814105:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820490 00010000:00010000:1.0:1713481296.814105:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801241ef840/0xdfc0fb148689295 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f4d expref: 26845 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.814108:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:1959:x1796714882500480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.814111:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820491 00010000:00010000:0.0:1713481296.814113:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.814115:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:1959:x1796714882500608:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.814116:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097644480/0xdfc0fb14893ab91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4c7 expref: 26845 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.814132:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820492 00000100:00100000:1.0:1713481296.814135:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26845:1959:x1796714882500736:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.814137:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.814140:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.814141:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091e78480/0xdfc0fb14868928e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f3f expref: 26845 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814142:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801241ef840/0xdfc0fb148689295 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f4d expref: 26845 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.814146:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097644480/0xdfc0fb14893ab91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4c7 expref: 26845 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.814147:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091e78480/0xdfc0fb14868928e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f3f expref: 26845 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814148:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801241ef840/0xdfc0fb148689295 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f4d expref: 26845 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.814157:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091e78480/0xdfc0fb14868928e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f3f expref: 26845 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.814158:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097644480/0xdfc0fb14893ab91 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4c7 expref: 26845 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814160:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801241ef840/0xdfc0fb148689295 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f4d expref: 26845 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814167:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.814167:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.814168:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.814168:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.814169:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814170:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.814173:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.814174:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814174:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814182:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.814187:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26842:1959:x1796714882500480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (138us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.814188:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.814191:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26842:1959:x1796714882500736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.814194:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820490 00000100:00100000:1.0:1713481296.814197:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820492 00000100:00100000:2.0:1713481296.814198:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26842:1959:x1796714882500608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.814202:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820491 00010000:00010000:1.0:1713481296.814212:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814219:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.814225:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299d880/2, rc 0, transno 993466 00010000:00010000:1.0:1713481296.814226:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.814229:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784526208:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.814232:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814242:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814248:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009716e400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.814251:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814258:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814271:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814277:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009716e400/0xdfc0fb148a3b4c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.814284:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+2821:3491:x1796714784526528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8462us (8513us total) trans 4295960763 rc 0/0 00000100:00100000:3.0:1713481296.814292:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563312 00000004:00080000:2.0:1713481296.814315:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a17480/2, rc 0, transno 993467 00000100:00100000:2.0:1713481296.814319:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784526528:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.814320:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814328:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814334:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814336:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814339:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814343:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814343:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814347:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814350:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814351:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814354:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832cd200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.814356:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814356:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bd986c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.814358:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814360:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814365:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814368:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814372:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800832cd200/0xdfc0fb148a3b446 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x272d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814378:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814385:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bd986c0/0xdfc0fb148a3b47e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.814413:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2821:3490:x1796714784527744:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6377us (6469us total) trans 4295960764 rc 0/0 00000100:00100000:1.0:1713481296.814420:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563324 00000100:00100000:1.0:1713481296.814443:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784529344:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.814465:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.814472:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+228:3493:x1796714784526656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8412us (8483us total) trans 4296040890 rc 0/0 00000100:00100000:2.0:1713481296.814476:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563315 00000100:00100000:0.0:1713481296.814479:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.814480:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.814485:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784529408:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.814492:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784529344 00000100:00100000:2.0:1713481296.814494:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784529344 00000100:00100000:2.0:1713481296.814504:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563338 00000100:00100000:2.0:1713481296.814507:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2821:3492:x1796714784529344:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.814514:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1713481296.814515:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43451 count 1 00010000:00010000:2.0:1713481296.814524:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.814529:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.814534:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134326d00/0xdfc0fb1486892aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f77 expref: 26839 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.814539:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.814539:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+227:3492:x1796714784527232:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7750us (7833us total) trans 4296040891 rc 0/0 00000004:00080000:1.0:1713481296.814540:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fdae300/2, rc 0, transno 1073595 00010000:00010000:2.0:1713481296.814540:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.814543:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.814546:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563318 00000100:00100000:1.0:1713481296.814548:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784527232:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.814559:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134326d00/0xdfc0fb1486892aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f77 expref: 26839 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.814561:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501056 00000100:00100000:3.0:1713481296.814562:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784529408 00000100:00100000:1.0:1713481296.814563:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501056 00000100:00100000:0.0:1713481296.814564:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.814565:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784529408 00010000:00010000:2.0:1713481296.814568:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134326d00/0xdfc0fb1486892aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f77 expref: 26840 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814574:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134325b00/0xdfc0fb14868929c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f69 expref: 26840 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.814578:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784529472:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.814581:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499520 00000100:00100000:3.0:1713481296.814582:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563339 00000100:00100000:0.0:1713481296.814584:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499520 00000100:00100000:3.0:1713481296.814585:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2822:3492:x1796714784529408:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.814586:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499648 00000100:00100000:1.0:1713481296.814588:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499648 00000100:00100000:2.0:1713481296.814593:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.814596:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122aec000/0xdfc0fb1489cfd25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2233e expref: 24479 pid: 16506 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.814596:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991deac0/0xdfc0fb1488e7e61 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b551e expref: 16909 pid: 16467 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.814597:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43452 count 1 00000100:00100000:2.0:1713481296.814609:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820493 00010000:00010000:3.0:1713481296.814609:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.814612:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820494 00000100:00100000:2.0:1713481296.814612:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26840:1959:x1796714882501056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.814616:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820495 00000100:00100000:1.0:1713481296.814616:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16909:1959:x1796714882499648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.814618:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.814619:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973558c0/0xdfc0fb1486892b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f85 expref: 26840 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.814621:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1959:x1796714882499520:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.814621:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.814621:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134325b00/0xdfc0fb14868929c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f69 expref: 26840 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814624:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991deac0/0xdfc0fb1488e7e61 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b551e expref: 16909 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.814626:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.814627:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.814627:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134325b00/0xdfc0fb14868929c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f69 expref: 26840 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.814627:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.814629:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991deac0/0xdfc0fb1488e7e61 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b551e expref: 16909 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.814629:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.814630:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122aec000/0xdfc0fb1489cfd25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2233e expref: 24479 pid: 16506 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.814638:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122aec000/0xdfc0fb1489cfd25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2233e expref: 24479 pid: 16506 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.814639:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134325b00/0xdfc0fb14868929c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f69 expref: 26840 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814640:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991deac0/0xdfc0fb1488e7e61 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b551e expref: 16909 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.814647:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.814647:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973558c0/0xdfc0fb1486892b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f85 expref: 26839 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.814648:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.814648:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.814649:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.814650:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122aec000/0xdfc0fb1489cfd25 lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2233e expref: 24479 pid: 16506 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.814650:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814652:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133dad8c0/0xdfc0fb148a3b3dd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49930 expref: 16908 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.814655:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973558c0/0xdfc0fb1486892b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f85 expref: 26839 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.814657:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814660:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133dad8c0/0xdfc0fb148a3b3dd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49930 expref: 16908 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.814661:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.814674:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.814677:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133dacb40/0xdfc0fb148a3b3cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4990d expref: 26839 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.814678:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784529536:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.814682:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.814685:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133dacb40/0xdfc0fb148a3b3cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4990d expref: 26839 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814687:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133dad8c0/0xdfc0fb148a3b3dd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49930 expref: 16908 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.814693:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784529600:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.814698:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26839:1959:x1796714882501056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.814700:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.814703:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133dacb40/0xdfc0fb148a3b3cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4990d expref: 26839 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.814703:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820493 00000100:00100000:1.0:1713481296.814705:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378780 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.814711:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784529664:192.168.202.24@tcp:105: 00000004:00080000:3.0:1713481296.814722:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007712a300/2, rc 0, transno 1073594 00000100:00100000:0.0:1713481296.814723:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.814725:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784526656:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.814726:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814733:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814740:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.814742:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a14380/2, rc 0, transno 993468 00000100:00100000:0.0:1713481296.814745:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.814746:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.814747:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784527744:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.814753:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.814757:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.814758:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009716d8c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.814761:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.814762:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499776 00000100:00100000:1.0:1713481296.814765:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499776 00000100:00100000:0.0:1713481296.814772:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.814773:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.814775:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784529728:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.814777:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012caadf80/0xdfc0fb148802e66 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e38 expref: 20754 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.814784:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.814784:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814791:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009716d8c0/0xdfc0fb148a3b4e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.814793:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.814794:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882499904 00000100:00100000:0.0:1713481296.814796:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.814796:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882499904 00010000:00010000:1.0:1713481296.814805:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cb86c0/0xdfc0fb148a13f11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38011 expref: 24479 pid: 15507 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.814809:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.814811:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.814812:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784529792:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.814822:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500032 00000100:00100000:3.0:1713481296.814822:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.814824:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500032 00000100:00100000:0.0:1713481296.814834:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.814836:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134327180/0xdfc0fb148689280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f23 expref: 26839 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.814848:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.814851:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500288 00000100:00100000:3.0:1713481296.814851:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784529856:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.814853:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500288 00000100:00100000:0.0:1713481296.814855:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500416 00000100:00100000:0.0:1713481296.814858:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500416 00010000:00010000:1.0:1713481296.814861:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801346818c0/0xdfc0fb148802e5f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e2a expref: 20755 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.814862:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.814869:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122492ac0/0xdfc0fb148689287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f31 expref: 26840 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.814869:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500544 00000100:00100000:1.0:1713481296.814871:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500544 00010000:00010000:1.0:1713481296.814877:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083729f80/0xdfc0fb14891d445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca70f expref: 24480 pid: 15498 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.814877:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784529728 00000100:00100000:3.0:1713481296.814879:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784529728 00000100:00100000:0.0:1713481296.814882:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500672 00000100:00100000:0.0:1713481296.814884:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500672 00000100:00100000:1.0:1713481296.814885:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820496 00000100:00100000:1.0:1713481296.814888:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20755:1959:x1796714882499776:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.814890:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784529792 00010000:00010000:1.0:1713481296.814892:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.814892:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784529792 00010000:00010000:0.0:1713481296.814893:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097355d40/0xdfc0fb1486892a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f5b expref: 26841 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814895:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012caadf80/0xdfc0fb148802e66 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e38 expref: 20755 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.814898:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784529856 00010000:00010000:1.0:1713481296.814900:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012caadf80/0xdfc0fb148802e66 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e38 expref: 20755 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.814900:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784529856 00000100:00100000:0.0:1713481296.814906:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820497 00000100:00100000:3.0:1713481296.814908:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563340 00000100:00100000:0.0:1713481296.814910:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1959:x1796714882499904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.814911:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+228:3490:x1796714784529728:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.814912:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caadf80/0xdfc0fb148802e66 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x272f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e38 expref: 20755 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.814916:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.814919:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.814920:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713481296.814920:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10039 count 1 00010000:00010000:1.0:1713481296.814922:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.814925:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cb86c0/0xdfc0fb148a13f11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38011 expref: 24480 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.814926:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.814927:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2824:3491:x1796714784528256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6324us (6397us total) trans 4295960765 rc 0/0 00010000:00010000:3.0:1713481296.814929:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.814933:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cb86c0/0xdfc0fb148a13f11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38011 expref: 24480 pid: 15507 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.814933:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563328 00010000:00010000:3.0:1713481296.814937:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148802eac lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ea8 expref: 20754 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.814938:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.814941:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.814942:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.814944:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.814948:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20754:1959:x1796714882499776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.814950:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cb86c0/0xdfc0fb148a13f11 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38011 expref: 24480 pid: 15507 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.814953:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820496 00000100:00100000:2.0:1713481296.814956:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563341 00010000:00010000:3.0:1713481296.814957:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148802eac lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ea8 expref: 20754 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.814961:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+228:3490:x1796714784529792:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.814964:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148802eac lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ea8 expref: 20754 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.814965:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.814967:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.814969:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784529920:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.814970:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800978c6400/0xdfc0fb148a3b4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49953 expref: 24479 pid: 16488 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.814971:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10040 count 1 00000100:00100000:1.0:1713481296.814973:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820498 00010000:00010000:0.0:1713481296.814977:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978c6400/0xdfc0fb148a3b4cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49953 expref: 24479 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.814977:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26841:1959:x1796714882500032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.814979:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.814979:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.814983:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.814986:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2ead00/0xdfc0fb148802eb3 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eb6 expref: 20753 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.814988:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134327180/0xdfc0fb148689280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f23 expref: 26841 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.814990:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.814991:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800978c6400/0xdfc0fb148a3b4cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49953 expref: 24479 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.814991:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.814992:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.814997:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134327180/0xdfc0fb148689280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f23 expref: 26841 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.814997:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563342 00000100:00100000:0.0:1713481296.814998:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784529984:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.815001:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2823:3493:x1796714784529856:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.815006:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2ead00/0xdfc0fb148802eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eb6 expref: 20753 pid: 9202 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713481296.815008:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43455 count 1 00010000:00010000:1.0:1713481296.815011:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134327180/0xdfc0fb148689280 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f23 expref: 26841 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.815012:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b980c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.815012:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2ead00/0xdfc0fb148802eb3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eb6 expref: 20753 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.815016:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815018:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784530048:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.815021:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.815022:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134325680/0xdfc0fb1486892b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f93 expref: 26840 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.815023:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.815025:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815026:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.815027:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.815028:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815029:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.815032:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815039:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134325680/0xdfc0fb1486892b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f93 expref: 26840 pid: 16479 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.815040:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.815042:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820499 00000100:00100000:2.0:1713481296.815045:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20753:1959:x1796714882500288:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.815048:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.815048:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134325680/0xdfc0fb1486892b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f93 expref: 26840 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.815049:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.815052:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801346818c0/0xdfc0fb148802e5f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x272e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e2a expref: 20753 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.815053:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.815053:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784530112:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.815058:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801346818c0/0xdfc0fb148802e5f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x272e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e2a expref: 20753 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.815063:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26840:1959:x1796714882500032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.815065:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2180 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.815067:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801346818c0/0xdfc0fb148802e5f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x272e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e2a expref: 20753 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.815068:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.815070:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820498 00010000:00010000:2.0:1713481296.815075:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815076:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815077:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815080:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501760 00000100:00100000:0.0:1713481296.815083:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501760 00010000:00010000:2.0:1713481296.815084:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.815092:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882500864 00000100:00100000:1.0:1713481296.815094:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882500864 00010000:00010000:2.0:1713481296.815095:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.815100:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563343 00010000:00010000:3.0:1713481296.815100:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815103:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009068d200/0xdfc0fb148802e82 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e54 expref: 20754 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.815103:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20754:1959:x1796714882500288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.815105:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20754:17924:x1796714882501760:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.815105:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815107:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820499 00010000:00010000:3.0:1713481296.815110:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.815112:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.815113:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501184 00010000:00010000:3.0:1713481296.815114:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.815115:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501184 00010000:00010000:0.0:1713481296.815136:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148a3b5ce lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49992 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815136:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820500 00010000:00010000:3.0:1713481296.815136:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815139:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26839:1959:x1796714882500416:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.815139:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bd9b3c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.815141:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815143:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979c4d80/0xdfc0fb148802e90 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e70 expref: 20755 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.815143:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.815145:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815146:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122492ac0/0xdfc0fb148689287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f31 expref: 26839 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.815147:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880121e31200/0xdfc0fb148a15fe1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39844 expref: 20755 pid: 16455 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.815151:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.815152:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815152:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122492ac0/0xdfc0fb148689287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f31 expref: 26839 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.815153:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820501 00010000:00010000:0.0:1713481296.815154:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148a3b5ce lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49992 expref: 20755 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815155:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.815156:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1959:x1796714882500544:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.815160:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bd9b3c0/0xdfc0fb148a3b44d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x272e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815161:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122492ac0/0xdfc0fb148689287 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f31 expref: 26839 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.815163:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.815164:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880121e31200/0xdfc0fb148a15fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39844 expref: 20755 pid: 16455 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.815167:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083729f80/0xdfc0fb14891d445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca70f expref: 24479 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.815170:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880121e31200/0xdfc0fb148a15fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39844 expref: 20755 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.815171:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815172:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.815174:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083729f80/0xdfc0fb14891d445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca70f expref: 24479 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.815174:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815175:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133c53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784530176:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.815178:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815186:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231ed0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.815187:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.815192:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083729f80/0xdfc0fb14891d445 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca70f expref: 24479 pid: 15498 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.815195:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26838:1959:x1796714882500416:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.815198:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820500 00010000:00010000:1.0:1713481296.815205:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.815207:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.815208:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820502 00000100:00100000:0.0:1713481296.815209:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.815210:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085dcba80/0xdfc0fb148a3b493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4993e expref: 24478 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815211:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26837:1959:x1796714882500672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.815216:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.815217:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085dcba80/0xdfc0fb148a3b493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4993e expref: 24478 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815219:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097355d40/0xdfc0fb1486892a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f5b expref: 26837 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.815224:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097355d40/0xdfc0fb1486892a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f5b expref: 26837 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.815232:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097355d40/0xdfc0fb1486892a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f5b expref: 26837 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.815235:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880085dcba80/0xdfc0fb148a3b493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4993e expref: 24478 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815239:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815240:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815241:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.815243:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078340380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784530240:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.815245:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815252:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.815260:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d3789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.815263:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1959:x1796714882500672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 51us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.815266:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820502 00000100:00100000:3.0:1713481296.815272:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+229:3490:x1796714784526912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8987us (9056us total) trans 4296040892 rc 0/0 00010000:00010000:1.0:1713481296.815275:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815279:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815280:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563316 00000100:00100000:2.0:1713481296.815281:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820503 00000100:00100000:2.0:1713481296.815283:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20755:1959:x1796714882500864:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.815284:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815287:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815287:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.815289:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009068d200/0xdfc0fb148802e82 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e54 expref: 20755 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.815291:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815294:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012cef1d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.815294:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009068d200/0xdfc0fb148802e82 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e54 expref: 20755 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.815296:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815299:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815300:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:3.0:1713481296.815306:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077129500/2, rc 0, transno 1073596 00010000:00010000:2.0:1713481296.815308:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009068d200/0xdfc0fb148802e82 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e54 expref: 20755 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.815309:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815311:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784526912:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.815313:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cef1d40/0xdfc0fb148a3b43f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815317:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815318:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.815319:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.815320:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815324:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815332:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.815334:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.815337:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501824 00000100:00100000:3.0:1713481296.815339:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501824 00000100:00100000:2.0:1713481296.815341:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20754:1959:x1796714882500864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.815344:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820503 00000100:00100000:2.0:1713481296.815354:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820504 00000100:00100000:2.0:1713481296.815356:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20753:1959:x1796714882501184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.815358:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501888 00010000:00010000:2.0:1713481296.815360:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.815360:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501888 00010000:00010000:2.0:1713481296.815363:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979c4d80/0xdfc0fb148802e90 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e70 expref: 20753 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.815368:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979c4d80/0xdfc0fb148802e90 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e70 expref: 20753 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.815369:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502080 00000100:00100000:3.0:1713481296.815370:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502080 00010000:00010000:2.0:1713481296.815377:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979c4d80/0xdfc0fb148802e90 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2733:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e70 expref: 20754 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.815381:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563344 00000100:00100000:3.0:1713481296.815384:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16909:17009:x1796714882501824:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.815387:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815388:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.815389:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.815389:0:16502:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.815391:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815397:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815398:0:16502:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008495a880/0xdfc0fb148a3b5d5 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499a0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815407:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502144 00002000:00010000:3.0:1713481296.815408:0:16502:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.815410:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502144 00010000:00010000:2.0:1713481296.815410:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.815414:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.815415:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2824:3492:x1796714784526720:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9361us (9436us total) trans 4295960766 rc 0/0 00010000:00010000:3.0:1713481296.815416:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.815419:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563314 00010000:00010000:3.0:1713481296.815419:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008495a880/0xdfc0fb148a3b5d5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499a0 expref: 16910 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815423:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20753:1959:x1796714882501184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (368us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.815426:0:16502:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008495a880/0xdfc0fb148a3b5d5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499a0 expref: 16910 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815429:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563345 00000100:00100000:2.0:1713481296.815429:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820504 00010000:00010000:3.0:1713481296.815431:0:16502:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008495a880, rc 0) 00000100:00100000:0.0:1713481296.815434:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:17935:x1796714882501888:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.815436:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563346 00000100:00100000:1.0:1713481296.815439:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20753:18792:x1796714882502080:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.815441:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.815443:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16910:17009:x1796714882501824:12345-192.168.202.24@tcp:101:dd.0 Request processed in 58us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.815445:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.815447:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563344 00010000:00010000:0.0:1713481296.815450:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b5dc lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb798:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499a7 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815452:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081ca2f40/0xdfc0fb148a3b5e3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc520:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499b5 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815452:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815460:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563347 00002000:00010000:1.0:1713481296.815461:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc520:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.815462:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815463:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:15045:x1796714882502144:12345-192.168.202.24@tcp:101:dd.0 00002000:00010000:0.0:1713481296.815464:0:15510:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb798:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.815468:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.815468:0:16502:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.815469:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.815469:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.815471:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.815471:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081ca2f40/0xdfc0fb148a3b5e3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc520:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499b5 expref: 20753 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.815472:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.815475:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b5dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499a7 expref: 26837 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815476:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815476:0:16502:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b5ea lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499bc expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815478:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081ca2f40/0xdfc0fb148a3b5e3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc520:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499b5 expref: 20753 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.815481:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133dacfc0/0xdfc0fb148a3b5dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499a7 expref: 26837 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815482:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815483:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081ca2f40, rc 0) 00002000:00010000:3.0:1713481296.815485:0:16502:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.815487:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085dc9d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.815489:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133dacfc0, rc 0) 00010000:00010000:2.0:1713481296.815490:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815491:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.815491:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.815493:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20753:18792:x1796714882502080:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 53us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.815494:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b5ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499bc expref: 24480 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.815497:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563346 00010000:00010000:2.0:1713481296.815497:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815500:0:16502:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008495b600/0xdfc0fb148a3b5ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499bc expref: 24480 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815504:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26837:17935:x1796714882501888:12345-192.168.202.24@tcp:101:dd.0 Request processed in 70us (183us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.815505:0:16502:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008495b600, rc 0) 00010000:00010000:2.0:1713481296.815508:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.815509:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563345 00000100:00100000:3.0:1713481296.815513:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:15045:x1796714882502144:12345-192.168.202.24@tcp:101:dd.0 Request processed in 49us (125us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.815514:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085dc9d40/0xdfc0fb148a3b4bd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815516:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815517:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563347 00010000:00010000:1.0:1713481296.815521:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815525:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815529:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815532:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815535:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009716d200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.815537:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815540:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815544:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815547:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815548:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815553:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815554:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009716d200/0xdfc0fb148a3b4e7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815557:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815560:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815564:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978c4fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.815565:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815569:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815577:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815581:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800978c4fc0/0xdfc0fb148a3b4d2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.815640:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2824:3492:x1796714784527808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7660us (7729us total) trans 4295960767 rc 0/0 00000100:00100000:2.0:1713481296.815647:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563323 00000100:00100000:1.0:1713481296.815654:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+230:3493:x1796714784528512:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6874us (6932us total) trans 4296040893 rc 0/0 00000100:00100000:1.0:1713481296.815657:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563329 00010000:00010000:1.0:1713481296.815694:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815699:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815703:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.815705:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007810ce00/2, rc 0, transno 993469 00010000:00010000:1.0:1713481296.815706:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815710:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815713:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bd99b00 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.815713:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+229:3493:x1796714784528064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7149us (7276us total) trans 4296040894 rc 0/0 00000100:00100000:2.0:1713481296.815714:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784528256:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.815715:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815718:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563326 00010000:00010000:1.0:1713481296.815719:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815727:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.815731:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bd99b00/0xdfc0fb148a3b454 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x272f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815732:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815739:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815742:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784530304:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.815745:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815752:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815755:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.815758:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815764:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a831680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.815767:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.815771:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d94a80/2, rc 0, transno 1073597 00010000:00010000:2.0:1713481296.815773:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815774:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784528512:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713481296.815780:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880075755f80/2, rc 0, transno 1073598 00000100:00100000:3.0:1713481296.815782:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784528064:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.815787:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.815794:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a831680/0xdfc0fb148a3b485 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.815796:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530304 00000100:00100000:3.0:1713481296.815798:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530304 00000100:00100000:3.0:1713481296.815808:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563348 00000100:00100000:3.0:1713481296.815811:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+230:3493:x1796714784530304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.815819:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10041 count 1 00010000:00010000:3.0:1713481296.815828:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.815829:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+230:3493:x1796714784527168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9181us (9227us total) trans 4296040895 rc 0/0 00010000:00010000:3.0:1713481296.815836:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800771d21c0/0xdfc0fb148802eba lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ec4 expref: 20752 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.815839:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563317 00010000:00010000:3.0:1713481296.815842:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.815843:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.815845:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.815868:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800771d21c0/0xdfc0fb148802eba lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ec4 expref: 20752 pid: 16538 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.815872:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007fdac380/2, rc 0, transno 1073599 00000100:00100000:1.0:1713481296.815875:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007fdac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784527168:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.815877:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800771d21c0/0xdfc0fb148802eba lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ec4 expref: 20752 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.815887:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800967cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784530368:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.815902:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095fc1240 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.815926:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007fdaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2824:3491:x1796714784527104:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9132us (9170us total) trans 4295960768 rc 0/0 00000100:00100000:2.0:1713481296.815931:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563319 00000100:00100000:3.0:1713481296.815941:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800967cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784530432:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.815949:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.815951:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800967cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784530496:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.815957:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800967cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784530560:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.815959:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.815969:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.815990:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.815990:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a17800/2, rc 0, transno 993471 00000004:00080000:2.0:1713481296.815992:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ae9f80/2, rc 0, transno 993472 00000100:00100000:3.0:1713481296.815994:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784527808:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.815995:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784527104:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.816007:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800881a4000/2, rc 0, transno 993470 00000100:00100000:2.0:1713481296.816008:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530432 00000100:00100000:2.0:1713481296.816010:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530432 00000100:00100000:3.0:1713481296.816011:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784526720:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.816012:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530496 00000100:00100000:1.0:1713481296.816015:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530496 00000100:00100000:2.0:1713481296.816019:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530560 00000100:00100000:2.0:1713481296.816021:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530560 00000100:00100000:3.0:1713481296.816030:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563349 00000100:00100000:2.0:1713481296.816034:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563350 00000100:00100000:3.0:1713481296.816036:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+232:3490:x1796714784530432:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.816038:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563351 00000100:00100000:2.0:1713481296.816038:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+232:3491:x1796714784530496:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.816042:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+232:3493:x1796714784530560:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.816052:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10043 count 1 00002000:00080000:1.0:1713481296.816054:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10044 count 1 00010000:00010000:2.0:1713481296.816059:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.816064:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816066:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2e8480/0xdfc0fb148802ecf lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ee0 expref: 20752 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.816070:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.816071:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.816073:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c6758c0/0xdfc0fb148802ec8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eee expref: 20752 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.816073:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.816078:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.816080:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.816082:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 4/0,1 mode: --/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816084:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2e8480/0xdfc0fb148802ecf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ee0 expref: 20752 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.816090:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2e8480/0xdfc0fb148802ecf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ee0 expref: 20752 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.816093:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007992f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784530688:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.816096:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784530816:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.816098:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c6758c0/0xdfc0fb148802ec8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eee expref: 20752 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.816106:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c6758c0/0xdfc0fb148802ec8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eee expref: 20752 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.816114:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861540 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.816115:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784530944:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.816142:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007992ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784530752:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.816156:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.816161:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124d31900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.816175:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.816181:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530688 00000100:00100000:1.0:1713481296.816185:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530688 00000100:00100000:3.0:1713481296.816194:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007992f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784530880:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.816201:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530752 00000100:00100000:1.0:1713481296.816203:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530752 00000100:00100000:2.0:1713481296.816207:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563352 00000100:00100000:2.0:1713481296.816212:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801205aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2825:3490:x1796714784530688:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.816215:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.816217:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563353 00000100:00100000:1.0:1713481296.816222:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2825:3491:x1796714784530752:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.816223:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43459 count 1 00002000:00080000:1.0:1713481296.816232:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43461 count 1 00010000:00010000:2.0:1713481296.816233:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.816234:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.816239:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007992c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784530624:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.816242:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097356d00/0xdfc0fb1486892cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2faf expref: 26836 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.816243:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.816246:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530880 00010000:00010000:2.0:1713481296.816248:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.816249:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.816250:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530880 00010000:00010000:2.0:1713481296.816251:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.816253:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097354fc0/0xdfc0fb1486892d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fbd expref: 26836 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.816259:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.816259:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.816260:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.816262:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.816267:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784530624 00010000:00010000:2.0:1713481296.816267:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097356d00/0xdfc0fb1486892cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2faf expref: 26836 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.816270:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784530624 00010000:00010000:2.0:1713481296.816275:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097356d00/0xdfc0fb1486892cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2faf expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.816282:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097354fc0/0xdfc0fb1486892d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fbd expref: 26836 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.816283:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563354 00000100:00100000:2.0:1713481296.816284:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784531008:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.816288:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801205adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2827:3492:x1796714784530880:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.816288:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097354fc0/0xdfc0fb1486892d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fbd expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.816293:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563355 00000100:00100000:1.0:1713481296.816295:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784531072:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.816298:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.816299:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801205ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2827:3492:x1796714784530624:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.816301:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43463 count 1 00000100:00100000:1.0:1713481296.816309:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009693c780 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.816312:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.816312:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43456 count 1 00000100:00100000:2.0:1713481296.816320:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882501696 00010000:00010000:0.0:1713481296.816322:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097354240/0xdfc0fb1486892db lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fcb expref: 26836 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.816322:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882501696 00010000:00010000:3.0:1713481296.816325:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.816333:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.816335:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.816336:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485876 00010000:00010000:3.0:1713481296.816336:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121e32d00/0xdfc0fb1486892c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fa1 expref: 26836 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.816337:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.816339:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:18979:x1796714882501696:12345-192.168.202.24@tcp:101:touch.0 00010000:00010000:3.0:1713481296.816342:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.816344:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.816344:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.816347:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816350:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b622 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49999 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.816354:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097354240/0xdfc0fb1486892db lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fcb expref: 26836 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.816363:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097354240/0xdfc0fb1486892db lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fcb expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.816363:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121e32d00/0xdfc0fb1486892c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fa1 expref: 26836 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.816369:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b622 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49999 expref: 2046 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.816373:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784531136:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.816373:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121e32d00/0xdfc0fb1486892c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fa1 expref: 26836 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.816375:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986cc000/0xdfc0fb148a3b622 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cbe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49999 expref: 2046 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816383:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbe:0x0].0x0 (ffff88012bb20100) 00000100:00100000:3.0:1713481296.816383:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784531200:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.816385:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713481296.816386:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986cc000, rc 0) 00000100:00100000:0.0:1713481296.816392:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cdb09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.816401:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:18979:x1796714882501696:12345-192.168.202.24@tcp:101:touch.0 Request processed in 61us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.816405:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485876 00000100:00100000:3.0:1713481296.816407:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33d180 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.816421:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.816424:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10042 count 1 00010000:00010000:2.0:1713481296.816426:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816430:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816434:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.816435:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816437:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816441:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085dca1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.816442:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816446:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.816446:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe65680/0xdfc0fb148802ec1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ed2 expref: 20752 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.816452:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.816453:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.816454:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.816456:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085dca1c0/0xdfc0fb148a3b4af lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.816457:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.816472:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe65680/0xdfc0fb148802ec1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ed2 expref: 20752 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.816481:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe65680/0xdfc0fb148802ec1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ed2 expref: 20752 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.816491:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784531264:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.816508:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800985c7840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.816604:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2828:3490:x1796714784527616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9254us (9354us total) trans 4295960769 rc 0/0 00000004:00080000:3.0:1713481296.816610:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787c5180/2, rc 0, transno 993473 00000100:00100000:2.0:1713481296.816611:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563321 00000100:00100000:3.0:1713481296.816618:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784527616:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.816688:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.816697:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784531328:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.816719:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.816748:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784531328 00000100:00100000:2.0:1713481296.816751:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784531328 00000100:00100000:2.0:1713481296.816774:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563356 00000100:00100000:1.0:1713481296.816779:0:15479:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e1d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:15479:1796714784528768:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.816779:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2828:3492:x1796714784531328:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.816791:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43465 count 1 00010000:00010000:1.0:1713481296.816796:0:15479:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.816801:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816811:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3feac0/0xdfc0fb1486892e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fd9 expref: 26836 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.816817:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.816819:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.816821:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.816837:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3feac0/0xdfc0fb1486892e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fd9 expref: 26836 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.816845:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3feac0/0xdfc0fb1486892e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fd9 expref: 26836 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.816854:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784531392:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.816858:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.816874:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978610c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.816890:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784529024:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.816907:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.816917:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e27b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784528960:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.816928:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784529088:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.816934:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.816935:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.816947:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800833761c0/0xdfc0fb148a3b55e lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4996f expref: 20752 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.816953:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502272 00000100:00100000:0.0:1713481296.816955:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502272 00010000:00010000:2.0:1713481296.816956:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800833761c0, rc 0) 00000100:00100000:3.0:1713481296.816957:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502336 00000100:00100000:3.0:1713481296.816961:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502336 00000100:00100000:1.0:1713481296.816968:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.816979:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125695 00000100:00100000:2.0:1713481296.816980:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20752:10479:x1796714882501312:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3555us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.816981:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563357 00000100:00100000:0.0:1713481296.816984:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2384:18929:x1796714882502272:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:3.0:1713481296.816987:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16910:18844:x1796714882502336:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.816988:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563336 00010000:00010000:3.0:1713481296.816994:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.817007:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c204000/0xdfc0fb148a3b637 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499c3 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.817014:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502400 00000100:00100000:2.0:1713481296.817018:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502400 00002000:00010000:3.0:1713481296.817020:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.817028:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2046 pid: 15484 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.817031:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.817033:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.817037:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.817037:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c204000/0xdfc0fb148a3b637 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499c3 expref: 16911 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.817043:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502528 00000100:00100000:2.0:1713481296.817046:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502528 00010000:00010000:3.0:1713481296.817048:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007c204000/0xdfc0fb148a3b637 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499c3 expref: 16911 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.817054:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800771d2ac0/0xdfc0fb148802e9e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e8c expref: 20752 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.817056:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c204000, rc 0) 00000100:00100000:1.0:1713481296.817059:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820505 00000100:00100000:1.0:1713481296.817065:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:1959:x1796714882502400:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.817071:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2385:18929:x1796714882502272:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 85us (213us total) trans 4295107612 rc 0/0 00000100:00100000:2.0:1713481296.817071:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820506 00010000:00010000:1.0:1713481296.817073:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.817075:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20752:1959:x1796714882502528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.817077:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16911:18844:x1796714882502336:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.817078:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125695 00010000:00010000:1.0:1713481296.817078:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2046 pid: 15484 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.817082:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.817085:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2046 pid: 15484 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.817086:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563357 00010000:00010000:2.0:1713481296.817087:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800771d2ac0/0xdfc0fb148802e9e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e8c expref: 20752 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.817093:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800771d2ac0/0xdfc0fb148802e9e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e8c expref: 20752 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.817098:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f816d00/0xdfc0fb148a38044 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47a82 expref: 2046 pid: 15484 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.817106:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800771d2ac0/0xdfc0fb148802e9e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e8c expref: 20752 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.817110:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb7:0x0].0x0 (ffff88009c077100) 00010000:00010000:1.0:1713481296.817113:0:6918:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817115:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.817116:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817116:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.817134:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817136:0:6918:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817139:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817148:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.817156:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.817164:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:1959:x1796714882502400:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.817170:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820505 00000100:00100000:2.0:1713481296.817173:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20751:1959:x1796714882502528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 97us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.817179:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820506 00010000:00010000:1.0:1713481296.817194:0:15479:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.817199:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000001:00080000:1.0:1713481296.817239:0:15479:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4295107609 00000004:00010000:1.0:1713481296.817266:0:15479:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880121d8ad80 reply state ffff88007a599000 transno 4295107613 ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.817271:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817275:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009716ef40/0xdfc0fb148a3b503 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.817279:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817281:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb7:0x0].0x0 (ffff88009c077100) 00010000:00010000:1.0:1713481296.817284:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.817286:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.817286:0:15479:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.817292:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.817299:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.817304:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800830baf40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.817307:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.817314:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.817320:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2386:18765:x1796714882500160:12345-192.168.202.24@tcp:36:dir_create.sh.0 Request processed in 5484us (5584us total) trans 4295107613 rc 0/0 00000100:00100000:1.0:1713481296.817324:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485871 00010000:00010000:0.0:1713481296.817327:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713481296.817327:0:15479:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1713481296.817334:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800830baf40/0xdfc0fb148a3b550 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.817490:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+233:3490:x1796714784528832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4251us (4312us total) trans 4296040896 rc 0/0 00000100:00100000:0.0:1713481296.817497:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563334 00000004:00080000:2.0:1713481296.817521:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d96680/2, rc 0, transno 1073600 00000100:00100000:2.0:1713481296.817538:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784528832:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.817550:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.817565:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502656 00000100:00100000:1.0:1713481296.817569:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502656 00000100:00100000:0.0:1713481296.817572:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.817575:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784531456:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.817587:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.817588:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485877 00000100:00100000:1.0:1713481296.817593:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2045:18943:x1796714882502656:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.817599:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.817601:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.817609:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca0480/0xdfc0fb148a3b63e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499ca expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.817623:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135b59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784529152:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.817638:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502464 00010000:00010000:0.0:1713481296.817642:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.817642:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502464 00010000:00010000:2.0:1713481296.817653:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969a2ac0/0xdfc0fb148802ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e9a expref: 20751 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.817658:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16910:1959:x1796714882499584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4110us (4159us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.817659:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.817680:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820484 00010000:00010000:1.0:1713481296.817684:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.817687:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502592 00000100:00100000:2.0:1713481296.817689:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502592 00010000:00010000:1.0:1713481296.817690:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817699:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099012d00/0xdfc0fb148916db4 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6592 expref: 20752 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.817701:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.817706:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.817711:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00000100:00100000:2.0:1713481296.817715:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820507 00000100:00100000:2.0:1713481296.817719:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20752:1959:x1796714882502464:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.817726:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.817730:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969a2ac0/0xdfc0fb148802ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e9a expref: 20752 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.817737:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969a2ac0/0xdfc0fb148802ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e9a expref: 20752 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.817738:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.817741:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820508 00010000:00010000:1.0:1713481296.817744:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.817745:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20752:1959:x1796714882502592:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.817750:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.817752:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.817755:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969a2ac0/0xdfc0fb148802ea5 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962e9a expref: 20752 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.817761:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099012d00/0xdfc0fb148916db4 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6592 expref: 20752 pid: 15496 timeout: 815 lvb_type: 1 00000004:00010000:1.0:1713481296.817762:0:15479:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817768:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.817770:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099012d00/0xdfc0fb148916db4 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6592 expref: 20751 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.817770:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.817771:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817772:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817776:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.817781:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.817782:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099012d00/0xdfc0fb148916db4 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6592 expref: 20751 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.817784:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817786:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.817791:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012050df80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.817792:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.817793:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.817793:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.817796:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800833761c0/0xdfc0fb148a3b55e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4996f expref: 20750 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817798:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817799:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.817803:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800833761c0/0xdfc0fb148a3b55e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4996f expref: 20750 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817805:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.817807:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.817809:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.817814:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012050df80/0xdfc0fb148a3b645 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:0.0:1713481296.817817:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800833761c0/0xdfc0fb148a3b55e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4996f expref: 20750 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.817817:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20750:1959:x1796714882502464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.817824:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784531520:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.817824:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820507 00010000:00010000:1.0:1713481296.817835:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.817839:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33dc00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.817839:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.817844:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817846:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817848:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012050f3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.817850:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817852:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.817853:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784531456 00010000:00010000:1.0:1713481296.817855:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT1 00000100:00100000:0.0:1713481296.817856:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784531456 00010000:00010000:2.0:1713481296.817859:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817862:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88012ba3a500) 00010000:00010000:1.0:1713481296.817864:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.817865:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817866:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:1.0:1713481296.817870:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012050f3c0/0xdfc0fb148a3b64c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT1 00010000:00010000:2.0:1713481296.817871:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.817876:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bbd680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.817879:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.817883:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563358 00000100:00100000:0.0:1713481296.817888:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+233:3490:x1796714784531456:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.817890:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.817899:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10045 count 1 00010000:00010000:2.0:1713481296.817902:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817905:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca0480/0xdfc0fb148a3b63e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2047 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.817908:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.817908:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099bbd680/0xdfc0fb148a3b557 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.817918:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800771d2880/0xdfc0fb148802ed6 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962efc expref: 20749 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.817920:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2046 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.817924:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.817925:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.817925:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012ba3a300) 00010000:00010000:0.0:1713481296.817927:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.817927:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.817929:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012050d680, rc 0) 00010000:00010000:0.0:1713481296.817944:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800771d2880/0xdfc0fb148802ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962efc expref: 20749 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.817944:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:18943:x1796714882502656:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 350us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.817950:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485877 00010000:00010000:0.0:1713481296.817952:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800771d2880/0xdfc0fb148802ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962efc expref: 20749 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.817960:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784531584:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.817972:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.818030:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784529216:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.818041:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+234:3491:x1796714784528896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4752us (4784us total) trans 4296040897 rc 0/0 00000100:00100000:2.0:1713481296.818045:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563335 00010000:00010000:3.0:1713481296.818060:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124de7840/0xdfc0fb148a3b5a4 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49984 expref: 16909 pid: 16488 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.818069:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d96a00/2, rc 0, transno 1073601 00010000:00010000:3.0:1713481296.818071:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124de7840, rc 0) 00000100:00100000:2.0:1713481296.818075:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784528896:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.818092:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16909:18836:x1796714882501568:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4323us (4635us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.818099:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563337 00000100:00100000:0.0:1713481296.818154:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784529664:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.818175:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.818176:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.818185:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784531648:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.818194:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:1959:x1796714882499520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3572us (3665us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.818201:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820495 00000100:00100000:2.0:1713481296.818206:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.818231:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784531648 00000100:00100000:3.0:1713481296.818234:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784531648 00000100:00100000:3.0:1713481296.818250:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563359 00000100:00100000:3.0:1713481296.818254:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+234:3490:x1796714784531648:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.818264:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10046 count 1 00010000:00010000:3.0:1713481296.818275:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.818289:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe67600/0xdfc0fb148802edd lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f0a expref: 20749 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.818295:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.818296:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.818299:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.818316:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe67600/0xdfc0fb148802edd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f0a expref: 20749 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.818325:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe67600/0xdfc0fb148802edd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f0a expref: 20749 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.818328:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784529920:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.818333:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135b59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784529280:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.818336:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784531712:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.818349:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.818351:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.818366:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b09f540 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.818368:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20749:1959:x1796714882499840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4620us (4673us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.818374:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820486 00000100:00100000:2.0:1713481296.818375:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784530048:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.818386:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082304000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784529600:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.818393:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784529536:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.818394:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.818403:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.818409:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.818415:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16908:1959:x1796714882499648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3798us (3851us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.818420:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820494 00000100:00100000:2.0:1713481296.818423:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784529472:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.818441:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.818457:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784529984:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.818476:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784530112:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.818478:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.818484:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784531072:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.818501:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.818507:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.818522:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784531008:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.818539:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.818577:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24478:1959:x1796714882499904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3664us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.818584:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820497 00000100:00100000:2.0:1713481296.818600:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800967cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784530368:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.818621:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078340380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9218:1796714784530240:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.818626:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.818638:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.818654:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:1959:x1796714882500544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3495us (3841us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.818660:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820501 00000100:00100000:0.0:1713481296.818678:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133c53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784530176:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.818704:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148a3b5ce lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49992 expref: 20748 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.818713:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134683180, rc 0) 00000100:00100000:0.0:1713481296.818728:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20748:17924:x1796714882501760:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3623us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.818733:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563343 00000100:00100000:2.0:1713481296.818783:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784530816:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.818787:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784530944:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.818803:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.818804:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.818828:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784531136:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.818829:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784531200:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.818840:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.818843:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784531392:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.818853:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.818855:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.818859:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.818860:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.818868:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.818869:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503232 00000100:00100000:0.0:1713481296.818872:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503232 00000100:00100000:2.0:1713481296.818876:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503680 00000100:00100000:2.0:1713481296.818878:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503680 00000100:00100000:3.0:1713481296.818885:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784531264:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.818889:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503744 00000100:00100000:2.0:1713481296.818891:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563360 00000100:00100000:0.0:1713481296.818892:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503744 00000100:00100000:1.0:1713481296.818892:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.818895:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16909:8499:x1796714882503232:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.818900:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.818905:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503936 00000100:00100000:0.0:1713481296.818907:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563361 00010000:00010000:2.0:1713481296.818907:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013464f3c0/0xdfc0fb148a3b668 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499d1 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.818908:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503936 00010000:00010000:3.0:1713481296.818909:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.818911:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16909:18817:x1796714882503680:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.818917:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.818917:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991ded00/0xdfc0fb1488e7eae lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5525 expref: 16910 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.818919:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3feac0/0xdfc0fb1486892e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fd9 expref: 26837 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.818921:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.818922:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.818924:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013464f3c0/0xdfc0fb148a3b668 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d1 expref: 16910 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.818925:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133dac000/0xdfc0fb148a3b66f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499d8 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.818930:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563362 00000100:00100000:3.0:1713481296.818936:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20748:15045:x1796714882503744:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.818937:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991ded00/0xdfc0fb1488e7eae lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5525 expref: 16911 pid: 16467 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.818938:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820509 00010000:00010000:0.0:1713481296.818942:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb1489cfe3d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223a0 expref: 20748 pid: 16531 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.818942:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26837:1959:x1796714882503936:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.818944:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.818945:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991ded00/0xdfc0fb1488e7eae lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5525 expref: 16911 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.818946:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.818947:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.818948:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.818949:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3feac0/0xdfc0fb1486892e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fd9 expref: 26837 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.818951:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133dac000/0xdfc0fb148a3b66f lrc: 4/0,0 mode: --/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d8 expref: 16911 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.818954:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c207180/0xdfc0fb148a3b676 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499df expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.818955:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3feac0/0xdfc0fb1486892e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fd9 expref: 26837 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.818955:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800967cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784531776:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.818963:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb1489cfe3d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223a0 expref: 20748 pid: 16531 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.818968:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.818969:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3feac0/0xdfc0fb1486892e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fd9 expref: 26837 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.818970:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb1489cfe3d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223a0 expref: 20748 pid: 16531 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.818974:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978610c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.818977:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.818978:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784531840:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.818978:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.818978:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.818980:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.818980:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.818984:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.818984:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c207180/0xdfc0fb148a3b676 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499df expref: 20749 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.818994:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378780 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.818996:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.818996:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007c207180/0xdfc0fb148a3b676 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499df expref: 20749 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.819003:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.819004:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c207180, rc 0) 00010000:00010000:2.0:1713481296.819010:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.819013:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1959:x1796714882503936:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (121us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.819017:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.819019:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820509 00010000:00010000:2.0:1713481296.819024:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.819027:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20749:15045:x1796714882503744:12345-192.168.202.24@tcp:101:dd.0 Request processed in 90us (157us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.819030:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.819033:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563362 00010000:00010000:2.0:1713481296.819036:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099bbc000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.819038:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.819045:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.819056:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.819063:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099bbc000/0xdfc0fb148a3b630 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.819090:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.819115:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504000 00000100:00100000:3.0:1713481296.819136:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504000 00000100:00100000:3.0:1713481296.819161:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563363 00000100:00100000:3.0:1713481296.819165:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24477:10409:x1796714882504000:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.819175:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.819185:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c207cc0/0xdfc0fb148a3b67d lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499e6 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.819200:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206cfcc0/0xdfc0fb14891d16d lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca716 expref: 24478 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.819207:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2829:3492:x1796714784531328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2427us (2487us total) trans 4295960770 rc 0/0 00010000:00010000:3.0:1713481296.819209:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb14893ab36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4d5 expref: 26835 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.819212:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563356 00010000:00010000:3.0:1713481296.819216:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.819217:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.819221:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c207cc0/0xdfc0fb148a3b67d lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499e6 expref: 24478 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.819233:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801205af800/2, rc 0, transno 993474 00010000:00010000:3.0:1713481296.819237:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb14893ab36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4d5 expref: 26835 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.819239:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784531328:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.819246:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb14893ab36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4d5 expref: 26835 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.819257:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784531904:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.819298:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801206cfcc0/0xdfc0fb14891d16d lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca716 expref: 24478 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.819306:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801206cfcc0/0xdfc0fb14891d16d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca716 expref: 24478 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.819316:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784531968:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.819328:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.819338:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33d180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.819342:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504512 00000100:00100000:1.0:1713481296.819345:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504512 00000100:00100000:1.0:1713481296.819358:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485878 00000100:00100000:1.0:1713481296.819361:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18945:x1796714882504512:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1713481296.819367:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.819374:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc8480/0xdfc0fb148a3b684 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a02 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.819376:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532032:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.819394:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.819413:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.819421:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.819423:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784531520:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.819426:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.819431:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.819436:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.819440:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.819440:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504064 00010000:00010000:1.0:1713481296.819443:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.819444:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504064 00010000:00010000:0.0:1713481296.819445:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.819455:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20749:1959:x1796714882502592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1710us (1869us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.819456:0:15479:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.819457:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784532032 00000100:00100000:2.0:1713481296.819458:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784532032 00010000:00010000:1.0:1713481296.819459:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.819460:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820508 00010000:00010000:1.0:1713481296.819462:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.819466:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.819469:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563364 00010000:00010000:1.0:1713481296.819470:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dbc9440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.819473:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:2.0:1713481296.819473:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20748:18792:x1796714882504064:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.819478:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.819479:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563365 00010000:00010000:2.0:1713481296.819480:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.819481:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2829:3492:x1796714784532032:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.819484:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.819486:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.819489:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.819490:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013464f180/0xdfc0fb148a3b699 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc521:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499ed expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.819492:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43467 count 1 00010000:00010000:1.0:1713481296.819494:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc9440/0xdfc0fb148a3b68b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.819500:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.819502:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc521:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.819507:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013536ef40/0xdfc0fb14868944e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fe7 expref: 26835 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.819508:0:15479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.819511:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.819511:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.819512:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.819513:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.819513:0:15479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.819513:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.819517:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013464f180/0xdfc0fb148a3b699 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc521:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ed expref: 20749 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.819518:0:15479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.819523:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013536ef40/0xdfc0fb14868944e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fe7 expref: 26835 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.819523:0:15479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dbca640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.819525:0:15479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.819526:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013464f180/0xdfc0fb148a3b699 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc521:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ed expref: 20749 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.819528:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013536ef40/0xdfc0fb14868944e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fe7 expref: 26835 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.819530:0:15479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.819534:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880133c53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784532096:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.819534:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013464f180, rc 0) 00010000:00010000:1.0:1713481296.819540:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88008bd1d900) 00010000:00010000:1.0:1713481296.819543:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.819545:0:15479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.819550:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbca640/0xdfc0fb148a3b692 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00000100:00100000:0.0:1713481296.819551:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cdb09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.819553:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20749:18792:x1796714882504064:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 78us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.819559:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563364 00000100:00100000:0.0:1713481296.819568:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.819581:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc8480/0xdfc0fb148a3b684 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a02 expref: 2204 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.819584:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504192 00000100:00100000:2.0:1713481296.819587:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504192 00010000:00010000:1.0:1713481296.819589:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc8480/0xdfc0fb148a3b684 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a02 expref: 2204 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.819590:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784531584:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.819602:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbc8480, rc 0) 00000100:00100000:2.0:1713481296.819604:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485879 00010000:00010000:0.0:1713481296.819607:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.819608:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18578:x1796714882504192:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:1.0:1713481296.819621:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18945:x1796714882504512:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 258us (293us total) trans 0 rc 301/301 00000100:00100000:0.0:1713481296.819623:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.819626:0:15476:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:1.0:1713481296.819628:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485878 00000100:00100000:0.0:1713481296.819633:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.819638:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc0fcc0/0xdfc0fb148a37f64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x517f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47b00 expref: 2204 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.819651:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.819654:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x517f:0x0].0x0 (ffff88008bd8e400) 00000100:00100000:1.0:1713481296.819657:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504256 00000100:00100000:1.0:1713481296.819660:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504256 00000100:00100000:3.0:1713481296.819661:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504320 00000100:00100000:0.0:1713481296.819662:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.819678:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801237cc480/0xdfc0fb148a37799 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47852 expref: 2202 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.819682:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504320 00000100:00100000:0.0:1713481296.819685:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.819692:0:15479:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504448 00010000:00010000:2.0:1713481296.819694:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x236:0x0].0x0 (ffff880083b55700) 00000100:00100000:1.0:1713481296.819695:0:15479:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504448 00010000:00010000:2.0:1713481296.819708:0:15476:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.819709:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485880 00000100:00100000:3.0:1713481296.819715:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2387:18933:x1796714882504256:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:1.0:1713481296.819716:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485881 00000100:00100000:1.0:1713481296.819721:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2387:18765:x1796714882504320:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.819721:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x236:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819724:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.819728:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819733:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c204d80/0xdfc0fb148a3b6ae lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499f4 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.819735:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.819736:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.819744:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007dbcaac0/0xdfc0fb148a3b6b5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa499fb expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.819745:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,1 mode: --/PW res: [0x200000400:0x236:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.819750:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.819760:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.819767:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007dbcaac0/0xdfc0fb148a3b6b5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499fb expref: 2389 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.819776:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007dbcaac0/0xdfc0fb148a3b6b5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cb7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499fb expref: 2389 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.819787:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cb7:0x0].0x0 (ffff88009c077100) 00010000:00010000:1.0:1713481296.819789:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713481296.819791:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbcaac0, rc 0) 00010000:00010000:3.0:1713481296.819796:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.819803:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819806:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.819810:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2389:18765:x1796714882504320:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 89us (175us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.819811:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819812:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.819813:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485881 00010000:00010000:2.0:1713481296.819817:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819824:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.819829:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.819831:0:15479:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485882 00000100:00100000:1.0:1713481296.819834:0:15479:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2202:18943:x1796714882504448:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:3.0:1713481296.819834:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.819839:0:15479:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.819846:0:15479:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbcb180/0xdfc0fb148a3b6d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a09 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.819862:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.819870:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819876:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.819886:0:15479:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc8240/0xdfc0fb148a3b6e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15479 initiator: MDT0 00000004:00010000:3.0:1713481296.819890:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.819893:0:15479:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc8240/0xdfc0fb148a3b6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:1.0:1713481296.819899:0:15479:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc8240/0xdfc0fb148a3b6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15479 initiator: MDT0 00010000:00010000:3.0:1713481296.819899:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819903:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819908:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819913:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819918:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af21c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.819921:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819927:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819934:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000040:00080000:2.0:1713481296.819935:0:15476:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13927, 64 off899520 00010000:00010000:3.0:1713481296.819937:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.819939:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.819945:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3b6c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000004:00200000:1.0:1713481296.819946:0:15479:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x50b7:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.819949:0:15479:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713481296.819960:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.819965:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819966:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.819970:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819971:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.819974:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.819975:0:15479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbcb180/0xdfc0fb148a3b6d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a09 expref: 2205 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.819975:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af3cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.819977:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.819978:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.819981:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819982:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.819984:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.819987:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819988:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff8800908ddf00) 00010000:00010000:2.0:1713481296.819989:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708d440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.819990:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.819991:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.819992:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.819995:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.819996:0:15479:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dbc8240/0xdfc0fb148a3b6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a09 expref: 2204 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.819998:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b6d1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.819999:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x517f:0x0].0x0 (ffff88008bd8e400) 00010000:00010000:1.0:1713481296.820001:0:15479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012bb20f00) 00010000:00010000:2.0:1713481296.820001:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1713481296.820003:0:15479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713481296.820003:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 3/0,0 mode: --/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.820005:0:15479:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dbc8240, rc 0) 00010000:00010000:2.0:1713481296.820006:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b6ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x517f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.820021:0:15479:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18943:x1796714882504448:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 185us (369us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.820022:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.820024:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.820026:0:15479:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485882 00010000:00010000:2.0:1713481296.820027:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.820029:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708e400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.820032:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.820035:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.820038:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x517f:0x0].0x0 (ffff88008bd8e400) 00010000:00010000:2.0:1713481296.820039:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.820041:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.820042:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c204d80/0xdfc0fb148a3b6ae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2389 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820046:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009708e400/0xdfc0fb148a3b6ca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x517f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.820058:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2388 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.820064:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012ba3a300) 00010000:00010000:3.0:1713481296.820067:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.820069:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079af0000, rc 0) 00000100:00100000:0.0:1713481296.820072:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.820090:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:18933:x1796714882504256:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 375us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.820091:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502784 00000100:00100000:0.0:1713481296.820095:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502784 00000100:00100000:3.0:1713481296.820096:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485880 00000100:00100000:1.0:1713481296.820110:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.820114:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148802eac lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ea8 expref: 20749 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820143:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502912 00000100:00100000:1.0:1713481296.820146:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502912 00010000:00010000:2.0:1713481296.820155:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.820157:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134326d00/0xdfc0fb1486892aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f77 expref: 26836 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820161:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.820166:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000100:00100000:3.0:1713481296.820170:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784531712:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.820171:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713481296.820172:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820510 00010000:00010000:2.0:1713481296.820175:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708fcc0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.820176:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1958:x1796714882502912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.820177:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.820181:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.820183:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.820185:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134326d00/0xdfc0fb1486892aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f77 expref: 26836 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820189:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x236:0x0].0x0 (ffff8800982b2000) 00010000:00010000:3.0:1713481296.820190:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820191:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.820192:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134326d00/0xdfc0fb1486892aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f77 expref: 26836 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820193:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.820198:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b6a7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x236:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.820209:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134326d00/0xdfc0fb1486892aa lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f77 expref: 26836 pid: 16532 timeout: 815 lvb_type: 1 00000004:00010000:2.0:1713481296.820214:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007841df80 reply state ffff88007c1aa000 transno 4295105921 ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.820219:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.820220:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.820221:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.820224:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.820225:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820511 00010000:00010000:2.0:1713481296.820227:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x236:0x0].0x3031 (ffff880084acd500) 00000100:00100000:0.0:1713481296.820229:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20749:1958:x1796714882502784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.820229:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.820231:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.820231:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.820235:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.820238:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148802eac lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ea8 expref: 20749 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.820244:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148802eac lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ea8 expref: 20749 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.820247:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.820254:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18578:x1796714882504192:12345-192.168.202.24@tcp:36:rm.0 Request processed in 644us (683us total) trans 4295105921 rc 0/0 00010000:00010000:0.0:1713481296.820257:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148802eac lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ea8 expref: 20749 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820259:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1958:x1796714882502912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.820260:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485879 00000100:00100000:1.0:1713481296.820263:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820510 00010000:00010000:0.0:1713481296.820264:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.820265:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.820267:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.820272:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820283:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.820285:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.820287:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.820287:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504576 00000100:00100000:2.0:1713481296.820290:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504576 00010000:00010000:1.0:1713481296.820291:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.820295:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20748:1958:x1796714882502784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (226us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.820295:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.820299:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820511 00010000:00010000:1.0:1713481296.820299:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.820302:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504704 00000100:00100000:2.0:1713481296.820304:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504704 00010000:00010000:1.0:1713481296.820305:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097144000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.820307:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820311:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.820311:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563366 00000100:00100000:2.0:1713481296.820314:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:11552:x1796714882504576:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.820319:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820319:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.820321:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563367 00010000:00010000:1.0:1713481296.820323:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097144000/0xdfc0fb148a3b5ab lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820327:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800848e8900/0xdfc0fb148a3b6f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a10 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820337:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013222a640/0xdfc0fb14895a049 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec94 expref: 26836 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.820341:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.820342:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.820344:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848e8900/0xdfc0fb148a3b6f4 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a10 expref: 26836 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820354:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013222a640/0xdfc0fb14895a049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec94 expref: 26836 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.820362:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013222a640/0xdfc0fb14895a049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec94 expref: 26836 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.820367:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784532160:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.820369:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24479:10479:x1796714882504704:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.820376:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.820378:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.820383:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b6fb lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a17 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820389:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820393:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.820394:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801320bb840/0xdfc0fb148916dd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6599 expref: 24480 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.820397:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.820398:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.820399:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.820401:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b6fb lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a17 expref: 24480 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820401:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820404:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820407:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de7600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.820409:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.820411:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801320bb840/0xdfc0fb148916dd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6599 expref: 24480 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.820413:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.820416:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801320bb840/0xdfc0fb148916dd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6599 expref: 24480 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820420:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.820421:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784532224:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.820424:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124de7600/0xdfc0fb148a3b5b9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.820434:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.820437:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2830:3492:x1796714784529344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5929us (5972us total) trans 4295960771 rc 0/0 00000100:00100000:1.0:1713481296.820442:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563338 00000100:00100000:0.0:1713481296.820454:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.820467:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800798fa680/2, rc 0, transno 993475 00000100:00100000:0.0:1713481296.820477:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.820479:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784529344:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.820504:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.820507:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503040 00000100:00100000:0.0:1713481296.820509:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503040 00000100:00100000:1.0:1713481296.820509:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532288:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.820517:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2ead00/0xdfc0fb148802eb3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eb6 expref: 20748 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820521:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.820527:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820512 00000100:00100000:0.0:1713481296.820530:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20748:1958:x1796714882503040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.820535:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.820537:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2ead00/0xdfc0fb148802eb3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2738:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eb6 expref: 20748 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820540:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784532288 00010000:00010000:0.0:1713481296.820542:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2ead00/0xdfc0fb148802eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2738:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eb6 expref: 20748 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820543:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784532288 00000100:00100000:2.0:1713481296.820553:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+235:3490:x1796714784529728:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5639us (5757us total) trans 4296040898 rc 0/0 00010000:00010000:0.0:1713481296.820555:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2ead00/0xdfc0fb148802eb3 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2738:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eb6 expref: 20748 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820558:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563368 00000100:00100000:2.0:1713481296.820562:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563340 00000100:00100000:1.0:1713481296.820563:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2830:3492:x1796714784532288:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.820564:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.820565:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.820568:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.820576:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43469 count 1 00010000:00010000:1.0:1713481296.820586:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820597:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121e30240/0xdfc0fb1486892f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ff5 expref: 26836 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.820603:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713481296.820603:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d97100/2, rc 0, transno 1073602 00010000:00010000:1.0:1713481296.820605:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.820607:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.820622:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784529728:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.820623:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121e30240/0xdfc0fb1486892f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ff5 expref: 26836 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.820625:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820632:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121e30240/0xdfc0fb1486892f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ff5 expref: 26836 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.820639:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504768 00000100:00100000:1.0:1713481296.820642:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784532352:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.820642:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504768 00010000:00010000:0.0:1713481296.820647:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.820656:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f8bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.820656:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784532416:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.820662:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20747:1958:x1796714882503040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 129us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.820677:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485883 00000100:00100000:2.0:1713481296.820682:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2799:18910:x1796714882504768:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:0.0:1713481296.820683:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820512 00010000:00010000:2.0:1713481296.820690:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.820694:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.820696:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.820699:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b44240/0xdfc0fb148a3b709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a1e expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.820723:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784532416 00000100:00100000:0.0:1713481296.820724:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503168 00000100:00100000:0.0:1713481296.820727:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503168 00000100:00100000:1.0:1713481296.820727:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784532416 00010000:00010000:0.0:1713481296.820734:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121e31200/0xdfc0fb148a15fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39844 expref: 20747 pid: 16455 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820743:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563369 00000100:00100000:0.0:1713481296.820745:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820513 00010000:00010000:2.0:1713481296.820747:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.820748:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20747:1958:x1796714882503168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.820748:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801205adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+235:3490:x1796714784532416:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.820752:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.820753:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.820755:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121e31200/0xdfc0fb148a15fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39844 expref: 20747 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820757:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00002000:00080000:1.0:1713481296.820759:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10047 count 1 00010000:00010000:0.0:1713481296.820760:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121e31200/0xdfc0fb148a15fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39844 expref: 20747 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.820770:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713481296.820773:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.820775:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713481296.820781:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c674000/0xdfc0fb148802ee4 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f18 expref: 20747 pid: 15499 timeout: 0 lvb_type: 1 00000004:00010000:2.0:1713481296.820781:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.820788:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.820789:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.820791:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820795:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b44240/0xdfc0fb148a3b709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2801 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820807:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c674000/0xdfc0fb148802ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f18 expref: 20747 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.820810:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2800 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820814:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.820815:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c674000/0xdfc0fb148802ee4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f18 expref: 20747 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820816:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713481296.820817:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121e31200/0xdfc0fb148a15fe1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39844 expref: 20747 pid: 16455 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820817:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b45200, rc 0) 00000100:00100000:1.0:1713481296.820824:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784532480:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.820828:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2800:18910:x1796714882504768:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 147us (374us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.820829:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.820830:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.820832:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485883 00010000:00010000:0.0:1713481296.820834:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148a3b5ce lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49992 expref: 20746 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.820840:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be180 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.820845:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148a3b5ce lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49992 expref: 20746 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820852:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820856:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.820861:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.820861:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.820863:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134683180/0xdfc0fb148a3b5ce lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49992 expref: 20746 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820864:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.820870:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503296 00000100:00100000:1.0:1713481296.820872:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503296 00010000:00010000:2.0:1713481296.820872:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.820873:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784532544:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.820875:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800971446c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.820877:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820880:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097356d00/0xdfc0fb1486892cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2faf expref: 26837 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.820880:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.820888:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.820889:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124d31900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.820890:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820514 00010000:00010000:2.0:1713481296.820891:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971446c0/0xdfc0fb148a3b5c0 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.820893:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26837:1958:x1796714882503296:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.820897:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.820900:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097356d00/0xdfc0fb1486892cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2faf expref: 26837 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.820905:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097356d00/0xdfc0fb1486892cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2faf expref: 26837 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.820916:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097356d00/0xdfc0fb1486892cd lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2faf expref: 26837 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.820924:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.820925:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.820926:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.820926:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820930:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.820942:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.820946:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503488 00000100:00100000:0.0:1713481296.820949:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503488 00000100:00100000:1.0:1713481296.820950:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1958:x1796714882503296:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.820954:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820514 00010000:00010000:0.0:1713481296.820959:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c6758c0/0xdfc0fb148802ec8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eee expref: 20747 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.820968:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820515 00000100:00100000:1.0:1713481296.820971:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20747:1958:x1796714882503488:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.820975:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.820977:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c6758c0/0xdfc0fb148802ec8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eee expref: 20747 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.820986:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c6758c0/0xdfc0fb148802ec8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eee expref: 20747 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.820989:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.820996:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c6758c0/0xdfc0fb148802ec8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x273c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962eee expref: 20747 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.821002:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503616 00000100:00100000:0.0:1713481296.821004:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503616 00010000:00010000:1.0:1713481296.821006:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.821007:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.821008:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821011:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097354240/0xdfc0fb1486892db lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fcb expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.821012:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821020:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820516 00010000:00010000:1.0:1713481296.821020:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.821023:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1958:x1796714882503616:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.821027:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.821028:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20746:1958:x1796714882503488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (103us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.821029:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097354240/0xdfc0fb1486892db lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fcb expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.821030:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+236:3490:x1796714784529792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6067us (6204us total) trans 4296040899 rc 0/0 00000100:00100000:1.0:1713481296.821031:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820515 00000100:00100000:2.0:1713481296.821037:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563341 00000004:00080000:3.0:1713481296.821038:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d96d80/2, rc 0, transno 1073603 00010000:00010000:0.0:1713481296.821039:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097354240/0xdfc0fb1486892db lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fcb expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.821046:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784529792:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.821053:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097354240/0xdfc0fb1486892db lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fcb expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.821061:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.821062:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.821064:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821064:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821068:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.821070:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1713481296.821071:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821074:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.821077:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784532608:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.821078:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821079:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.821085:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821091:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821096:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986cd680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.821099:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821106:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1958:x1796714882503616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 80us (114us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.821106:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821107:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.821107:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.821112:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820516 00000100:00100000:1.0:1713481296.821115:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503872 00000100:00100000:1.0:1713481296.821117:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503872 00010000:00010000:2.0:1713481296.821139:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821142:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe65680/0xdfc0fb148802ec1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ed2 expref: 20746 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.821144:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b606 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821155:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820517 00000100:00100000:0.0:1713481296.821160:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20746:1958:x1796714882503872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.821167:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.821171:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe65680/0xdfc0fb148802ec1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ed2 expref: 20746 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.821178:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe65680/0xdfc0fb148802ec1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ed2 expref: 20746 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.821184:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.821192:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe65680/0xdfc0fb148802ec1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x273a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ed2 expref: 20746 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.821198:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784532608 00000100:00100000:1.0:1713481296.821201:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784532608 00010000:00010000:0.0:1713481296.821203:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.821205:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.821207:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821214:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821215:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504896 00000100:00100000:1.0:1713481296.821217:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504896 00000100:00100000:1.0:1713481296.821228:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563370 00000100:00100000:1.0:1713481296.821232:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+236:3490:x1796714784532608:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.821236:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1713481296.821240:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10048 count 1 00010000:00010000:3.0:1713481296.821241:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821247:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20746:1958:x1796714882503872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 87us (139us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.821249:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821251:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820517 00010000:00010000:3.0:1713481296.821253:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821255:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148802eeb lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f26 expref: 20746 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.821258:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801205aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2831:3490:x1796714784530688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5046us (5102us total) trans 4295960772 rc 0/0 00010000:00010000:1.0:1713481296.821259:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.821260:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.821260:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821262:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.821262:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563352 00010000:00010000:3.0:1713481296.821267:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821269:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821272:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148802eeb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f26 expref: 20745 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.821273:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821277:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148802eeb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f26 expref: 20745 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.821277:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821278:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821282:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821282:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784532672:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.821282:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563371 00010000:00010000:3.0:1713481296.821283:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c206ac0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.821285:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20745:14753:x1796714882504896:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.821286:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821289:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821290:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.821292:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081ca2880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.821293:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821294:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821294:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801353e6840 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.821296:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b461c0/0xdfc0fb148a3b725 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a2c expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821298:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821306:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908c0480/0xdfc0fb148a13f18 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38018 expref: 20746 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.821306:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821308:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 2/0,0 mode: --/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821310:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.821311:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081ca2880/0xdfc0fb148a3b5ff lrc: 0/0,0 mode: --/PW res: [0x280000408:0x273c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821311:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.821312:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b629 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x273a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821313:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b461c0/0xdfc0fb148a3b725 lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a2c expref: 20746 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821315:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.821322:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800908c0480/0xdfc0fb148a13f18 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38018 expref: 20746 pid: 16524 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.821326:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.821327:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800908c0480/0xdfc0fb148a13f18 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38018 expref: 20746 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.821333:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784532736:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.821337:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502848 00000100:00100000:1.0:1713481296.821339:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502848 00000100:00100000:2.0:1713481296.821343:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.821350:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563372 00000100:00100000:1.0:1713481296.821352:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1958:x1796714882502848:12345-192.168.202.24@tcp:2:touch.0 00000100:00100000:2.0:1713481296.821359:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504832 00000100:00100000:2.0:1713481296.821362:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504832 00000100:00100000:2.0:1713481296.821379:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485884 00000100:00100000:2.0:1713481296.821383:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2800:18918:x1796714882504832:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:2.0:1713481296.821390:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.821398:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff6af40/0xdfc0fb148a3b72c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a25 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821422:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+238:3493:x1796714784530560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5378us (5431us total) trans 4296040900 rc 0/0 00000100:00100000:1.0:1713481296.821425:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1958:x1796714882502848:12345-192.168.202.24@tcp:2:touch.0 Request processed in 71us (98us total) trans 4295960773 rc 0/0 00000100:00100000:0.0:1713481296.821426:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563351 00000100:00100000:1.0:1713481296.821430:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563372 00010000:00010000:0.0:1713481296.821445:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821447:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.821450:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.821450:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+237:3490:x1796714784530432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5413us (5488us total) trans 4296040901 rc 0/0 00010000:00010000:0.0:1713481296.821454:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821455:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.821457:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563349 00010000:00010000:0.0:1713481296.821458:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821461:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.821462:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821463:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.821465:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133daed00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.821467:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821470:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821471:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.821472:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502720 00000100:00100000:1.0:1713481296.821475:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502720 00010000:00010000:2.0:1713481296.821477:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.821478:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821481:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133daed00/0xdfc0fb148a3b614 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821483:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.821485:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ddd40/0xdfc0fb14891ed89 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb6e4 expref: 20747 pid: 16488 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.821498:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882502976 00000004:00080000:3.0:1713481296.821498:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007992f800/2, rc 0, transno 993476 00000100:00100000:1.0:1713481296.821500:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882502976 00010000:00010000:2.0:1713481296.821507:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124310000/0xdfc0fb148a3b741 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.821507:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007992f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784530688:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.821508:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973558c0/0xdfc0fb1486892b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f85 expref: 26836 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.821513:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124310000/0xdfc0fb148a3b741 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000004:00080000:3.0:1713481296.821516:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800967cc380/2, rc 0, transno 1073605 00010000:00010000:2.0:1713481296.821519:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124310000/0xdfc0fb148a3b741 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.821521:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800967cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784530432:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.821522:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820518 00000100:00100000:1.0:1713481296.821527:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20747:1958:x1796714882502720:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00010000:2.0:1713481296.821529:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880124310000/0xdfc0fb148a3b741 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.821533:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.821536:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.821537:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800919ddd40/0xdfc0fb14891ed89 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb6e4 expref: 20747 pid: 16488 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.821541:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.821545:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800919ddd40/0xdfc0fb14891ed89 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb6e4 expref: 20747 pid: 16488 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.821546:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.821554:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.821555:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532800:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.821559:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ff69d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.821561:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.821566:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.821568:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ddd40/0xdfc0fb14891ed89 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb6e4 expref: 20747 pid: 16488 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.821573:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.821576:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.821578:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.821580:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.821582:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.821583:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b733 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.821586:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124de7840/0xdfc0fb148a3b5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49984 expref: 16911 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.821590:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.821593:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de7840/0xdfc0fb148a3b5a4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49984 expref: 16911 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821596:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801205adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2831:3492:x1796714784530880:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5307us (5380us total) trans 4295960774 rc 0/0 00010000:00010000:2.0:1713481296.821597:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.821600:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563354 00010000:00010000:2.0:1713481296.821602:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00000004:00080000:3.0:1713481296.821606:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007992f100/2, rc 0, transno 993478 00010000:00010000:2.0:1713481296.821607:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.821609:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007992f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784530880:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.821611:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124313a80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.821613:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880124de7840/0xdfc0fb148a3b5a4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8062:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49984 expref: 16911 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821613:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.821614:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.821617:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784532800 00000100:00100000:3.0:1713481296.821617:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009232a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532864:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.821618:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.821619:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784532800 00000100:00100000:1.0:1713481296.821622:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784532928:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.821628:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3931 (ffff880084acd700) 00010000:00010000:2.0:1713481296.821630:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.821631:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563373 00010000:00010000:2.0:1713481296.821631:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.821631:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.821633:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2831:3492:x1796714784532800:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.821636:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b73a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.821639:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6a2840 going to sleep for 11 seconds 00002000:00080000:0.0:1713481296.821641:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43471 count 1 00010000:00010000:0.0:1713481296.821649:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821655:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098124480/0xdfc0fb148689463 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3003 expref: 26836 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.821659:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.821659:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820519 00010000:00010000:0.0:1713481296.821660:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.821662:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821677:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1958:x1796714882502976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.821684:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.821685:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009232b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784532992:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.821687:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ff6af40/0xdfc0fb148a3b72c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a25 expref: 2802 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821689:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973558c0/0xdfc0fb1486892b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f85 expref: 26836 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.821697:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973558c0/0xdfc0fb1486892b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f85 expref: 26836 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.821705:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124310000/0xdfc0fb148a3b741 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a25 expref: 2801 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.821705:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.821711:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880091b3c000) 00010000:00010000:2.0:1713481296.821714:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.821716:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124310000, rc 0) 00010000:00010000:1.0:1713481296.821719:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973558c0/0xdfc0fb1486892b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f85 expref: 26836 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.821729:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.821731:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098124480/0xdfc0fb148689463 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3003 expref: 26835 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.821731:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.821732:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2801:18918:x1796714882504832:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 347us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.821732:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784532864 00010000:00010000:1.0:1713481296.821734:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.821735:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784532864 00010000:00010000:0.0:1713481296.821737:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098124480/0xdfc0fb148689463 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3003 expref: 26835 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.821738:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485884 00010000:00010000:1.0:1713481296.821740:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821743:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784533056:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.821751:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784532992 00000100:00100000:0.0:1713481296.821754:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.821754:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784532992 00010000:00010000:1.0:1713481296.821759:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.821769:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563374 00000100:00100000:1.0:1713481296.821770:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1958:x1796714882502976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.821774:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009232b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+237:3492:x1796714784532864:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.821775:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820519 00000100:00100000:2.0:1713481296.821776:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563375 00000100:00100000:2.0:1713481296.821782:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2832:3490:x1796714784532992:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.821784:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800967cca80/2, rc 0, transno 1073604 00002000:00080000:3.0:1713481296.821787:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10049 count 1 00000100:00100000:0.0:1713481296.821790:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800967cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784530560:0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.821795:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43473 count 1 00010000:00010000:3.0:1713481296.821800:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821806:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.821810:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123674240/0xdfc0fb148802ef2 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f34 expref: 20746 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.821816:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941ea880/0xdfc0fb14868946a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3011 expref: 26834 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.821817:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.821818:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.821820:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.821821:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821826:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.821828:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.821831:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.821839:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123674240/0xdfc0fb148802ef2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f34 expref: 20746 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.821842:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.821847:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941ea880/0xdfc0fb14868946a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3011 expref: 26834 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.821851:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503104 00000100:00100000:1.0:1713481296.821852:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503104 00010000:00010000:3.0:1713481296.821854:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123674240/0xdfc0fb148802ef2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f34 expref: 20746 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.821856:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941ea880/0xdfc0fb14868946a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3011 expref: 26835 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.821860:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134325680/0xdfc0fb1486892b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f93 expref: 26835 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.821864:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092329f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784533120:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.821866:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784533184:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.821868:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503360 00000100:00100000:1.0:1713481296.821869:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503360 00010000:00010000:1.0:1713481296.821874:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097354fc0/0xdfc0fb1486892d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fbd expref: 26836 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.821883:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.821885:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820520 00000100:00100000:2.0:1713481296.821887:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.821888:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26836:1958:x1796714882503104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.821892:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.821894:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134325680/0xdfc0fb1486892b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f93 expref: 26836 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.821899:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134325680/0xdfc0fb1486892b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f93 expref: 26836 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.821900:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.821907:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821911:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134325680/0xdfc0fb1486892b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2f93 expref: 26836 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.821914:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821918:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.821919:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.821921:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.821921:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.821925:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.821928:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.821934:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de4000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.821935:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.821937:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821943:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26835:1958:x1796714882503104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (123us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.821943:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821946:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820520 00000100:00100000:0.0:1713481296.821952:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820521 00010000:00010000:3.0:1713481296.821956:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.821957:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26834:1958:x1796714882503360:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.821963:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821964:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.821964:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124de4000/0xdfc0fb148a3b5b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821968:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097354fc0/0xdfc0fb1486892d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fbd expref: 26834 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.821968:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.821971:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.821973:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821976:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821977:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097354fc0/0xdfc0fb1486892d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fbd expref: 26834 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.821978:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503424 00000100:00100000:1.0:1713481296.821980:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503424 00010000:00010000:2.0:1713481296.821980:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821984:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de4d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.821986:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800771d21c0/0xdfc0fb148802eba lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ec4 expref: 20747 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.821986:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.821990:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.821992:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097354fc0/0xdfc0fb1486892d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fbd expref: 26834 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.821994:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820522 00000100:00100000:1.0:1713481296.821996:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20747:1958:x1796714882503424:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.821997:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822000:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124de4d80/0xdfc0fb148a3b5c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822001:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.822002:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.822003:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822003:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800771d21c0/0xdfc0fb148802eba lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2739:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ec4 expref: 20747 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822006:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822007:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800771d21c0/0xdfc0fb148802eba lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2739:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ec4 expref: 20747 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822012:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822016:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800771d21c0/0xdfc0fb148802eba lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2739:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ec4 expref: 20747 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.822023:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822024:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822025:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822029:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822030:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.822038:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.822044:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26833:1958:x1796714882503360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.822046:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20746:1958:x1796714882503424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 48us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.822051:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820521 00000100:00100000:1.0:1713481296.822053:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820522 00010000:00010000:2.0:1713481296.822064:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822071:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822075:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822076:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.822078:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822082:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822084:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822085:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.822088:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822090:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503552 00010000:00010000:2.0:1713481296.822091:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822092:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503552 00010000:00010000:1.0:1713481296.822097:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2e8480/0xdfc0fb148802ecf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ee0 expref: 20746 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.822097:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084958d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.822099:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822099:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822103:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882503808 00000100:00100000:1.0:1713481296.822105:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882503808 00010000:00010000:2.0:1713481296.822105:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822106:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822110:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121e32d00/0xdfc0fb1486892c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fa1 expref: 26833 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822112:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081ca21c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.822115:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822117:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822135:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820523 00010000:00010000:0.0:1713481296.822138:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822138:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20746:1958:x1796714882503552:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.822142:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.822145:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2e8480/0xdfc0fb148802ecf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ee0 expref: 20746 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.822145:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b5f1 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822150:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2e8480/0xdfc0fb148802ecf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ee0 expref: 20746 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822152:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822158:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081ca21c0/0xdfc0fb148a3b60d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822159:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2e8480/0xdfc0fb148802ecf lrc: 0/0,0 mode: --/PR res: [0x280000408:0x273b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ee0 expref: 20746 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.822159:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2834:3492:x1796714784529408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7571us (7642us total) trans 4295960775 rc 0/0 00010000:00010000:1.0:1713481296.822165:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822166:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.822167:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563339 00010000:00010000:1.0:1713481296.822168:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822172:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822181:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.822190:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20745:1958:x1796714882503552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.822194:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820523 00000100:00100000:1.0:1713481296.822204:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820524 00000100:00100000:1.0:1713481296.822207:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26833:1958:x1796714882503808:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.822210:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.822213:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121e32d00/0xdfc0fb1486892c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fa1 expref: 26833 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.822218:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121e32d00/0xdfc0fb1486892c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fa1 expref: 26833 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.822230:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121e32d00/0xdfc0fb1486892c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fa1 expref: 26833 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.822238:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822239:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822241:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822248:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822256:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.822260:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2834:3491:x1796714784530752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6037us (6084us total) trans 4295960777 rc 0/0 00000100:00100000:1.0:1713481296.822263:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:1958:x1796714882503808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.822266:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820524 00000100:00100000:0.0:1713481296.822268:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563353 00010000:00010000:1.0:1713481296.822279:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822283:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822284:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+238:3493:x1796714784530304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6470us (6526us total) trans 4296040902 rc 0/0 00010000:00010000:1.0:1713481296.822287:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822291:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822291:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563348 00010000:00010000:1.0:1713481296.822294:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822297:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b088240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.822299:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.822303:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0baa00/2, rc 0, transno 1073606 00010000:00010000:1.0:1713481296.822306:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.822308:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784530304:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.822315:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822319:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b61b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.822335:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.822349:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504640 00000100:00100000:0.0:1713481296.822352:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504640 00000100:00100000:2.0:1713481296.822359:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2833:3493:x1796714784529856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7357us (7495us total) trans 4295960776 rc 0/0 00010000:00010000:0.0:1713481296.822362:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800771d2880/0xdfc0fb148802ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962efc expref: 20745 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.822363:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563342 00000100:00100000:0.0:1713481296.822378:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820525 00000100:00100000:0.0:1713481296.822382:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20745:1958:x1796714882504640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.822388:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.822390:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800771d2880/0xdfc0fb148802ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962efc expref: 20745 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822395:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800771d2880/0xdfc0fb148802ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962efc expref: 20745 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822407:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800771d2880/0xdfc0fb148802ed6 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x273d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962efc expref: 20745 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822414:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.822415:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.822417:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822421:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822422:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801205ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2833:3492:x1796714784530624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6123us (6161us total) trans 4295960778 rc 0/0 00000100:00100000:1.0:1713481296.822429:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563355 00010000:00010000:0.0:1713481296.822432:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.822441:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20744:1958:x1796714882504640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.822447:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820525 00010000:00010000:1.0:1713481296.822454:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822461:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822468:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.822469:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0bb480/2, rc 0, transno 993480 00000100:00100000:0.0:1713481296.822474:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784529856:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.822475:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822482:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822492:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986cc6c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.822495:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.822496:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.822501:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784533248:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.822501:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822512:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.822516:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.822519:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b5f8 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x273b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822533:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784533248 00000100:00100000:2.0:1713481296.822535:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784533248 00000004:00080000:3.0:1713481296.822536:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007992ed80/2, rc 0, transno 993481 00000100:00100000:3.0:1713481296.822545:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007992ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784530752:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.822547:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563376 00000100:00100000:0.0:1713481296.822549:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009232a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784533376:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.822550:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2833:3490:x1796714784533248:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.822558:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43475 count 1 00010000:00010000:2.0:1713481296.822565:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.822566:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.822573:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b93aac0/0xdfc0fb148689471 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d301f expref: 26831 pid: 16509 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.822576:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713481296.822577:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.822578:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.822579:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.822582:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784533440:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.822585:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713481296.822589:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b93aac0/0xdfc0fb148689471 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d301f expref: 26831 pid: 16509 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.822591:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784533312:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.822594:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b93aac0/0xdfc0fb148689471 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d301f expref: 26831 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.822600:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784533504:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.822603:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.822612:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822612:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.822619:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822626:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822628:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784533376 00000100:00100000:2.0:1713481296.822630:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784533376 00010000:00010000:0.0:1713481296.822633:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822639:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822639:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784533440 00000100:00100000:2.0:1713481296.822640:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784533440 00000004:00080000:3.0:1713481296.822640:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007992c700/2, rc 0, transno 993482 00010000:00010000:0.0:1713481296.822644:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133dac480 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.822646:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007992c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784530624:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.822647:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+239:3491:x1796714784530496:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6608us (6676us total) trans 4296040903 rc 0/0 00000100:00100000:2.0:1713481296.822647:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563377 00010000:00010000:0.0:1713481296.822648:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822649:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+239:3493:x1796714784533376:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.822652:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563350 00010000:00010000:0.0:1713481296.822654:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.822656:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10050 count 1 00000004:00080000:3.0:1713481296.822660:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800798fad80/2, rc 0, transno 993479 00010000:00010000:2.0:1713481296.822677:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.822681:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784529408:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.822683:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563378 00000100:00100000:1.0:1713481296.822687:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2834:3491:x1796714784533440:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.822687:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd18c0/0xdfc0fb148802ef9 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f42 expref: 20743 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.822691:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.822692:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.822694:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.822696:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43477 count 1 00010000:00010000:1.0:1713481296.822704:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822706:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbd18c0/0xdfc0fb148802ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f42 expref: 20743 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.822711:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bd70fc0/0xdfc0fb148689478 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d302d expref: 26831 pid: 16459 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.822711:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbd18c0/0xdfc0fb148802ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f42 expref: 20743 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.822713:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822715:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822716:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822717:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822717:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784533632:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.822719:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784533568:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.822721:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133dac480/0xdfc0fb148a3b65a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x273d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822727:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098ec1cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.822728:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bd70fc0/0xdfc0fb148689478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d302d expref: 26831 pid: 16459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.822734:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bd70fc0/0xdfc0fb148689478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d302d expref: 26831 pid: 16459 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.822738:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.822740:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784533760:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.822755:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784533568 00000100:00100000:1.0:1713481296.822758:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb9600 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.822758:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784533568 00000004:00080000:3.0:1713481296.822765:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800967cc000/2, rc 0, transno 1073607 00000100:00100000:3.0:1713481296.822772:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800967cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784530496:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.822774:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563379 00000100:00100000:2.0:1713481296.822778:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2835:3491:x1796714784533568:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.822788:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43479 count 1 00010000:00010000:2.0:1713481296.822798:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.822801:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784533696:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.822802:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.822805:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9d40/0xdfc0fb14868947f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d303b expref: 26831 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.822809:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.822810:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.822812:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822818:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.822823:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941e9d40/0xdfc0fb14868947f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d303b expref: 26831 pid: 16462 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.822826:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.822827:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505024 00010000:00010000:2.0:1713481296.822828:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941e9d40/0xdfc0fb14868947f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d303b expref: 26831 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.822830:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505024 00000100:00100000:2.0:1713481296.822834:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784533888:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.822835:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+239:3490:x1796714784531456:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4946us (5235us total) trans 4296040904 rc 0/0 00000100:00100000:0.0:1713481296.822840:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563358 00000100:00100000:1.0:1713481296.822845:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784533696 00000100:00100000:3.0:1713481296.822845:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.822846:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098ec1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.822847:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784533696 00000100:00100000:3.0:1713481296.822850:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784533824:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.822855:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563380 00000100:00100000:0.0:1713481296.822858:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16912:17935:x1796714882505024:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.822859:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563381 00010000:00010000:0.0:1713481296.822863:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.822864:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2836:3492:x1796714784533696:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.822867:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.822870:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b3df80/0xdfc0fb148a3b779 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a3a expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.822872:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43481 count 1 00002000:00010000:0.0:1713481296.822879:0:16509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.822879:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822885:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.822885:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784533824 00010000:00010000:0.0:1713481296.822886:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822886:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360898c0/0xdfc0fb148689486 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3049 expref: 26831 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.822888:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784533824 00010000:00010000:0.0:1713481296.822889:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b3df80/0xdfc0fb148a3b779 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a3a expref: 16913 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.822890:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822891:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.822892:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822895:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b3df80/0xdfc0fb148a3b779 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a3a expref: 16913 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.822900:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b3df80, rc 0) 00010000:00010000:1.0:1713481296.822903:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360898c0/0xdfc0fb148689486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3049 expref: 26831 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.822908:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360898c0/0xdfc0fb148689486 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3049 expref: 26831 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.822909:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16913:17935:x1796714882505024:12345-192.168.202.24@tcp:101:dd.0 Request processed in 51us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.822913:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563380 00000100:00100000:1.0:1713481296.822913:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120505180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784533952:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.822917:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563382 00000100:00100000:2.0:1713481296.822922:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+239:3492:x1796714784533824:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.822924:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c25a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.822931:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1713481296.822932:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10051 count 1 00000100:00100000:1.0:1713481296.822938:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784533312 00000100:00100000:1.0:1713481296.822940:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784533312 00010000:00010000:2.0:1713481296.822942:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.822951:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563383 00010000:00010000:2.0:1713481296.822951:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135442f40/0xdfc0fb148802f00 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f50 expref: 20743 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.822954:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+240:3493:x1796714784533312:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.822957:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.822958:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:0.0:1713481296.822959:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801205aea00/2, rc 0, transno 1073608 00010000:00010000:2.0:1713481296.822961:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.822964:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:5389 count 1 00000100:00100000:0.0:1713481296.822973:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784531456:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.822973:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822976:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135442f40/0xdfc0fb148802f00 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f50 expref: 20743 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.822983:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882504960 00010000:00010000:1.0:1713481296.822983:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ff9f3c0/0xdfc0fb14879d214 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f93b5bb expref: 20743 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.822984:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135442f40/0xdfc0fb148802f00 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f50 expref: 20743 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.822985:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882504960 00010000:00010000:1.0:1713481296.822989:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.822990:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.822993:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe67600/0xdfc0fb148802edd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f0a expref: 20744 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.822993:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.822993:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784534016:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.823004:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820526 00000100:00100000:3.0:1713481296.823005:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800881a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784534080:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.823007:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20744:1959:x1796714882504960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.823008:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800848d5900 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.823010:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007ff9f3c0/0xdfc0fb14879d214 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f93b5bb expref: 20744 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.823012:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.823015:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe67600/0xdfc0fb148802edd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f0a expref: 20744 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.823018:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007ff9f3c0/0xdfc0fb14879d214 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f93b5bb expref: 20744 pid: 16452 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.823020:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe67600/0xdfc0fb148802edd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f0a expref: 20744 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.823027:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009090c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784534144:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.823028:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.823030:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe67600/0xdfc0fb148802edd lrc: 0/0,0 mode: --/PR res: [0x280000408:0x273e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f0a expref: 20744 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.823039:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.823040:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.823042:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.823042:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013051d000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.823046:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.823047:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784534080 00000100:00100000:2.0:1713481296.823050:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784534080 00010000:00010000:0.0:1713481296.823058:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.823062:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.823066:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20743:1959:x1796714882504960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.823067:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563384 00000100:00100000:0.0:1713481296.823070:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820526 00000100:00100000:2.0:1713481296.823071:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007810f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+241:3490:x1796714784534080:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.823071:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.823075:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00080000:2.0:1713481296.823078:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10052 count 1 00010000:00010000:3.0:1713481296.823079:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.823084:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505088 00000100:00100000:1.0:1713481296.823086:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505088 00010000:00010000:2.0:1713481296.823086:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.823086:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823092:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350bbcc0/0xdfc0fb148802f07 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f5e expref: 20742 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.823093:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823096:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.823096:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.823098:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563385 00010000:00010000:2.0:1713481296.823098:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.823099:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c2073c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.823100:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16913:17009:x1796714882505088:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.823102:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.823105:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.823105:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.823109:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350bbcc0/0xdfc0fb148802f07 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f5e expref: 20742 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.823109:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.823112:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009794f840/0xdfc0fb148a3b79c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a33 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823113:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350bbcc0/0xdfc0fb148802f07 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f5e expref: 20742 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.823117:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:1.0:1713481296.823136:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.823141:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784534208:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.823142:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.823143:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.823144:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.823146:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009794f840/0xdfc0fb148a3b79c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a33 expref: 16914 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.823152:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009794f840/0xdfc0fb148a3b79c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a33 expref: 16914 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.823153:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ef00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.823157:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009794f840, rc 0) 00010000:00010000:3.0:1713481296.823160:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.823163:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505152 00000100:00100000:2.0:1713481296.823165:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505152 00000100:00100000:1.0:1713481296.823167:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16914:17009:x1796714882505088:12345-192.168.202.24@tcp:101:dd.0 Request processed in 65us (91us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.823167:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b661 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x273e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.823171:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563385 00000100:00100000:2.0:1713481296.823176:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505216 00000100:00100000:2.0:1713481296.823177:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505216 00000100:00100000:2.0:1713481296.823186:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563386 00000100:00100000:1.0:1713481296.823189:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563387 00000100:00100000:2.0:1713481296.823189:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16914:18844:x1796714882505152:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713481296.823191:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:11388:x1796714882505216:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.823193:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.823197:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.823200:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b7a3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a41 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.823204:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009794cd80/0xdfc0fb148a3b7aa lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a48 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.823208:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.823214:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.823215:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.823217:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af26ac0/0xdfc0fb148942420 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03d4 expref: 24480 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.823218:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b7a3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a41 expref: 16915 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.823223:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.823224:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.823224:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800978c5440/0xdfc0fb148a3b7a3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a41 expref: 16915 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.823227:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009794cd80/0xdfc0fb148a3b7aa lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a48 expref: 26833 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823228:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800978c5440, rc 0) 00000100:00100000:2.0:1713481296.823237:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16915:18844:x1796714882505152:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 48us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.823241:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563386 00010000:00010000:1.0:1713481296.823242:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009af26ac0/0xdfc0fb148942420 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03d4 expref: 24480 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.823251:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009af26ac0/0xdfc0fb148942420 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03d4 expref: 24480 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.823260:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009090e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784534272:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.823263:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505280 00000100:00100000:2.0:1713481296.823265:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505280 00000100:00100000:1.0:1713481296.823275:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.823275:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485885 00000100:00100000:2.0:1713481296.823278:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:18678:x1796714882505280:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1713481296.823288:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.823294:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800978c6640/0xdfc0fb148a3b7b1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a4f expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.823308:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+242:3490:x1796714784531648:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5052us (5100us total) trans 4296040905 rc 0/0 00000100:00100000:3.0:1713481296.823316:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563359 00000100:00100000:0.0:1713481296.823326:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784531840:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.823333:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.823339:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.823342:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133dac000/0xdfc0fb148a3b66f lrc: 3/0,0 mode: --/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d8 expref: 16914 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823343:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.823349:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133dac000, rc 0) 00010000:00010000:2.0:1713481296.823350:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000004:00080000:3.0:1713481296.823351:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801205ac000/2, rc 0, transno 1073609 00010000:00010000:2.0:1713481296.823354:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.823355:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.823357:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16914:18817:x1796714882503680:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4447us (4503us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.823357:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.823358:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784531648:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.823362:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563361 00000100:00100000:0.0:1713481296.823375:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505408 00000100:00100000:0.0:1713481296.823376:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505408 00010000:00010000:2.0:1713481296.823386:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e5440/0xdfc0fb148a3b7c6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.823391:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e5440/0xdfc0fb148a3b7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.823394:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563388 00010000:00010000:2.0:1713481296.823394:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e5440/0xdfc0fb148a3b7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.823397:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:15045:x1796714882505408:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.823402:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.823402:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713481296.823408:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b7cd lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a56 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713481296.823408:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c3c:0x0]: returning size 5 00000100:00100000:3.0:1713481296.823408:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007810fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784534336:0@lo:6:osp-syn-0-1.0 00000004:00200000:2.0:1713481296.823410:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713481296.823416:0:15475:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e5440/0xdfc0fb148a3b7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00002000:00010000:0.0:1713481296.823417:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.823421:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e5440/0xdfc0fb148a3b7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.823422:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.823423:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.823425:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.823426:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b7cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a56 expref: 24482 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823428:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.823431:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.823432:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b3c000/0xdfc0fb148a3b7cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a56 expref: 24482 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.823432:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.823434:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.823436:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b3c000, rc 0) 00010000:00010000:2.0:1713481296.823437:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007deb46c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.823438:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.823442:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.823446:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x0 (ffff880099cf8500) 00000100:00100000:0.0:1713481296.823447:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:15045:x1796714882505408:12345-192.168.202.24@tcp:101:dd.0 Request processed in 49us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.823447:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.823449:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.823450:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563388 00010000:00010000:2.0:1713481296.823451:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007deb46c0/0xdfc0fb148a3b7b8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.823455:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784534336 00000100:00100000:1.0:1713481296.823459:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784534336 00010000:00010000:2.0:1713481296.823462:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.823465:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.823468:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.823470:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800842e4900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.823472:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.823474:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563389 00010000:00010000:2.0:1713481296.823474:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.823477:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+242:3490:x1796714784534336:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.823477:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x3231 (ffff88007c133900) 00010000:00010000:2.0:1713481296.823478:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.823480:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.823482:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e4900/0xdfc0fb148a3b7bf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00002000:00080000:1.0:1713481296.823485:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10053 count 1 00010000:00010000:1.0:1713481296.823493:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.823499:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123676880/0xdfc0fb148802f0e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f6c expref: 20742 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.823503:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.823504:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.823506:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823506:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978c6640/0xdfc0fb148a3b7b1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a4f expref: 2048 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823513:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e5440/0xdfc0fb148a3b7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a4f expref: 2047 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.823517:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123676880/0xdfc0fb148802f0e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f6c expref: 20742 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.823517:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3c:0x0].0x0 (ffff88009c2a5500) 00010000:00010000:2.0:1713481296.823518:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713481296.823520:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800842e5440, rc 0) 00010000:00010000:1.0:1713481296.823522:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123676880/0xdfc0fb148802f0e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f6c expref: 20742 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.823528:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784534400:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.823531:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18678:x1796714882505280:12345-192.168.202.24@tcp:101:rm.0 Request processed in 253us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.823535:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485885 00000100:00100000:1.0:1713481296.823539:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c6d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.823561:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800967cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784531776:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.823578:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013464f3c0/0xdfc0fb148a3b668 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d1 expref: 16913 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.823584:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013464f3c0, rc 0) 00000100:00100000:2.0:1713481296.823592:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16913:8499:x1796714882503232:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4697us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.823596:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563360 00000100:00100000:1.0:1713481296.823898:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.823921:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.823941:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505344 00000100:00100000:0.0:1713481296.823945:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505344 00010000:00010000:0.0:1713481296.823958:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb1489cfe3d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223a0 expref: 20743 pid: 16531 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.823971:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505472 00000100:00100000:0.0:1713481296.823973:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505472 00010000:00010000:0.0:1713481296.823978:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991ded00/0xdfc0fb1488e7eae lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5525 expref: 16913 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.823988:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784531904:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.823992:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820527 00000100:00100000:0.0:1713481296.823995:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20743:1958:x1796714882505344:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.824000:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.824001:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.824003:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb1489cfe3d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223a0 expref: 20743 pid: 16531 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.824009:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb1489cfe3d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223a0 expref: 20743 pid: 16531 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.824016:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505536 00000100:00100000:2.0:1713481296.824019:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505536 00010000:00010000:0.0:1713481296.824025:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb1489cfe3d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223a0 expref: 20743 pid: 16531 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.824030:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb14893ab36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4d5 expref: 26834 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.824039:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.824040:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.824044:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133dac000/0xdfc0fb148a3b66f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d8 expref: 16913 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.824045:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820528 00000100:00100000:2.0:1713481296.824048:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16913:1958:x1796714882505472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.824053:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133dac000/0xdfc0fb148a3b66f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d8 expref: 16913 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.824053:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.824056:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820529 00010000:00010000:2.0:1713481296.824056:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991ded00/0xdfc0fb1488e7eae lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5525 expref: 16913 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.824062:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26834:1959:x1796714882505536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.824064:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991ded00/0xdfc0fb1488e7eae lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5525 expref: 16913 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.824070:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.824074:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb14893ab36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4d5 expref: 26834 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.824074:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991ded00/0xdfc0fb1488e7eae lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5525 expref: 16913 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.824082:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb14893ab36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4d5 expref: 26834 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.824082:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.824083:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.824086:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013464f3c0/0xdfc0fb148a3b668 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d1 expref: 16912 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.824090:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013464f3c0/0xdfc0fb148a3b668 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d1 expref: 16912 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.824094:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb14893ab36 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4d5 expref: 26834 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.824102:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013464f3c0/0xdfc0fb148a3b668 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d1 expref: 16912 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.824107:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784534464:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.824109:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.824141:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978610c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.824147:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26833:1959:x1796714882505536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.824153:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820529 00010000:00010000:0.0:1713481296.824166:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133dac000/0xdfc0fb148a3b66f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x876f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499d8 expref: 16912 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.824174:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784534528:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.824259:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b980c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.824333:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784531968:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.824373:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007c207cc0/0xdfc0fb148a3b67d lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499e6 expref: 24481 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.824378:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880133c53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784532096:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.824380:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c207cc0, rc 0) 00000100:00100000:2.0:1713481296.824397:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:10409:x1796714882504000:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5231us (5308us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.824401:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.824401:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563363 00000001:00080000:3.0:1713481296.824875:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040887 00002000:00080000:3.0:1713481296.824965:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57298 00000100:00100000:0.0:1713481296.824995:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.825017:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506112 00000100:00100000:2.0:1713481296.825021:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506112 00000100:00100000:2.0:1713481296.825041:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485886 00000100:00100000:2.0:1713481296.825045:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18945:x1796714882506112:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1713481296.825056:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.825065:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde98c0/0xdfc0fb148a3b7db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a72 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.825144:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825150:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825155:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825161:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825167:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825172:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825189:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825194:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825200:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825205:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825210:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fde9d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.825212:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825217:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825225:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.825227:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.825230:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825235:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde9d40/0xdfc0fb148a3b7e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825250:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825253:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825256:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825259:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fdeba80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.825260:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825266:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825270:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88008bd1d900) 00010000:00010000:2.0:1713481296.825271:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.825273:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825275:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3b7e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825302:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde98c0/0xdfc0fb148a3b7db lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a72 expref: 2205 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.825309:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fde98c0/0xdfc0fb148a3b7db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a72 expref: 2205 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.825320:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fde98c0, rc 0) 00000100:00100000:2.0:1713481296.825352:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18945:x1796714882506112:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 305us (357us total) trans 0 rc 301/301 00000100:00100000:2.0:1713481296.825358:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485886 00000100:00100000:2.0:1713481296.825445:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.825451:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784532160:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.825459:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505600 00000100:00100000:2.0:1713481296.825462:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505600 00010000:00010000:0.0:1713481296.825471:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800848e8900/0xdfc0fb148a3b6f4 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a10 expref: 26832 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.825478:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563390 00000100:00100000:2.0:1713481296.825482:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801205aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20743:18792:x1796714882505600:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.825489:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.825499:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fde8900/0xdfc0fb148a3b7f0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc522:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a5d expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.825510:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc522:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.825512:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848e8900, rc 0) 00010000:00010000:2.0:1713481296.825519:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.825520:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.825522:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fde8900/0xdfc0fb148a3b7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc522:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a5d expref: 20744 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.825532:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007fde8900/0xdfc0fb148a3b7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc522:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a5d expref: 20744 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.825536:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:11552:x1796714882504576:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5221us (5873us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.825539:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fde8900, rc 0) 00000100:00100000:0.0:1713481296.825541:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563366 00000100:00100000:2.0:1713481296.825558:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801205aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20744:18792:x1796714882505600:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 74us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.825561:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.825564:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563390 00000100:00100000:2.0:1713481296.825579:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505664 00000100:00100000:2.0:1713481296.825582:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505664 00000100:00100000:2.0:1713481296.825606:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563391 00000100:00100000:2.0:1713481296.825611:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:18765:x1796714882505664:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.825617:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.825625:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fdea400/0xdfc0fb148a3b7f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a64 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.825628:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784532224:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.825629:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.825636:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdd98c0/0xdfc0fb148a3819b lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ba8 expref: 26831 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.825640:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.825641:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.825642:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b6fb lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a17 expref: 24482 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.825643:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fdea400/0xdfc0fb148a3b7f7 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a64 expref: 24482 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.825649:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bae9680, rc 0) 00000100:00100000:1.0:1713481296.825652:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784532352:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.825658:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdd98c0/0xdfc0fb148a3819b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ba8 expref: 26831 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.825684:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:10479:x1796714882504704:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5358us (5998us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.825685:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cdd98c0/0xdfc0fb148a3819b lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ba8 expref: 26831 pid: 16523 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.825691:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563367 00010000:00010000:1.0:1713481296.825693:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.825694:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801205ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784534592:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.825713:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009af53480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.825718:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.825731:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505920 00000100:00100000:2.0:1713481296.825734:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505920 00000100:00100000:2.0:1713481296.825753:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485887 00000100:00100000:2.0:1713481296.825757:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2801:18933:x1796714882505920:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1713481296.825763:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.825765:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.825769:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3b7fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a6b expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.825774:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506240 00000100:00100000:0.0:1713481296.825777:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506240 00000100:00100000:1.0:1713481296.825778:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506560 00000100:00100000:1.0:1713481296.825780:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506560 00000100:00100000:0.0:1713481296.825794:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125696 00000100:00100000:1.0:1713481296.825796:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26111 00000100:00100000:0.0:1713481296.825798:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:18578:x1796714882506240:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:1.0:1713481296.825799:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:18943:x1796714882506560:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:2.0:1713481296.825812:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86ac0/0xdfc0fb148a3b805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825820:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86ac0/0xdfc0fb148a3b805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.825827:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86ac0/0xdfc0fb148a3b805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.825828:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.825837:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132099b00/0xdfc0fb148a3a321 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4939c expref: 2205 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.825860:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff880130505e00) 00010000:00010000:1.0:1713481296.825871:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1713481296.825875:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x50b7:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.825879:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1713481296.825883:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.825888:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.825892:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.825901:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3b7fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x50b7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a6b expref: 2803 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.825909:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.825913:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.825916:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86ac0/0xdfc0fb148a3b805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a6b expref: 2802 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.825917:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.825921:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012bb20f00) 00010000:00010000:2.0:1713481296.825924:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1713481296.825925:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534656:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.825926:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f86ac0, rc 0) 00000100:00100000:2.0:1713481296.825946:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2802:18933:x1796714882505920:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 187us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.825947:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.825951:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485887 00000100:00100000:1.0:1713481296.825959:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f8bf900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.825980:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784534656 00000100:00100000:1.0:1713481296.825983:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784534656 00000040:00080000:0.0:1713481296.825984:0:15535:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x9e:0x0].1841, 344 off1554024 00000100:00100000:1.0:1713481296.826007:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82926 00000100:00100000:1.0:1713481296.826010:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+33:15514:x1796714784534656:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.826017:0:15522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.826025:0:15522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a46c0/0xdfc0fb148a3b81a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b813 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826034:0:15522:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a46c0/0xdfc0fb148a3b81a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b813 expref: 34 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826040:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a46c0/0xdfc0fb148a3b81a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b813 expref: 34 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826044:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.826045:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.826047:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800880a46c0, rc 0) 00000100:00100000:1.0:1713481296.826064:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+34:15514:x1796714784534656:12345-0@lo:101:mdt_io00_009.0 Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.826067:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82926 00000040:00080000:0.0:1713481296.826072:0:15535:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xb7:0x0].644, 424 off640280 00000004:00080000:0.0:1713481296.826076:0:15535:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009d378c00 with version 16267 00000100:00100000:1.0:1713481296.826093:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534656:0@lo:101:mdt_io00_009.0 00000004:00080000:2.0:1713481296.826094:0:8638:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88007e4bd780 version 16267 rpc_version 16267 00010000:00010000:1.0:1713481296.826101:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826106:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1713481296.826112:0:8638:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:1.0:1713481296.826117:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:2.0:1713481296.826138:0:8638:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800967cc700 x1796714784534784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1713481296.826143:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.826147:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.826153:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.826153:0:8638:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800967cc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784534784:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713481296.826161:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534848:0@lo:101:mdt_io00_009.0 00000100:00100000:2.0:1713481296.826180:0:8638:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.826207:0:8638:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.826218:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784534784 00000100:00100000:1.0:1713481296.826221:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784534784 00000100:00100000:1.0:1713481296.826233:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82927 00000100:00100000:1.0:1713481296.826235:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+34:8638:x1796714784534784:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713481296.826323:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+35:8638:x1796714784534784:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (143us total) trans 4295107614 rc 0/0 00000100:00100000:1.0:1713481296.826327:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82927 00000100:00100000:1.0:1713481296.826342:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.826349:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f8bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.826351:0:8638:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800967cc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784534784:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713481296.826360:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784534848 00000100:00100000:0.0:1713481296.826365:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784534848 00000100:00100000:1.0:1713481296.826386:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82928 00000100:00100000:1.0:1713481296.826388:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+35:15514:x1796714784534848:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.826394:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.826401:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a6d00/0xdfc0fb148a3b828 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b821 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826409:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a6d00/0xdfc0fb148a3b828 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b821 expref: 36 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826415:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a6d00/0xdfc0fb148a3b828 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b821 expref: 36 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826418:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff8800842d0e00) 00010000:00010000:1.0:1713481296.826419:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.826421:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800880a6d00, rc 0) 00000100:00100000:0.0:1713481296.826426:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:18578:x1796714882506240:12345-192.168.202.24@tcp:35:rm.0 Request processed in 626us (706us total) trans 4295105922 rc 0/0 00000100:00100000:0.0:1713481296.826430:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125696 00000100:00100000:1.0:1713481296.826437:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784534848:12345-0@lo:101:mdt_io00_009.0 Request processed in 48us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.826440:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82928 00000100:00100000:1.0:1713481296.826460:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534848:0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.826467:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826472:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.826481:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:1.0:1713481296.826495:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534912:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713481296.826508:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.826515:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f8bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.826527:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784534912 00000100:00100000:0.0:1713481296.826531:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784534912 00000100:00100000:0.0:1713481296.826546:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82929 00000100:00100000:0.0:1713481296.826549:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784534912:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.826595:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.826612:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784534912:12345-0@lo:1000:mdt_io00_009.0 Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.826616:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82929 00000100:00100000:1.0:1713481296.826618:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534912:0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.826622:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.826633:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506304 00000100:00100000:0.0:1713481296.826635:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506304 00000100:00100000:2.0:1713481296.826636:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.826652:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505792 00000100:00100000:1.0:1713481296.826652:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534976:0@lo:1000:mdt_io00_009.0 00000100:00100000:0.0:1713481296.826653:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505792 00010000:00010000:0.0:1713481296.826659:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013536ef40/0xdfc0fb14868944e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fe7 expref: 26832 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.826660:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506048 00000100:00100000:1.0:1713481296.826679:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.826679:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506048 00000100:00100000:0.0:1713481296.826684:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98375 00000100:00100000:0.0:1713481296.826686:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:1958:x1796714882506304:12345-192.168.202.24@tcp:103:mrename.0 00000100:00100000:1.0:1713481296.826689:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.826692:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.826692:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801320bb840/0xdfc0fb148916dd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6599 expref: 24482 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.826702:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820530 00010000:00010000:0.0:1713481296.826703:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880078c42640/0xdfc0fb148a3a21e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4932c expref: 2047 pid: 15473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.826706:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081eced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:1959:x1796714882505792:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.826710:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.826714:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013536ef40/0xdfc0fb14868944e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fe7 expref: 26832 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.826716:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820531 00010000:00010000:1.0:1713481296.826720:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013536ef40/0xdfc0fb14868944e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fe7 expref: 26832 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.826720:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882506048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.826721:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff8801225f0000) 00010000:00010000:2.0:1713481296.826727:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.826732:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013536ef40/0xdfc0fb14868944e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2fe7 expref: 26832 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.826734:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.826737:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801320bb840/0xdfc0fb148916dd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6599 expref: 24482 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.826740:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.826741:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.826743:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.826746:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801320bb840/0xdfc0fb148916dd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6599 expref: 24482 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.826748:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.826756:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:1958:x1796714882506304:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 67us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.826762:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.826763:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98375 00010000:00010000:2.0:1713481296.826765:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801320bb840/0xdfc0fb148916dd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c6599 expref: 24482 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.826773:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081eced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26831:1959:x1796714882505792:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.826777:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820530 00010000:00010000:2.0:1713481296.826777:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.826779:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.826782:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b6fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a17 expref: 24481 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.826788:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784534976 00000100:00100000:0.0:1713481296.826790:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784534976 00010000:00010000:2.0:1713481296.826790:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b6fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a17 expref: 24481 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826793:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826797:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826802:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826805:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.826806:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82930 00010000:00010000:2.0:1713481296.826809:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bae9680/0xdfc0fb148a3b6fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a17 expref: 24481 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.826810:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784534976:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713481296.826812:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826816:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133daf180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.826818:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.826818:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086ec2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784535040:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.826821:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826828:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.826832:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133daf180/0xdfc0fb148a3b6a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.826840:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.826869:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784534976:12345-0@lo:1000:mdt_io00_009.0 Request processed in 57us (189us total) trans 0 rc 1/1 00000100:00100000:0.0:1713481296.826875:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82930 00000100:00100000:2.0:1713481296.826883:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.826900:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505728 00000100:00100000:2.0:1713481296.826904:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505728 00000100:00100000:0.0:1713481296.826913:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.826916:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801206cfcc0/0xdfc0fb14891d16d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca716 expref: 24482 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.826933:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.826940:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882505856 00000100:00100000:2.0:1713481296.826943:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882505856 00000100:00100000:0.0:1713481296.826947:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506432 00000100:00100000:0.0:1713481296.826950:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506432 00000100:00100000:1.0:1713481296.826951:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2837:3492:x1796714784532032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7468us (7538us total) trans 4295960779 rc 0/0 00010000:00010000:2.0:1713481296.826953:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013222a640/0xdfc0fb14895a049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec94 expref: 26831 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.826955:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563365 00010000:00010000:0.0:1713481296.826962:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121e30240/0xdfc0fb1486892f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ff5 expref: 26832 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.826968:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820532 00000004:00080000:3.0:1713481296.826969:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007841c380/2, rc 0, transno 993483 00000100:00100000:2.0:1713481296.826973:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882505728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.826979:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820533 00010000:00010000:2.0:1713481296.826979:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.826979:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532032:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.826984:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820534 00000100:00100000:1.0:1713481296.826984:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:1959:x1796714882505856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.826984:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801206cfcc0/0xdfc0fb14891d16d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca716 expref: 24482 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.826988:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.826989:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26832:1959:x1796714882506432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.826992:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801206cfcc0/0xdfc0fb14891d16d lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca716 expref: 24482 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.826996:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013222a640/0xdfc0fb14895a049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec94 expref: 26832 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.826997:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.827001:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121e30240/0xdfc0fb1486892f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ff5 expref: 26832 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.827006:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013222a640/0xdfc0fb14895a049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec94 expref: 26832 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.827007:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206cfcc0/0xdfc0fb14891d16d lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca716 expref: 24482 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.827015:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121e30240/0xdfc0fb1486892f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ff5 expref: 26832 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.827016:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784535104:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.827018:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013222a640/0xdfc0fb14895a049 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec94 expref: 26832 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.827019:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.827021:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.827024:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c207cc0/0xdfc0fb148a3b67d lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499e6 expref: 24481 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827025:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827026:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827028:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848e8900/0xdfc0fb148a3b6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a10 expref: 26831 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.827029:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121e30240/0xdfc0fb1486892f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d2ff5 expref: 26831 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.827032:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c207cc0/0xdfc0fb148a3b67d lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499e6 expref: 24481 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827033:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848e8900/0xdfc0fb148a3b6f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a10 expref: 26831 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.827041:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.827041:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.827043:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827044:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800848e8900/0xdfc0fb148a3b6f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a10 expref: 26830 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.827045:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.827049:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007c207cc0/0xdfc0fb148a3b67d lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499e6 expref: 24481 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827050:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e724000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784535168:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.827053:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.827058:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086ec1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784535232:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.827064:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800736ee9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.827072:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.827078:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc49180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.827080:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784535104 00000100:00100000:1.0:1713481296.827083:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784535104 00000100:00100000:0.0:1713481296.827089:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:1959:x1796714882506432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.827095:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820534 00000100:00100000:1.0:1713481296.827095:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563392 00000100:00100000:1.0:1713481296.827097:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2837:3492:x1796714784535104:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.827105:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43483 count 1 00010000:00010000:1.0:1713481296.827111:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827136:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bd70900/0xdfc0fb14868948d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3057 expref: 26829 pid: 16459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.827140:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827141:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827143:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.827144:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.827151:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827153:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bd70900/0xdfc0fb14868948d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3057 expref: 26829 pid: 16459 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.827158:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bd70900/0xdfc0fb14868948d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3057 expref: 26829 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.827159:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827163:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784535296:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.827166:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827176:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099fafcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.827178:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.827184:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.827190:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007dbcb840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.827193:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827194:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084300000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784534976:0@lo:1000:mdt_io00_009.0 00010000:00010000:0.0:1713481296.827199:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.827209:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092329f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784533120:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.827215:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.827222:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dbcb840/0xdfc0fb148a3b702 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827223:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e724e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784535360:0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.827228:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.827230:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827237:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.827247:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.827255:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784535360 00000100:00100000:1.0:1713481296.827257:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784535360 00000100:00100000:1.0:1713481296.827266:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82931 00000100:00100000:1.0:1713481296.827269:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784535360:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.827276:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784533184:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.827300:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827307:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784535360:12345-0@lo:1000:mdt_io00_009.0 Request processed in 37us (69us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.827311:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82931 00000100:00100000:1.0:1713481296.827336:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e724e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784535360:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713481296.827376:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.827380:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.827383:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713481296.827389:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e724e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784535424:0@lo:101:mdt_io00_009.0 00000100:00100000:1.0:1713481296.827400:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.827406:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fbf6480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.827420:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784532480:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.827438:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.827448:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784535424 00000100:00100000:1.0:1713481296.827450:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784535424 00000100:00100000:1.0:1713481296.827460:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82932 00000100:00100000:1.0:1713481296.827462:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+36:15514:x1796714784535424:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.827467:0:15522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.827473:0:15522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b836 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827481:0:15522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2045 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827489:0:15522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2387 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827493:0:15522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 5/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 37 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827502:0:15522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2387 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.827503:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784532736:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.827506:0:15522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2387 pid: 15576 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.827511:0:15522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e727480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:15522:1796714784535488:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.827527:0:15522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2045 pid: 15479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.827527:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b461c0/0xdfc0fb148a3b725 lrc: 3/0,0 mode: --/PW res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a2c expref: 20743 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827531:0:15522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2045 pid: 15479 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.827535:0:15522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e726a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:15522:1796714784535552:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.827537:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b461c0, rc 0) 00000100:00100000:1.0:1713481296.827541:0:15522:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be180 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.827555:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20743:14753:x1796714882504896:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6268us (6371us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.827556:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784532672:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.827560:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563371 00010000:00010000:1.0:1713481296.827570:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.827571:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2838:3492:x1796714784532288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7007us (7048us total) trans 4295960780 rc 0/0 00000100:00100000:0.0:1713481296.827575:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563368 00000004:00080000:3.0:1713481296.827581:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e55d500/2, rc 0, transno 993484 00000100:00100000:1.0:1713481296.827584:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506368 00000100:00100000:1.0:1713481296.827586:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506368 00000100:00100000:3.0:1713481296.827589:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532288:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.827593:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2046 pid: 15479 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.827596:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.827602:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784532544:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.827604:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820535 00000100:00100000:1.0:1713481296.827606:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:1958:x1796714882506368:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:1.0:1713481296.827610:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.827613:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2046 pid: 15479 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.827613:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506944 00000100:00100000:2.0:1713481296.827615:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506944 00010000:00010000:1.0:1713481296.827617:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2046 pid: 15479 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.827618:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.827619:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784535616:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.827624:0:9218:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012ba3a300) 00010000:00010000:1.0:1713481296.827627:0:9218:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 3/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 37 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.827630:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20742:1958:x1796714882503168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6881us (6936us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.827630:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.827631:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485888 00000100:00100000:2.0:1713481296.827634:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:18918:x1796714882506944:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:0.0:1713481296.827637:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820513 00000100:00100000:3.0:1713481296.827639:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.827641:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.827642:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:1958:x1796714882506368:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.827646:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820535 00010000:00010000:2.0:1713481296.827650:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3b844 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a79 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.827659:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506688 00000100:00100000:0.0:1713481296.827661:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506688 00000100:00100000:0.0:1713481296.827693:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125697 00000100:00100000:0.0:1713481296.827698:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:18979:x1796714882506688:12345-192.168.202.24@tcp:35:touch.0 00000100:00100000:1.0:1713481296.827702:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.827716:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.827721:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.827723:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.827729:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:1.0:1713481296.827736:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.827743:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508800 00000100:00100000:1.0:1713481296.827744:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506816 00000100:00100000:1.0:1713481296.827746:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506816 00000100:00100000:3.0:1713481296.827747:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508800 00010000:00010000:1.0:1713481296.827754:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941ea880/0xdfc0fb14868946a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3011 expref: 26830 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.827767:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820536 00000100:00100000:3.0:1713481296.827769:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507072 00000100:00100000:1.0:1713481296.827770:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:1960:x1796714882506816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.827771:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507072 00000004:00200000:2.0:1713481296.827772:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2aaf:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.827774:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:2.0:1713481296.827775:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1713481296.827776:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941ea880/0xdfc0fb14868946a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3011 expref: 26830 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.827782:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941ea880/0xdfc0fb14868946a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3011 expref: 26830 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.827788:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485889 00010000:00010000:1.0:1713481296.827793:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941ea880/0xdfc0fb14868946a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3011 expref: 26830 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.827793:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:18947:x1796714882508800:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1713481296.827800:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827800:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.827801:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3b844 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827802:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.827803:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18979:x1796714882506688:12345-192.168.202.24@tcp:35:touch.0 Request processed in 103us (574us total) trans 4295107615 rc 0/0 00010000:00010000:1.0:1713481296.827806:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.827808:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.827809:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125697 00010000:00010000:1.0:1713481296.827816:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.827818:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2390 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.827819:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3b852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ab8 expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.827824:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880084aad100) 00010000:00010000:2.0:1713481296.827826:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1713481296.827828:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:1960:x1796714882506816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (90us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.827828:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f86400, rc 0) 00000100:00100000:1.0:1713481296.827831:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820536 00000100:00100000:2.0:1713481296.827848:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2390:18918:x1796714882506944:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 212us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.827853:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.827858:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485888 00000100:00100000:1.0:1713481296.827861:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506752 00000100:00100000:1.0:1713481296.827863:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506752 00010000:00010000:1.0:1713481296.827869:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123674240/0xdfc0fb148802ef2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f34 expref: 20742 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.827878:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820537 00000100:00100000:1.0:1713481296.827881:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20742:1960:x1796714882506752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.827884:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485890 00010000:00010000:1.0:1713481296.827885:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.827887:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123674240/0xdfc0fb148802ef2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f34 expref: 20742 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.827888:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2389:18910:x1796714882507072:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:1.0:1713481296.827892:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123674240/0xdfc0fb148802ef2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f34 expref: 20742 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.827897:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:1.0:1713481296.827906:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123674240/0xdfc0fb148802ef2 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f34 expref: 20742 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.827907:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.827914:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:1.0:1713481296.827916:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827917:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.827918:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827923:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.827925:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086ec3800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784535680:0@lo:1000:mdt00_011.0 00010000:00010000:3.0:1713481296.827927:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:1.0:1713481296.827932:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.827933:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00000100:00100000:1.0:1713481296.827941:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20741:1960:x1796714882506752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (88us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.827943:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00000100:00100000:1.0:1713481296.827947:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820537 00000100:00100000:2.0:1713481296.827949:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.827952:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784535616 00000100:00100000:0.0:1713481296.827956:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784535616 00000100:00100000:2.0:1713481296.827961:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.827962:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827966:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827970:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.827971:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563393 00010000:00010000:1.0:1713481296.827974:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.827975:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800848e61c0/0xdfc0fb148a3b867 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00000100:00100000:0.0:1713481296.827976:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2838:3493:x1796714784535616:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.827978:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.827979:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784534208:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.827981:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af1200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.827982:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.827982:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800848e61c0/0xdfc0fb148a3b867 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00002000:00080000:0.0:1713481296.827986:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43485 count 1 00010000:00010000:1.0:1713481296.827986:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.827989:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800848e61c0/0xdfc0fb148a3b867 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:0.0:1713481296.827995:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.827995:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.827997:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT0 00010000:00010000:1.0:1713481296.827999:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079af1200/0xdfc0fb148a3b74f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828001:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828003:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:0.0:1713481296.828005:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941e8900/0xdfc0fb148689494 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3065 expref: 26828 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.828008:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:0.0:1713481296.828009:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.828010:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.828012:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828014:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.828019:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af3cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.828021:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:0.0:1713481296.828023:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941e8900/0xdfc0fb148689494 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3065 expref: 26828 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.828026:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:0.0:1713481296.828031:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941e8900/0xdfc0fb148689494 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3065 expref: 26828 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.828032:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828033:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.828036:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.828037:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096761880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784535744:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.828039:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828040:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.828045:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079af3cc0/0xdfc0fb148a3b859 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.828046:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.828049:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.828052:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828058:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.828059:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828064:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.828069:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124311f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.828069:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00000100:00100000:0.0:1713481296.828070:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.828072:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828073:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af21c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.828075:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.828079:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828080:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.828085:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff8800908ddf00) 00010000:00010000:3.0:1713481296.828087:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.828088:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.828089:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.828090:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828093:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3b860 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT0 00000100:00100000:0.0:1713481296.828096:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882506880 00010000:00010000:2.0:1713481296.828096:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3b756 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.828098:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882506880 00010000:00010000:0.0:1713481296.828106:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c674000/0xdfc0fb148802ee4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f18 expref: 20741 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.828114:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507136 00000100:00100000:0.0:1713481296.828116:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507136 00010000:00010000:0.0:1713481296.828135:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148802eeb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f26 expref: 20742 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.828145:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820538 00000100:00100000:0.0:1713481296.828148:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20742:1960:x1796714882506880:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.828148:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009232b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+244:3492:x1796714784532864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6371us (6514us total) trans 4296040907 rc 0/0 00010000:00010000:3.0:1713481296.828149:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3b852 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ab8 expref: 2207 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.828152:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.828155:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c674000/0xdfc0fb148802ee4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x273f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f18 expref: 20742 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.828155:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563374 00010000:00010000:0.0:1713481296.828160:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c674000/0xdfc0fb148802ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x273f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f18 expref: 20742 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.828164:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800848e61c0/0xdfc0fb148a3b867 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ab8 expref: 2206 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.828174:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00010000:00010000:0.0:1713481296.828175:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c674000/0xdfc0fb148802ee4 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x273f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f18 expref: 20742 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.828176:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.828178:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848e61c0, rc 0) 00000100:00100000:1.0:1713481296.828183:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820539 00010000:00010000:0.0:1713481296.828186:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.828187:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.828187:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20741:1960:x1796714882507136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.828189:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.828193:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828193:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.828195:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2206:18947:x1796714882508800:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 401us (493us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.828196:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148802eeb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f26 expref: 20741 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.828202:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148802eeb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f26 expref: 20741 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.828202:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485889 00010000:00010000:0.0:1713481296.828204:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.828215:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20741:1960:x1796714882506880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.828215:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148802eeb lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f26 expref: 20741 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.828219:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820538 00010000:00010000:1.0:1713481296.828227:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.828228:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.828231:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828235:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2839:3490:x1796714784532992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6452us (6528us total) trans 4295960781 rc 0/0 00010000:00010000:1.0:1713481296.828238:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828240:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563375 00000004:00080000:3.0:1713481296.828248:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009232a300/2, rc 0, transno 1073611 00010000:00010000:1.0:1713481296.828253:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.828257:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009232a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532864:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.828267:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20739:1960:x1796714882507136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.828273:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820539 00000004:00080000:2.0:1713481296.828278:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009232b800/2, rc 0, transno 993485 00000100:00100000:2.0:1713481296.828286:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009232b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784532992:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.828295:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828297:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784535808:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.828302:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.828304:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784535872:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.828309:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828314:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828317:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828317:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.828321:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800737af600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.828322:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.828325:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.828326:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828335:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828338:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3b717 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x273f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828344:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784535808 00000100:00100000:2.0:1713481296.828347:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784535808 00000100:00100000:2.0:1713481296.828360:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784535872 00000100:00100000:2.0:1713481296.828362:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784535872 00000100:00100000:2.0:1713481296.828375:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563394 00000100:00100000:2.0:1713481296.828379:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+244:3490:x1796714784535808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.828390:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10054 count 1 00010000:00010000:2.0:1713481296.828401:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828411:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd06c0/0xdfc0fb148802f15 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f7a expref: 20738 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.828417:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.828419:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.828421:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828437:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbd06c0/0xdfc0fb148802f15 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f7a expref: 20738 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.828445:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbd06c0/0xdfc0fb148802f15 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f7a expref: 20738 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.828454:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784535936:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.828465:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801205adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+245:3490:x1796714784532416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7716us (7771us total) trans 4296040908 rc 0/0 00000100:00100000:1.0:1713481296.828470:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563369 00000100:00100000:2.0:1713481296.828471:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.828486:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563395 00000100:00100000:2.0:1713481296.828490:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2839:3491:x1796714784535872:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.828497:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.828500:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43487 count 1 00010000:00010000:1.0:1713481296.828504:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828508:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828511:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828516:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120fb0b40/0xdfc0fb14868949b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3073 expref: 26828 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.828517:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828522:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.828523:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.828524:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828526:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828529:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800737ae1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.828532:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828538:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828540:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120fb0b40/0xdfc0fb14868949b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3073 expref: 26828 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.828548:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120fb0b40/0xdfc0fb14868949b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3073 expref: 26828 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.828551:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828556:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f84e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784536000:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.828558:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3b71e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.828561:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.828572:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.828573:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507200 00000100:00100000:0.0:1713481296.828575:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507200 00010000:00010000:0.0:1713481296.828583:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800908c0480/0xdfc0fb148a13f18 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38018 expref: 20739 pid: 16524 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.828592:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801205afb80/2, rc 0, transno 1073612 00000100:00100000:0.0:1713481296.828593:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820540 00000100:00100000:0.0:1713481296.828596:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20739:1960:x1796714882507200:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.828600:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.828607:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800908c0480/0xdfc0fb148a13f18 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc179:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38018 expref: 20739 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.828608:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784532416:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.828615:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800908c0480/0xdfc0fb148a13f18 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc179:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38018 expref: 20739 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.828625:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800908c0480/0xdfc0fb148a13f18 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc179:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38018 expref: 20739 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.828629:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784536064:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.828634:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.828635:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.828638:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b461c0/0xdfc0fb148a3b725 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a2c expref: 20738 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.828643:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b461c0/0xdfc0fb148a3b725 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a2c expref: 20738 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.828647:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.828653:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b461c0/0xdfc0fb148a3b725 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc179:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a2c expref: 20738 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.828659:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e1d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784536128:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.828687:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784536064 00000100:00100000:2.0:1713481296.828690:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784536064 00000100:00100000:0.0:1713481296.828692:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.828701:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+246:3490:x1796714784532608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7468us (7593us total) trans 4296040909 rc 0/0 00000100:00100000:1.0:1713481296.828708:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563370 00000100:00100000:2.0:1713481296.828712:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563396 00000100:00100000:2.0:1713481296.828715:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+246:3492:x1796714784536064:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.828726:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10055 count 1 00000100:00100000:0.0:1713481296.828730:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784533056:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.828737:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.828739:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784532928:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.828746:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008807f840/0xdfc0fb148802f1c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f88 expref: 20738 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.828756:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.828758:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.828760:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828763:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.828774:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008807f840/0xdfc0fb148802f1c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f88 expref: 20738 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.828777:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20738:1958:x1796714882502720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7249us (7460us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.828782:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008807f840/0xdfc0fb148802f1c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f88 expref: 20738 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.828783:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820518 00000100:00100000:2.0:1713481296.828790:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f84c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784536192:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.828793:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828803:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ce60600 going to sleep for 11 seconds 00000004:00080000:2.0:1713481296.828827:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d95180/2, rc 0, transno 1073613 00000100:00100000:0.0:1713481296.828829:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.828839:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.828841:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784532608:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.828847:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507328 00000100:00100000:1.0:1713481296.828850:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507328 00000100:00100000:2.0:1713481296.828860:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784533504:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.828862:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507392 00000100:00100000:1.0:1713481296.828863:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507392 00000100:00100000:3.0:1713481296.828866:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784536256:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.828878:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563397 00010000:00010000:2.0:1713481296.828880:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.828881:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:17935:x1796714882507328:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.828884:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.828888:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.828898:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800880a58c0/0xdfc0fb148a3b88a lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb799:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a80 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.828902:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784533632:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.828909:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784536256 00002000:00010000:1.0:1713481296.828910:0:16541:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb799:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.828911:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784536256 00000100:00100000:0.0:1713481296.828919:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563398 00010000:00010000:1.0:1713481296.828919:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.828921:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.828922:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16913:17009:x1796714882507392:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.828923:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828925:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800880a58c0/0xdfc0fb148a3b88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a80 expref: 26830 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.828928:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.828928:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563399 00000100:00100000:3.0:1713481296.828931:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+246:3493:x1796714784536256:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.828934:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b891 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a87 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.828940:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800880a58c0/0xdfc0fb148a3b88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a80 expref: 26830 pid: 16541 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.828940:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10056 count 1 00002000:00010000:0.0:1713481296.828943:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.828946:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784533888:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.828947:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800880a58c0, rc 0) 00010000:00010000:0.0:1713481296.828951:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.828952:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.828953:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.828956:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b891 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a87 expref: 16914 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.828962:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:17935:x1796714882507328:12345-192.168.202.24@tcp:101:dd.0 Request processed in 79us (132us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.828963:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148802f23 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f96 expref: 20737 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.828965:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b3f3c0/0xdfc0fb148a3b891 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a87 expref: 16914 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.828967:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.828969:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563397 00010000:00010000:0.0:1713481296.828973:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b3f3c0, rc 0) 00010000:00010000:3.0:1713481296.828975:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.828976:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.828979:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.828987:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16914:17009:x1796714882507392:12345-192.168.202.24@tcp:101:dd.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.828991:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784535680 00000100:00100000:0.0:1713481296.828992:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563398 00000100:00100000:1.0:1713481296.828993:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784535680 00010000:00010000:3.0:1713481296.828997:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148802f23 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f96 expref: 20737 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.829006:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148802f23 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f96 expref: 20737 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.829016:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82933 00000100:00100000:3.0:1713481296.829016:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784536320:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.829020:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800881a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15475:x1796714784535680:12345-0@lo:1000:mdt00_011.0 00000100:00100000:3.0:1713481296.829032:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.829036:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.829049:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507456 00000100:00100000:3.0:1713481296.829052:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507456 00000100:00100000:3.0:1713481296.829068:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563400 00000100:00100000:3.0:1713481296.829072:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:17924:x1796714882507456:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.829074:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800881a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15475:x1796714784535680:12345-0@lo:1000:mdt00_011.0 Request processed in 52us (1124us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.829078:0:16462:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.829080:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086ec3800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784535680:0@lo:1000:mdt00_011.0 00000100:00100000:1.0:1713481296.829081:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82933 00010000:00010000:3.0:1713481296.829086:0:16462:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800848e5440/0xdfc0fb148a3b89f lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a8e expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.829101:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a1626c lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3984b expref: 24483 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.829108:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.829109:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.829111:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848e5440/0xdfc0fb148a3b89f lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a8e expref: 24483 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.829115:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120505180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784533952:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.829140:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f84ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784536384:0@lo:1000:mdt00_011.0 00010000:00010000:3.0:1713481296.829142:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a1626c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3984b expref: 24483 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.829148:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a1626c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3984b expref: 24483 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.829153:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.829154:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784536448:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.829164:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.829168:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.829179:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784533760:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.829185:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098ec1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.829197:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784536384 00010000:00010000:1.0:1713481296.829199:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.829200:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784536384 00000100:00100000:2.0:1713481296.829214:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82934 00000100:00100000:2.0:1713481296.829217:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15475:x1796714784536384:12345-0@lo:1000:mdt00_011.0 00000100:00100000:2.0:1713481296.829260:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15475:x1796714784536384:12345-0@lo:1000:mdt00_011.0 Request processed in 42us (96us total) trans 0 rc -2/-2 00000100:00100000:2.0:1713481296.829266:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82934 00000100:00100000:2.0:1713481296.829292:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f84ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784536384:0@lo:1000:mdt00_011.0 00010000:00010000:2.0:1713481296.829326:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.829332:0:15475:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.829338:0:15475:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15475 initiator: MDT1 00000100:00100000:2.0:1713481296.829346:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f84ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784536512:0@lo:101:mdt00_011.0 00000100:00100000:2.0:1713481296.829361:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.829372:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.829374:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784536512 00000100:00100000:0.0:1713481296.829377:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784536512 00000100:00100000:0.0:1713481296.829394:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82935 00000100:00100000:0.0:1713481296.829397:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15475:x1796714784536512:12345-0@lo:101:mdt00_011.0 00010000:00010000:0.0:1713481296.829402:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.829409:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b8a6 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829422:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2801 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829427:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 4/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.829428:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784534016:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.829437:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2801 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829442:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2801 pid: 10467 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.829448:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e1d9880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784536576:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.829449:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.829471:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124d31900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.829508:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009090c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784534144:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.829529:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.829534:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.829570:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009090e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784534272:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.829592:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507584 00010000:00010000:1.0:1713481296.829592:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009794cd80/0xdfc0fb148a3b7aa lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a48 expref: 26829 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.829594:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15497:1796714784534464:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.829596:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507584 00010000:00010000:1.0:1713481296.829601:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009794cd80, rc 0) 00010000:00010000:2.0:1713481296.829612:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.829614:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563401 00000100:00100000:0.0:1713481296.829617:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20738:15045:x1796714882507584:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.829622:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.829623:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:11388:x1796714882505216:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6430us (6505us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.829627:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16913:1958:x1796714882505472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5578us (5705us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.829629:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563387 00010000:00010000:0.0:1713481296.829631:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b8b4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a95 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.829632:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820528 00002000:00010000:0.0:1713481296.829639:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.829646:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.829647:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.829649:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a95 expref: 20739 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829658:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124313a80/0xdfc0fb148a3b8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a95 expref: 20739 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.829660:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784534400:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.829678:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124313a80, rc 0) 00000100:00100000:0.0:1713481296.829692:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20739:15045:x1796714882507584:12345-192.168.202.24@tcp:101:dd.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.829695:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563401 00000100:00100000:2.0:1713481296.829699:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.829706:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.829709:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507712 00000100:00100000:2.0:1713481296.829711:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507712 00010000:00010000:2.0:1713481296.829719:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbd18c0/0xdfc0fb148802ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f42 expref: 20739 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.829722:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6920:1796714784534528:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.829729:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820541 00000100:00100000:2.0:1713481296.829732:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20739:1957:x1796714882507712:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.829736:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.829737:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.829739:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbd18c0/0xdfc0fb148802ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f42 expref: 20739 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.829744:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbd18c0/0xdfc0fb148802ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f42 expref: 20739 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.829746:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20739:1958:x1796714882505344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5750us (5849us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.829750:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820527 00010000:00010000:2.0:1713481296.829756:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd18c0/0xdfc0fb148802ef9 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f42 expref: 20739 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.829769:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.829770:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.829772:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.829773:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.829776:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.829786:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.829792:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.829797:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20737:1957:x1796714882507712:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.829801:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.829801:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820541 00000100:00100000:0.0:1713481296.829808:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.829810:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507968 00000100:00100000:2.0:1713481296.829812:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507520 00000100:00100000:2.0:1713481296.829813:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507520 00000100:00100000:1.0:1713481296.829814:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507968 00000100:00100000:0.0:1713481296.829816:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507840 00000100:00100000:0.0:1713481296.829818:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507840 00010000:00010000:2.0:1713481296.829819:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098124480/0xdfc0fb148689463 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3003 expref: 26829 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.829826:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9d40/0xdfc0fb14868947f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d303b expref: 26830 pid: 16462 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.829826:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135442f40/0xdfc0fb148802f00 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f50 expref: 20737 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.829827:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508096 00000100:00100000:2.0:1713481296.829828:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508096 00010000:00010000:2.0:1713481296.829833:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009af26ac0/0xdfc0fb148942420 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03d4 expref: 24484 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.829836:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820542 00000100:00100000:0.0:1713481296.829839:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:1957:x1796714882507520:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.829843:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.829843:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820543 00000100:00100000:2.0:1713481296.829846:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:1957:x1796714882507840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.829847:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098124480/0xdfc0fb148689463 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3003 expref: 26830 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.829849:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.829852:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098124480/0xdfc0fb148689463 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3003 expref: 26830 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.829852:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941e9d40/0xdfc0fb14868947f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d303b expref: 26830 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.829853:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820544 00000100:00100000:1.0:1713481296.829857:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20737:1957:x1796714882507968:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.829858:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941e9d40/0xdfc0fb14868947f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d303b expref: 26830 pid: 16462 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.829863:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098124480/0xdfc0fb148689463 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3003 expref: 26830 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.829865:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.829866:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9d40/0xdfc0fb14868947f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d303b expref: 26830 pid: 16462 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.829869:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135442f40/0xdfc0fb148802f00 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f50 expref: 20737 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.829870:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.829871:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.829872:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.829873:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.829873:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.829875:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829877:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.829879:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.829882:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135442f40/0xdfc0fb148802f00 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f50 expref: 20737 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.829887:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.829887:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.829894:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135442f40/0xdfc0fb148802f00 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f50 expref: 20737 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.829897:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1957:x1796714882507520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.829899:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1957:x1796714882507840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.829901:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820542 00000100:00100000:2.0:1713481296.829903:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820543 00010000:00010000:1.0:1713481296.829907:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.829908:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.829911:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820545 00010000:00010000:1.0:1713481296.829911:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.829914:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1957:x1796714882508096:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.829918:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.829918:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.829918:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829920:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af26ac0/0xdfc0fb148942420 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03d4 expref: 24484 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.829922:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.829926:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829929:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af26ac0/0xdfc0fb148942420 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03d4 expref: 24484 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.829933:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.829935:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.829937:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af26ac0/0xdfc0fb148942420 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03d4 expref: 24484 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.829937:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.829940:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de6f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.829942:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829946:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.829946:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829947:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.829948:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009794cd80/0xdfc0fb148a3b7aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a48 expref: 26826 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829953:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009794cd80/0xdfc0fb148a3b7aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a48 expref: 26826 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.829953:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20736:1957:x1796714882507968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 94us (177us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.829954:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.829957:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124de6f40/0xdfc0fb148a3b764 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.829959:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820544 00010000:00010000:0.0:1713481296.829962:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009794cd80/0xdfc0fb148a3b7aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a48 expref: 26826 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.829967:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b8d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:15550:1796714784536640:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.829979:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122b980c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.829989:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.829994:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830001:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830005:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830009:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830012:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135b3cd80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.830014:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830017:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830025:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830029:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b3cd80/0xdfc0fb148a3b748 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.830083:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+247:3493:x1796714784533376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7432us (7516us total) trans 4296040910 rc 0/0 00000100:00100000:2.0:1713481296.830088:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563377 00000004:00080000:3.0:1713481296.830102:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009232a680/2, rc 0, transno 1073614 00010000:00010000:2.0:1713481296.830105:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830109:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.830111:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009232a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784533376:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.830114:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830134:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830138:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830142:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de73c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.830144:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.830146:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2840:3492:x1796714784532800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8511us (8554us total) trans 4295960782 rc 0/0 00010000:00010000:2.0:1713481296.830147:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.830150:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563373 00010000:00010000:2.0:1713481296.830157:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830161:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124de73c0/0xdfc0fb148a3b787 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.830178:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092328380/2, rc 0, transno 993486 00000100:00100000:3.0:1713481296.830184:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784532800:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.830196:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.830202:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784536704:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.830225:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.830253:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+247:3492:x1796714784533824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7331us (7385us total) trans 4296040911 rc 0/0 00000100:00100000:2.0:1713481296.830257:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563382 00000100:00100000:2.0:1713481296.830268:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784536704 00000100:00100000:2.0:1713481296.830270:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784536704 00000004:00080000:3.0:1713481296.830277:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121d8a680/2, rc 0, transno 1073615 00000100:00100000:3.0:1713481296.830283:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784533824:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.830288:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563402 00000100:00100000:2.0:1713481296.830290:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+247:3491:x1796714784536704:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.830300:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10057 count 1 00000100:00100000:3.0:1713481296.830307:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784536768:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.830311:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830321:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123674480/0xdfc0fb148802f2a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fa4 expref: 20735 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.830326:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.830326:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.830328:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.830330:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830345:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784536768 00010000:00010000:2.0:1713481296.830345:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123674480/0xdfc0fb148802f2a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fa4 expref: 20735 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.830349:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784536768 00000100:00100000:3.0:1713481296.830353:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784536832:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.830354:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123674480/0xdfc0fb148802f2a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fa4 expref: 20735 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.830363:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784536896:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.830364:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563403 00000100:00100000:1.0:1713481296.830368:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2840:3491:x1796714784536768:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.830371:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.830379:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978610c0 going to sleep for 11 seconds 00002000:00080000:1.0:1713481296.830380:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43488 count 1 00010000:00010000:1.0:1713481296.830391:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.830403:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784536832 00010000:00010000:1.0:1713481296.830406:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c7d200/0xdfc0fb1486894a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3081 expref: 26826 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.830406:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784536832 00010000:00010000:1.0:1713481296.830413:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.830414:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.830416:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.830427:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563404 00000100:00100000:2.0:1713481296.830432:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+248:3492:x1796714784536832:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.830433:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c7d200/0xdfc0fb1486894a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3081 expref: 26826 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.830441:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c7d200/0xdfc0fb1486894a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3081 expref: 26826 pid: 16525 timeout: 815 lvb_type: 1 00002000:00080000:2.0:1713481296.830446:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10058 count 1 00000100:00100000:1.0:1713481296.830448:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784536960:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.830460:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830462:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084aabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.830469:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.830469:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd2400/0xdfc0fb148802f31 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fb2 expref: 20735 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.830474:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.830476:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.830477:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508224 00010000:00010000:2.0:1713481296.830478:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830480:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508224 00010000:00010000:2.0:1713481296.830492:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbd2400/0xdfc0fb148802f31 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fb2 expref: 20735 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.830500:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbd2400/0xdfc0fb148802f31 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fb2 expref: 20735 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.830507:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563405 00000100:00100000:0.0:1713481296.830509:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.830509:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784537024:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.830511:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16913:18836:x1796714882508224:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.830518:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.830524:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.830527:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xdfc0fb148a3b8d0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49a9c expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830535:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.830535:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509824 00010000:00010000:1.0:1713481296.830540:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124e8a640/0xdfc0fb14891eec4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb75b expref: 20735 pid: 16452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830540:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.830540:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509824 00010000:00010000:2.0:1713481296.830544:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.830550:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1713481296.830551:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.830551:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.830552:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.830555:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xdfc0fb148a3b8d0 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a9c expref: 16914 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830555:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830558:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124de5440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.830559:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830563:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.830564:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485891 00010000:00010000:1.0:1713481296.830569:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124e8a640/0xdfc0fb14891eec4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb75b expref: 20735 pid: 16452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.830569:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18947:x1796714882509824:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:0.0:1713481296.830571:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.830572:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.830575:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124e8a640/0xdfc0fb14891eec4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb75b expref: 20735 pid: 16452 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.830575:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124de5440/0xdfc0fb148a3b772 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830580:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009090e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784537088:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.830583:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508288 00010000:00010000:3.0:1713481296.830583:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.830586:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508288 00000100:00100000:1.0:1713481296.830595:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c6d6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.830595:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6640/0xdfc0fb148a3b8d7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49af7 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.830603:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563406 00000100:00100000:0.0:1713481296.830606:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16915:18844:x1796714882508288:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.830611:0:16491:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.830615:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507264 00010000:00010000:0.0:1713481296.830618:0:16491:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ff6af40/0xdfc0fb148a3b8de lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49aa3 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830618:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507264 00002000:00010000:0.0:1713481296.830626:0:16491:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.830629:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350bbcc0/0xdfc0fb148802f07 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f5e expref: 20736 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.830633:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.830634:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.830637:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ff6af40/0xdfc0fb148a3b8de lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49aa3 expref: 16916 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830642:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007ff6af40/0xdfc0fb148a3b8de lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49aa3 expref: 16916 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830647:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff6af40, rc 0) 00000100:00100000:1.0:1713481296.830647:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820546 00000100:00100000:1.0:1713481296.830651:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20736:1960:x1796714882507264:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.830657:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16916:18844:x1796714882508288:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 50us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.830658:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.830660:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563406 00010000:00010000:1.0:1713481296.830661:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350bbcc0/0xdfc0fb148802f07 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f5e expref: 20736 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.830684:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350bbcc0/0xdfc0fb148802f07 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f5e expref: 20736 pid: 9202 timeout: 815 lvb_type: 1 00000004:00200000:3.0:1713481296.830695:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3431:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.830703:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350bbcc0/0xdfc0fb148802f07 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f5e expref: 20736 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.830705:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2841:3491:x1796714784533568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7926us (7966us total) trans 4295960783 rc 0/0 00000100:00100000:2.0:1713481296.830709:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563379 00010000:00010000:1.0:1713481296.830713:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.830714:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.830716:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.830720:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.830733:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.830756:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6640/0xdfc0fb148a3b8d7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49af7 expref: 2049 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.830765:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6640/0xdfc0fb148a3b8d7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49af7 expref: 2049 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.830778:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c0d6640, rc 0) 00000100:00100000:0.0:1713481296.830809:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.830814:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120075880/2, rc 0, transno 993487 00000100:00100000:3.0:1713481296.830818:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2048:18947:x1796714882509824:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 249us (309us total) trans 4295107616 rc 301/301 00000100:00100000:2.0:1713481296.830820:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784533568:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.830823:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485891 00000100:00100000:1.0:1713481296.830828:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20735:1960:x1796714882507264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 175us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.830832:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.830832:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830835:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820546 00010000:00010000:2.0:1713481296.830836:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.830841:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.830841:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830844:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830848:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.830849:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.830850:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507776 00010000:00010000:2.0:1713481296.830851:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008bd9ba80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.830852:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507776 00010000:00010000:2.0:1713481296.830852:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.830856:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.830857:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.830859:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bd70fc0/0xdfc0fb148689478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d302d expref: 26827 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.830863:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.830864:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784537152:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.830865:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.830867:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bd9ba80/0xdfc0fb148a3b795 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830869:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508032 00000100:00100000:1.0:1713481296.830870:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508032 00010000:00010000:1.0:1713481296.830875:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007ff9f3c0/0xdfc0fb14879d214 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f93b5bb expref: 20735 pid: 16452 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.830879:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.830884:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507648 00000100:00100000:1.0:1713481296.830886:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507648 00000100:00100000:0.0:1713481296.830891:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508352 00000100:00100000:3.0:1713481296.830892:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.830893:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508352 00010000:00010000:1.0:1713481296.830894:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b93aac0/0xdfc0fb148689471 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d301f expref: 26828 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.830905:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508416 00000100:00100000:0.0:1713481296.830906:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508416 00000100:00100000:1.0:1713481296.830907:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882507904 00000100:00100000:1.0:1713481296.830910:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882507904 00000100:00100000:0.0:1713481296.830912:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784537152 00000100:00100000:0.0:1713481296.830913:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784537152 00010000:00010000:1.0:1713481296.830918:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360898c0/0xdfc0fb148689486 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3049 expref: 26830 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.830921:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563407 00000100:00100000:0.0:1713481296.830924:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:18817:x1796714882508352:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.830929:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.830932:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508160 00000100:00100000:1.0:1713481296.830934:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508160 00010000:00010000:0.0:1713481296.830935:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b8ec lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49aaa expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.830942:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123676880/0xdfc0fb148802f0e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f6c expref: 20737 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.830945:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ceffcc0/0xdfc0fb1489cff39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223e6 expref: 24483 pid: 16537 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.830949:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.830950:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.830952:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b8ec lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49aaa expref: 26831 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.830953:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820547 00000100:00100000:1.0:1713481296.830957:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800891b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26831:1960:x1796714882507776:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.830962:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ceffcc0/0xdfc0fb1489cff39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223e6 expref: 24483 pid: 16537 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.830962:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007810f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+249:3490:x1796714784534080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7890us (7934us total) trans 4296040912 rc 0/0 00010000:00010000:1.0:1713481296.830963:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.830966:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563384 00010000:00010000:0.0:1713481296.830967:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ceffcc0/0xdfc0fb1489cff39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223e6 expref: 24483 pid: 16537 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.830967:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bd70fc0/0xdfc0fb148689478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d302d expref: 26831 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.830974:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bd70fc0/0xdfc0fb148689478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d302d expref: 26831 pid: 16459 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.830976:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084ae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784537216:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.830981:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563408 00000100:00100000:2.0:1713481296.830984:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20737:18792:x1796714882508416:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.830987:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091872000 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.830989:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bd70fc0/0xdfc0fb148689478 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d302d expref: 26831 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.830989:0:16503:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.830996:0:16503:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086dd1d40/0xdfc0fb148a3b8f3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc523:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ab1 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.830999:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.830999:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.831001:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.831002:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563409 00002000:00010000:2.0:1713481296.831003:0:16503:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc523:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.831005:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2841:3493:x1796714784537152:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.831006:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831010:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831010:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1713481296.831012:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43491 count 1 00010000:00010000:2.0:1713481296.831013:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086dd1d40/0xdfc0fb148a3b8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc523:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ab1 expref: 20738 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831019:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831019:0:16503:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086dd1d40/0xdfc0fb148a3b8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc523:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ab1 expref: 20738 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831021:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.831024:0:16503:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086dd1d40, rc 0) 00010000:00010000:0.0:1713481296.831026:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fa5d40/0xdfc0fb1486894b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d308f expref: 26830 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.831029:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831030:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831031:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.831032:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20738:18792:x1796714882508416:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 48us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.831036:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563408 00000100:00100000:1.0:1713481296.831038:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800891b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26830:1960:x1796714882507776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 79us (204us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.831041:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fa5d40/0xdfc0fb1486894b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d308f expref: 26830 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.831044:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820547 00010000:00010000:0.0:1713481296.831047:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fa5d40/0xdfc0fb1486894b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d308f expref: 26830 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.831051:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084ae1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784537280:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.831055:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820548 00000100:00100000:2.0:1713481296.831058:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20737:1960:x1796714882508032:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.831060:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012431a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.831062:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820549 00010000:00010000:2.0:1713481296.831062:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.831065:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007ff9f3c0/0xdfc0fb14879d214 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f93b5bb expref: 20737 pid: 16452 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.831066:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26829:1960:x1796714882507648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.831073:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.831074:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007ff9f3c0/0xdfc0fb14879d214 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f93b5bb expref: 20737 pid: 16452 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.831077:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b93aac0/0xdfc0fb148689471 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d301f expref: 26829 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.831079:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.831085:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b93aac0/0xdfc0fb148689471 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d301f expref: 26829 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.831086:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ff9f3c0/0xdfc0fb14879d214 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f93b5bb expref: 20737 pid: 16452 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.831093:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831094:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831096:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831100:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b93aac0/0xdfc0fb148689471 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d301f expref: 26829 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.831100:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.831100:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508544 00000100:00100000:0.0:1713481296.831101:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.831103:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508544 00010000:00010000:1.0:1713481296.831108:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.831109:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831110:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.831111:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831115:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.831116:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508672 00000100:00100000:3.0:1713481296.831132:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508672 00000100:00100000:2.0:1713481296.831134:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20736:1960:x1796714882508032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.831135:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.831138:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820548 00000100:00100000:3.0:1713481296.831144:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485892 00000100:00100000:3.0:1713481296.831147:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2048:18678:x1796714882508544:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1713481296.831150:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.831151:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820550 00000100:00100000:2.0:1713481296.831154:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1960:x1796714882507904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.831158:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.831161:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360898c0/0xdfc0fb148689486 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3049 expref: 26828 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.831163:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26828:1960:x1796714882507648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (311us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.831165:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1713481296.831166:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360898c0/0xdfc0fb148689486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3049 expref: 26828 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.831170:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820549 00010000:00010000:2.0:1713481296.831176:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360898c0/0xdfc0fb148689486 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3049 expref: 26828 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.831176:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800842e5440/0xdfc0fb148a3b7c6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a4f expref: 2048 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831182:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831183:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831184:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831188:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.831189:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820551 00000100:00100000:1.0:1713481296.831193:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20735:1960:x1796714882508160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.831195:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091c4cd80/0xdfc0fb148a07c06 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3452b expref: 2047 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831197:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.831199:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.831204:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123676880/0xdfc0fb148802f0e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2745:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f6c expref: 20735 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.831204:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26826:1960:x1796714882507904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 50us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.831207:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820550 00010000:00010000:1.0:1713481296.831212:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123676880/0xdfc0fb148802f0e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2745:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f6c expref: 20735 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.831212:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3c:0x0].0x0 (ffff88009c2a5500) 00000100:00100000:0.0:1713481296.831214:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508864 00000100:00100000:0.0:1713481296.831216:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508864 00010000:00010000:3.0:1713481296.831226:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880120721440/0xdfc0fb148a3af37 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4977e expref: 2046 pid: 15479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.831228:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563410 00010000:00010000:1.0:1713481296.831229:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123676880/0xdfc0fb148802f0e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2745:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f6c expref: 20735 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.831231:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16916:8499:x1796714882508864:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.831231:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801205ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784534592:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.831235:0:16491:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.831241:0:16491:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b901 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e9d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49abf expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831241:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.831242:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.831244:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831245:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x0 (ffff880099cf8500) 00010000:00010000:2.0:1713481296.831246:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007fdea400/0xdfc0fb148a3b7f7 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a64 expref: 24483 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831247:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.831248:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831250:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007daba400/0xdfc0fb1488e7e68 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b552c expref: 16917 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.831252:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fdea400, rc 0) 00010000:00010000:0.0:1713481296.831255:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831255:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831257:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b901 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49abf expref: 16917 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831257:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.831259:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.831259:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:18765:x1796714882505664:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 5648us (5700us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.831262:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.831263:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563391 00010000:00010000:0.0:1713481296.831267:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007daba400/0xdfc0fb1488e7e68 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b552c expref: 16917 pid: 16487 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.831267:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.831271:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20734:1960:x1796714882508160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 77us (404us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.831272:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007daba400/0xdfc0fb1488e7e68 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b552c expref: 16917 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.831274:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5b00/0xdfc0fb148a3b90f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.831277:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081ec8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784537344:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.831277:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820551 00010000:00010000:3.0:1713481296.831278:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5b00/0xdfc0fb148a3b90f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.831279:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831281:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5b00/0xdfc0fb148a3b90f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.831286:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.831287:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012431acc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.831291:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831294:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831298:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831301:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ffa0240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.831302:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831303:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.831305:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.831306:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831311:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831312:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831315:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3b75d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831318:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831318:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.831319:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.831324:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831325:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.831329:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831329:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.831330:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.831333:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009794d8c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.831334:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831338:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831351:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831361:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009794d8c0/0xdfc0fb148a3b780 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.831368:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.831377:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.831385:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509184 00000100:00100000:0.0:1713481296.831387:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509184 00000100:00100000:0.0:1713481296.831397:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563411 00000100:00100000:0.0:1713481296.831399:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16918:11552:x1796714882509184:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.831403:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.831409:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132099b00/0xdfc0fb148a3b91d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ad4 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.831411:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2843:3490:x1796714784533248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8858us (8893us total) trans 4295960784 rc 0/0 00010000:00010000:0.0:1713481296.831418:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbd6d00/0xdfc0fb14895a15a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec9b expref: 16919 pid: 16461 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.831418:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563376 00010000:00010000:0.0:1713481296.831422:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831422:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831425:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132099b00/0xdfc0fb148a3b91d lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ad4 expref: 16919 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831433:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cbd6d00/0xdfc0fb14895a15a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec9b expref: 16919 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.831437:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cbd6d00/0xdfc0fb14895a15a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec9b expref: 16919 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.831442:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077a83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784537408:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.831449:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508992 00000100:00100000:2.0:1713481296.831452:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508992 00000040:00080000:3.0:1713481296.831452:0:15642:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x15:0x0].32250, 64 off2072192 00000100:00100000:0.0:1713481296.831453:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096dbd000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.831467:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509056 00000100:00100000:2.0:1713481296.831469:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509056 00000100:00100000:2.0:1713481296.831481:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485893 00010000:00010000:3.0:1713481296.831483:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.831485:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2206:18578:x1796714882508672:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.831487:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831492:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.831495:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2842:3492:x1796714784533696:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8629us (8667us total) trans 4295960785 rc 0/0 00010000:00010000:3.0:1713481296.831496:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831499:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.831502:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563381 00010000:00010000:2.0:1713481296.831502:0:10467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713481296.831502:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831505:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831508:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d6d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.831509:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.831512:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.831513:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.831514:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124280000/0xdfc0fb148a33321 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x517c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa44bf1 expref: 2206 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831517:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3c:0x0].0x0 (ffff88008330e200) 00010000:00010000:3.0:1713481296.831519:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713481296.831521:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 3/0,0 mode: --/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.831522:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509248 00000100:00100000:1.0:1713481296.831524:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509248 00010000:00010000:3.0:1713481296.831524:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6d00/0xdfc0fb148a3b924 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2c3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.831533:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.831533:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009606e400/0xdfc0fb148a30cbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x517c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4366c expref: 2205 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831538:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831541:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.831542:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x517c:0x0].0x0 (ffff88008fa3e700) 00000100:00100000:1.0:1713481296.831543:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509312 00010000:00010000:3.0:1713481296.831544:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.831545:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509312 00010000:00010000:3.0:1713481296.831546:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d7cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.831548:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831551:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.831552:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563412 00010000:00010000:2.0:1713481296.831552:0:10467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.831555:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3c:0x0].0x0 (ffff88008330e200) 00010000:00010000:3.0:1713481296.831556:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1713481296.831557:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563413 00010000:00010000:3.0:1713481296.831557:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.831558:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:10409:x1796714882509248:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.831560:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d7cc0/0xdfc0fb148a3b916 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.831561:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20734:10479:x1796714882509312:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.831564:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.831565:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.831568:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.831571:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.831573:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb148a3b932 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49adb expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831577:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.831578:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099fef180/0xdfc0fb148a3b939 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ae2 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831585:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x37c4:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.831587:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932898c0/0xdfc0fb14891d44c lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca71d expref: 24484 pid: 16464 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.831590:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.831592:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e64fc0/0xdfc0fb148916dbb lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a0 expref: 20735 pid: 15547 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.831595:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120508d80/0xdfc0fb14893ab3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ea expref: 26825 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.831596:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.831598:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831599:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831600:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.831600:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.831602:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb148a3b932 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49adb expref: 24484 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.831603:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099fef180/0xdfc0fb148a3b939 lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae2 expref: 20735 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831612:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120508d80/0xdfc0fb14893ab3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ea expref: 26825 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.831617:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120508d80/0xdfc0fb14893ab3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ea expref: 26825 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.831618:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e64fc0/0xdfc0fb148916dbb lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a0 expref: 20735 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.831623:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078614a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784537472:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.831626:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.831630:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e64fc0/0xdfc0fb148916dbb lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a0 expref: 20735 pid: 15547 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.831630:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.831633:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.831637:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932898c0/0xdfc0fb14891d44c lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca71d expref: 24484 pid: 16464 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.831640:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009090c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784537536:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.831641:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 3/0,1 mode: --/EX res: [0x200000400:0x236:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.831642:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932898c0/0xdfc0fb14891d44c lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca71d expref: 24484 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.831644:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.831646:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784537600:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.831648:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.831652:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089015cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.831652:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831656:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.831657:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.831658:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.831660:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.831661:0:10467:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.831679:0:10467:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.831686:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784537664:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1713481296.831688:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.831690:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485894 00000100:00100000:1.0:1713481296.831693:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2802:18933:x1796714882508992:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1713481296.831699:0:15483:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.831702:0:15473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509376 00000100:00100000:2.0:1713481296.831702:0:10467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.831704:0:15473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509376 00010000:00010000:1.0:1713481296.831708:0:15483:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099fec000/0xdfc0fb148a3b95c lrc: 2/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ac6 expref: -99 pid: 15483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.831712:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861000 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.831717:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485895 00000100:00100000:0.0:1713481296.831720:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2390:18937:x1796714882509056:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.831725:0:15473:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.831727:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086ec2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784535040:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.831732:0:15473:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b963 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49acd expref: -99 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831747:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.831760:0:15483:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.831760:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1959:x1796714882506048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5039us (5123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.831766:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820531 00010000:00010000:1.0:1713481296.831768:0:15483:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:1.0:1713481296.831774:0:15483:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15483 initiator: MDT0 00000100:00100000:2.0:1713481296.831782:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882508928 00010000:00010000:0.0:1713481296.831784:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00000100:00100000:2.0:1713481296.831784:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882508928 00010000:00010000:0.0:1713481296.831792:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.831792:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdd98c0/0xdfc0fb148a3819b lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ba8 expref: 26826 pid: 16523 timeout: 815 lvb_type: 0 00000004:00200000:1.0:1713481296.831795:0:15483:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x230:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.831798:0:15483:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713481296.831799:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713481296.831801:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509120 00000100:00100000:2.0:1713481296.831802:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509120 00010000:00010000:2.0:1713481296.831807:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bd70900/0xdfc0fb14868948d lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3057 expref: 26827 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.831809:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:3.0:1713481296.831813:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.831815:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713481296.831815:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820552 00010000:00010000:3.0:1713481296.831817:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d5200 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.831818:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26827:1960:x1796714882508928:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.831818:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.831820:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.831822:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.831822:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.831823:0:15483:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099fec000/0xdfc0fb148a3b95c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2805 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831824:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cdd98c0/0xdfc0fb148a3819b lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ba8 expref: 26827 pid: 16523 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.831827:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x0 (ffff880099cf8500) 00010000:00010000:3.0:1713481296.831828:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.831829:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cdd98c0/0xdfc0fb148a3819b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ba8 expref: 26827 pid: 16523 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.831829:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831833:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5200/0xdfc0fb148a3b908 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2c3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.831838:0:15483:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2804 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831839:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cdd98c0/0xdfc0fb148a3819b lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47ba8 expref: 26827 pid: 16523 timeout: 815 lvb_type: 0 00000004:00010000:3.0:1713481296.831841:0:15642:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880084ae0700 reply state ffff880134f9f000 transno 4295107617 ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5b00/0xdfc0fb148a3b90f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.831846:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d5b00/0xdfc0fb148a3b90f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c3b:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.831848:0:15483:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88012ba3a500) 00010000:00010000:3.0:1713481296.831850:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x3231 (ffff88008330e000) 00010000:00010000:1.0:1713481296.831851:0:15483:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.831851:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.831852:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.831853:0:15483:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012064eac0, rc 0) 00010000:00010000:2.0:1713481296.831853:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.831853:0:15642:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713481296.831854:0:15473:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b97f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 00010000:00010000:2.0:1713481296.831855:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fdea400/0xdfc0fb148a3b7f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a64 expref: 24483 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831860:0:15473:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b97f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.831860:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fdea400/0xdfc0fb148a3b7f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a64 expref: 24483 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831865:0:15473:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b97f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:1.0:1713481296.831868:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2804:18933:x1796714882508992:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 173us (547us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.831870:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007fdea400/0xdfc0fb148a3b7f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xba50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a64 expref: 24483 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.831872:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18678:x1796714882508544:12345-192.168.202.24@tcp:36:rm.0 Request processed in 724us (792us total) trans 4295107617 rc 0/0 00000100:00100000:1.0:1713481296.831874:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485894 00000100:00100000:2.0:1713481296.831875:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086ec2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784537728:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.831878:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485892 00000004:00200000:0.0:1713481296.831882:0:15473:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c7b:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.831884:0:15473:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713481296.831887:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6480 going to sleep for 11 seconds 00000004:00010000:0.0:1713481296.831891:0:15473:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b97f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713481296.831893:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485896 00010000:00010000:0.0:1713481296.831896:0:15473:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT1 00000100:00100000:3.0:1713481296.831896:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2803:18918:x1796714882509376:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.831900:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.831902:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.831903:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.831906:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00000100:00100000:2.0:1713481296.831906:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820553 00010000:00010000:0.0:1713481296.831909:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c2073c0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.831909:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26826:1960:x1796714882509120:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.831910:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:3.0:1713481296.831910:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131467cc0/0xdfc0fb148a3b986 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ae9 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831913:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.831914:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.831916:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bd70900/0xdfc0fb14868948d lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3057 expref: 26826 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.831919:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.831919:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831921:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.831921:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bd70900/0xdfc0fb14868948d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3057 expref: 26826 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.831922:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:0.0:1713481296.831925:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c2073c0/0xdfc0fb148a3b971 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713481296.831927:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.831929:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831930:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.831932:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831933:0:15473:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713481296.831934:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831936:0:15473:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.831936:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831939:0:15473:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713481296.831941:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.831942:0:15473:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096b44240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.831943:0:15473:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT1 00010000:00010000:2.0:1713481296.831943:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.831946:0:15473:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713481296.831946:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.831949:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26826:1960:x1796714882509120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 40us (580us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.831950:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88008bd14600) 00010000:00010000:1.0:1713481296.831950:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d315440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.831951:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.831952:0:15473:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713481296.831952:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.831952:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820553 00010000:00010000:0.0:1713481296.831954:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096b44240/0xdfc0fb148a3b978 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT1 00010000:00010000:1.0:1713481296.831956:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831959:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.831965:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.831969:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831969:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.831973:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d315440/0xdfc0fb148a3b7d4 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.831975:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800881a7100/2, rc 0, transno 1073616 00010000:00010000:0.0:1713481296.831976:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009b088240/0xdfc0fb148a3b963 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49acd expref: 2392 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831976:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.831980:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800881a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784534080:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.831980:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.831983:0:15473:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b97f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49acd expref: 2391 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.831984:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.831987:0:15473:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88011d9f2c00) 00010000:00010000:0.0:1713481296.831989:0:15473:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00080000:2.0:1713481296.831989:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096761180/2, rc 0, transno 993488 00010000:00010000:0.0:1713481296.831990:0:15473:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009708fcc0, rc 0) 00000100:00100000:2.0:1713481296.831993:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784533248:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.831999:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a825d40/0xdfc0fb148a3b99b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.832002:0:15473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2391:18937:x1796714882509056:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 281us (671us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.832003:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a825d40/0xdfc0fb148a3b99b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.832006:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485895 00000100:00100000:2.0:1713481296.832006:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086ec1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784535232:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.832009:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a825d40/0xdfc0fb148a3b99b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00000004:00010000:3.0:1713481296.832018:0:15642:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a825d40/0xdfc0fb148a3b99b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832022:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.832024:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.832026:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832029:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00000100:00100000:2.0:1713481296.832032:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1959:x1796714882505728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5059us (5150us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.832032:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832034:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131467180 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.832036:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820532 00010000:00010000:3.0:1713481296.832036:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832039:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832043:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.832044:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.832047:0:15642:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.832052:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.832052:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832055:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131467180/0xdfc0fb148a3b98d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832068:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832071:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832074:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832077:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a8f600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.832078:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832080:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT0 00010000:00010000:3.0:1713481296.832083:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff88008330e700) 00010000:00010000:3.0:1713481296.832085:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.832086:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.832088:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096761880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784535744:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.832088:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096a8f600/0xdfc0fb148a3b994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00000100:00100000:1.0:1713481296.832092:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+249:3490:x1796714784534336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8613us (8659us total) trans 4296040913 rc 0/0 00000004:00080000:2.0:1713481296.832093:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007810fb80/2, rc 0, transno 1073617 00000100:00100000:2.0:1713481296.832096:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007810fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784534336:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.832099:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563389 00010000:00010000:0.0:1713481296.832102:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832104:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509440 00000100:00100000:2.0:1713481296.832106:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509440 00010000:00010000:3.0:1713481296.832109:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131467cc0/0xdfc0fb148a3b986 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae9 expref: 2805 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.832116:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a825d40/0xdfc0fb148a3b99b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae9 expref: 2804 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.832137:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00000100:00100000:2.0:1713481296.832138:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563414 00010000:00010000:3.0:1713481296.832138:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.832140:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a825d40, rc 0) 00000100:00100000:2.0:1713481296.832141:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16920:17935:x1796714882509440:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.832146:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.832150:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.832153:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2804:18918:x1796714882509376:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 256us (464us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.832154:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148a3b9a2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49af0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832158:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.832158:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485896 00002000:00010000:2.0:1713481296.832163:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.832164:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832168:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832170:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832171:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.832172:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832173:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148a3b9a2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49af0 expref: 16921 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832175:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009794eac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.832177:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.832179:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e1d9880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784536576:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.832179:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099da73c0/0xdfc0fb148a3b9a2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49af0 expref: 16921 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832183:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832184:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099da73c0, rc 0) 00000100:00100000:2.0:1713481296.832193:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16921:17935:x1796714882509440:12345-192.168.202.24@tcp:101:dd.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000004:00080000:3.0:1713481296.832193:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120077b80/2, rc 0, transno 993489 00010000:00010000:0.0:1713481296.832194:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.832196:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784533696:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.832197:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563414 00010000:00010000:0.0:1713481296.832198:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.832199:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.832200:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.832202:0:15506:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832205:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009794eac0/0xdfc0fb148a3b78e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x150d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.832206:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084958d80, rc 0) 00000100:00100000:2.0:1713481296.832219:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f84e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0001_UUID:16545:1796714784536000:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.832227:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15475:x1796714784536512:12345-0@lo:101:mdt00_011.0 Request processed in 2830us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.832231:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82935 00010000:00010000:2.0:1713481296.832234:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.832242:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784537664 00000100:00100000:0.0:1713481296.832244:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784537664 00000100:00100000:2.0:1713481296.832246:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784537792:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.832249:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784536320:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.832253:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82936 00000100:00100000:0.0:1713481296.832256:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+38:10467:x1796714784537664:12345-0@lo:101:mdt00_005.0 00000100:00100000:2.0:1713481296.832260:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.832261:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.832267:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009708e400/0xdfc0fb148a3b9a9 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b955 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832271:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713481296.832271:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832274:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784537856:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.832276:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009708e400/0xdfc0fb148a3b9a9 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b955 expref: 39 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.832281:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009708e400/0xdfc0fb148a3b9a9 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b955 expref: 39 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832282:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.832284:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x0 (ffff880130505e00) 00010000:00010000:0.0:1713481296.832285:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713481296.832286:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009708e400, rc 0) 00000100:00100000:3.0:1713481296.832286:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784536448:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.832299:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784537792 00000100:00100000:2.0:1713481296.832301:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784537792 00010000:00010000:3.0:1713481296.832301:0:16462:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800848e5440/0xdfc0fb148a3b89f lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a8e expref: 24482 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.832304:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+39:10467:x1796714784537664:12345-0@lo:101:mdt00_005.0 Request processed in 47us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.832307:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82936 00010000:00010000:3.0:1713481296.832308:0:16462:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848e5440, rc 0) 00000100:00100000:2.0:1713481296.832309:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784537856 00000100:00100000:2.0:1713481296.832310:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784537856 00000100:00100000:2.0:1713481296.832317:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563415 00000100:00100000:3.0:1713481296.832318:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:17924:x1796714882507456:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3246us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.832320:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+251:3490:x1796714784537792:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.832323:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563400 00000100:00100000:0.0:1713481296.832327:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563416 00002000:00080000:2.0:1713481296.832328:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10059 count 1 00000100:00100000:0.0:1713481296.832331:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+251:3490:x1796714784537856:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.832333:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+251:3493:x1796714784533312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9376us (9399us total) trans 4296040914 rc 0/0 00010000:00010000:2.0:1713481296.832335:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.832337:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563383 00002000:00080000:0.0:1713481296.832338:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10060 count 1 00000100:00100000:3.0:1713481296.832341:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784537984:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.832342:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008807d440/0xdfc0fb148802f38 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fc0 expref: 20735 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.832346:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832346:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832347:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832349:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.832353:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801236773c0/0xdfc0fb148802f3f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fce expref: 20735 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.832357:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.832358:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.832358:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.832359:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832359:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008807d440/0xdfc0fb148802f38 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fc0 expref: 20735 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.832364:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008807d440/0xdfc0fb148802f38 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fc0 expref: 20735 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.832370:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801236773c0/0xdfc0fb148802f3f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fce expref: 20735 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.832370:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784538048:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.832372:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e724000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8074:1796714784535168:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.832375:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801236773c0/0xdfc0fb148802f3f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fce expref: 20735 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.832381:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120253800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784538112:192.168.202.24@tcp:104: 00000004:00080000:3.0:1713481296.832384:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092329c00/2, rc 0, transno 1073618 00000100:00100000:2.0:1713481296.832385:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009af53480 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.832388:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784533312:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.832391:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800890153c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.832391:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.832393:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.832396:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784537984 00000100:00100000:3.0:1713481296.832396:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784537920:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.832398:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784537984 00000100:00100000:1.0:1713481296.832405:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880133c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26825:1959:x1796714882505856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5420us (5492us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.832407:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784537664:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1713481296.832410:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.832411:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820533 00010000:00010000:0.0:1713481296.832414:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832415:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784537920 00000100:00100000:2.0:1713481296.832418:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784537920 00010000:00010000:0.0:1713481296.832419:0:10467:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832432:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563417 00000100:00100000:2.0:1713481296.832436:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2843:3493:x1796714784537984:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.832446:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43495 count 1 00000100:00100000:3.0:1713481296.832447:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563418 00000100:00100000:3.0:1713481296.832450:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2843:3493:x1796714784537920:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.832456:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.832460:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43493 count 1 00010000:00010000:2.0:1713481296.832465:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c7c000/0xdfc0fb1486894b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ab expref: 26824 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.832469:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832470:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832472:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832474:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.832477:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135480900/0xdfc0fb1486894a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d309d expref: 26824 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.832481:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.832483:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.832484:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832489:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c7c000/0xdfc0fb1486894b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ab expref: 26824 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.832492:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bd70900/0xdfc0fb14868948d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3057 expref: 26824 pid: 16459 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.832495:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135480900/0xdfc0fb1486894a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d309d expref: 26824 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.832497:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c7c000/0xdfc0fb1486894b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ab expref: 26824 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.832501:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135480900/0xdfc0fb1486894a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d309d expref: 26823 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.832503:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784535296:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.832507:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784538240:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.832508:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784538304:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.832520:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33dcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.832523:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832527:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.832530:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713481296.832531:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.832535:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784538176:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.832537:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832544:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.832547:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.832548:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832553:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832558:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800880a6ac0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.832559:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784535936:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.832561:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832567:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832578:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832579:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832586:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800880a6ac0/0xdfc0fb148a3b82f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832595:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784538176 00000100:00100000:2.0:1713481296.832597:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784538176 00000100:00100000:2.0:1713481296.832609:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563419 00000100:00100000:2.0:1713481296.832612:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+251:3491:x1796714784538176:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.832619:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10061 count 1 00010000:00010000:2.0:1713481296.832627:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832634:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099264fc0/0xdfc0fb148802f46 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fdc expref: 20735 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.832637:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832638:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832640:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 4/0,1 mode: --/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832649:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099264fc0/0xdfc0fb148802f46 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fdc expref: 20735 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.832654:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099264fc0/0xdfc0fb148802f46 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fdc expref: 20735 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.832660:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784538368:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.832682:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.832727:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2844:3492:x1796714784535104:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5627us (5686us total) trans 4295960786 rc 0/0 00000004:00080000:3.0:1713481296.832733:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081d97480/2, rc 0, transno 993490 00000100:00100000:1.0:1713481296.832734:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563392 00000100:00100000:2.0:1713481296.832738:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f84c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784536192:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.832739:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784535104:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.832753:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.832760:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.832764:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784538432:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.832768:0:15522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e727480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:15522:1796714784535488:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.832779:0:15522:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.202.24@tcp) returned -22 from blocking AST (req@ffff88009e726a00 x1796714784535552) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2046 pid: 15479 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.832782:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.832790:0:15522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012050d680/0xdfc0fb148a3b653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ca expref: 2046 pid: 15479 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.832808:0:15522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e726a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:15522:1796714784535552:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.832822:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.832833:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012ba3a300) 00000100:00100000:2.0:1713481296.832834:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784538432 00000100:00100000:2.0:1713481296.832836:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784538432 00010000:00010000:1.0:1713481296.832837:0:15522:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 3/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 38 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.832844:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 3/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 38 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832845:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510208 00000100:00100000:2.0:1713481296.832847:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510208 00010000:00010000:1.0:1713481296.832851:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012ba3a300) 00010000:00010000:1.0:1713481296.832852:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1713481296.832853:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563420 00010000:00010000:1.0:1713481296.832855:0:15522:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 3/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 38 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.832856:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2844:3490:x1796714784538432:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.832861:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800880a4000, rc 0) 00002000:00080000:2.0:1713481296.832863:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43497 count 1 00010000:00010000:2.0:1713481296.832871:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.832877:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c7c240/0xdfc0fb1486894c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30b9 expref: 26823 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.832878:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120253b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784538496:0@lo:403:mdt00_005.0 00010000:00010000:2.0:1713481296.832881:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832882:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832883:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.832889:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+38:15514:x1796714784535424:12345-0@lo:101:mdt_io00_009.0 Request processed in 5424us (5486us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.832893:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c7c240/0xdfc0fb1486894c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30b9 expref: 26823 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.832895:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82932 00010000:00010000:2.0:1713481296.832898:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c7c240/0xdfc0fb1486894c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30b9 expref: 26823 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.832899:0:10467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.832904:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f84c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784538560:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.832913:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097861000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.832914:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784538496 00000100:00100000:2.0:1713481296.832916:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.832917:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784538496 00000100:00100000:2.0:1713481296.832933:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563421 00000100:00100000:1.0:1713481296.832935:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82937 00000100:00100000:2.0:1713481296.832935:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16921:17009:x1796714882510208:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.832938:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+38:10467:x1796714784538496:12345-0@lo:403:mdt00_005.0 00010000:00010000:2.0:1713481296.832940:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.832945:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7a80/0xdfc0fb148a3b9da lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49afe expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.832946:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e1d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784536128:192.168.202.24@tcp:105: 00002000:00010000:2.0:1713481296.832953:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.832957:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.832959:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832960:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.832962:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7a80/0xdfc0fb148a3b9da lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49afe expref: 16922 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.832966:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20735:1960:x1796714882507200:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4369us (4405us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.832968:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7a80/0xdfc0fb148a3b9da lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49afe expref: 16922 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.832970:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820540 00010000:00010000:2.0:1713481296.832973:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b0c7a80, rc 0) 00000100:00100000:2.0:1713481296.832981:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16922:17009:x1796714882510208:12345-192.168.202.24@tcp:101:dd.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.832985:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563421 00000100:00100000:0.0:1713481296.832993:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f84ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784536512:0@lo:101:mdt00_011.0 00010000:00010000:0.0:1713481296.833000:0:15475:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833004:0:15475:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833028:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.833038:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509504 00000100:00100000:0.0:1713481296.833040:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509504 00010000:00010000:0.0:1713481296.833047:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148802f23 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f96 expref: 20735 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.833059:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.833062:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820554 00000100:00100000:0.0:1713481296.833066:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20735:1960:x1796714882509504:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.833069:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509632 00010000:00010000:0.0:1713481296.833070:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.833071:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509632 00010000:00010000:0.0:1713481296.833072:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148802f23 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2748:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f96 expref: 20735 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.833078:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148802f23 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2748:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f96 expref: 20735 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.833079:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e8900/0xdfc0fb148689494 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3065 expref: 26824 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.833087:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148802f23 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2748:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f96 expref: 20735 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.833088:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820555 00000100:00100000:2.0:1713481296.833091:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081eced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26824:1960:x1796714882509632:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.833095:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.833097:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941e8900/0xdfc0fb148689494 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3065 expref: 26824 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.833099:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.833100:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.833102:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833103:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941e8900/0xdfc0fb148689494 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3065 expref: 26824 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.833106:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833112:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941e8900/0xdfc0fb148689494 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3065 expref: 26824 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.833133:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.833135:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833136:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833138:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833143:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20734:1960:x1796714882509504:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 76us (114us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.833143:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833143:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833146:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820554 00010000:00010000:3.0:1713481296.833149:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833154:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833155:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.833157:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833161:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833162:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.833164:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081eced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26823:1960:x1796714882509632:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (107us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.833165:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833165:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800848e6f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.833167:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.833168:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820555 00010000:00010000:0.0:1713481296.833170:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833171:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833173:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833177:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833180:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833183:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135b3fa80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.833185:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833187:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800848e6f40/0xdfc0fb148a3b898 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833189:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833197:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833201:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b3fa80/0xdfc0fb148a3b86e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.833201:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.833213:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510272 00000100:00100000:2.0:1713481296.833215:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510272 00000100:00100000:2.0:1713481296.833225:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563422 00000100:00100000:2.0:1713481296.833228:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882510272:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.833233:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.833240:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b0c4240/0xdfc0fb148a3b9e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b05 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833249:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820f7cc0/0xdfc0fb148a13f1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3801f expref: 24483 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.833253:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833254:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833255:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0c4240/0xdfc0fb148a3b9e1 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b05 expref: 24483 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833265:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820f7cc0/0xdfc0fb148a13f1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3801f expref: 24483 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.833270:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820f7cc0/0xdfc0fb148a13f1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3801f expref: 24483 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.833275:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784538624:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.833289:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013045e480 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.833305:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2845:3493:x1796714784535616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5329us (5666us total) trans 4295960787 rc 0/0 00000100:00100000:3.0:1713481296.833309:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+252:3493:x1796714784536256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4377us (4424us total) trans 4296040915 rc 0/0 00000100:00100000:0.0:1713481296.833310:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563393 00000100:00100000:3.0:1713481296.833314:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563399 00000100:00100000:2.0:1713481296.833318:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.833329:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509888 00000100:00100000:2.0:1713481296.833330:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509888 00010000:00010000:2.0:1713481296.833338:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a1626c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3984b expref: 24484 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.833347:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820556 00000100:00100000:2.0:1713481296.833349:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1960:x1796714882509888:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.833353:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.833355:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a1626c lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3984b expref: 24484 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.833360:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a1626c lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3984b expref: 24484 pid: 16489 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.833363:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800787c5500/2, rc 0, transno 1073619 00000100:00100000:3.0:1713481296.833367:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800787c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784536256:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.833369:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a1626c lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3984b expref: 24484 pid: 16489 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.833374:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880075756d80/2, rc 0, transno 993491 00010000:00010000:2.0:1713481296.833377:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833377:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.833377:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880075756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784535616:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.833380:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848e5440/0xdfc0fb148a3b89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a8e expref: 24483 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833384:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848e5440/0xdfc0fb148a3b89f lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a8e expref: 24483 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833394:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800848e5440/0xdfc0fb148a3b89f lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a8e expref: 24483 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.833399:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784538752:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.833404:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784538688:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.833409:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013045e780 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.833421:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.833430:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.833433:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.833436:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784538816:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.833439:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510016 00000100:00100000:2.0:1713481296.833440:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510016 00000100:00100000:3.0:1713481296.833446:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.833447:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120fb0b40/0xdfc0fb14868949b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3073 expref: 26823 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.833451:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.833462:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509568 00000100:00100000:2.0:1713481296.833463:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509568 00000100:00100000:0.0:1713481296.833467:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784538688 00000100:00100000:0.0:1713481296.833469:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784538688 00010000:00010000:2.0:1713481296.833470:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2391 pid: 15576 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.833473:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784538816 00000100:00100000:3.0:1713481296.833476:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784538816 00000100:00100000:2.0:1713481296.833483:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820557 00000100:00100000:0.0:1713481296.833487:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563423 00000100:00100000:2.0:1713481296.833487:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26823:1960:x1796714882510016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.833491:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563424 00000100:00100000:0.0:1713481296.833492:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+252:3492:x1796714784538688:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.833494:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.833494:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2845:3492:x1796714784538816:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.833498:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120fb0b40/0xdfc0fb14868949b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3073 expref: 26823 pid: 16509 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.833502:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43499 count 1 00002000:00080000:0.0:1713481296.833505:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10062 count 1 00010000:00010000:2.0:1713481296.833506:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120fb0b40/0xdfc0fb14868949b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3073 expref: 26823 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.833511:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833515:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833519:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941eb840/0xdfc0fb1486894cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30c7 expref: 26823 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.833520:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120fb0b40/0xdfc0fb14868949b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3073 expref: 26823 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.833525:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd3840/0xdfc0fb148802f4d lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fea expref: 20733 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.833527:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.833528:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.833530:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833531:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.833533:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833534:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.833535:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 4/0,1 mode: --/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833535:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833538:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833540:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941eb840/0xdfc0fb1486894cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30c7 expref: 26822 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.833544:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833545:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941eb840/0xdfc0fb1486894cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30c7 expref: 26822 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.833549:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbd3840/0xdfc0fb148802f4d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fea expref: 20733 pid: 16489 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.833552:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784538880:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.833555:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbd3840/0xdfc0fb148802f4d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fea expref: 20733 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.833560:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.833562:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784538944:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.833564:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.833575:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.833577:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1960:x1796714882510016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.833583:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820557 00000100:00100000:0.0:1713481296.833589:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820558 00000100:00100000:0.0:1713481296.833593:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2391:1959:x1796714882509568:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.833597:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.833600:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2391 pid: 15576 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.833605:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2391 pid: 15576 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.833611:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833612:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079af0000/0xdfc0fb148a3b6df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499f4 expref: 2391 pid: 15576 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.833618:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833625:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833629:0:16582:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012ba3a300) 00010000:00010000:0.0:1713481296.833632:0:16582:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 39 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833632:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833637:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 39 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833638:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833641:0:16582:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 39 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833643:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c206ac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.833646:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833653:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833654:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 39 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833662:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0001_UUID:16582:1796714784539008:0@lo:105: 00010000:00010000:2.0:1713481296.833680:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833689:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c206ac0/0xdfc0fb148a3b87c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833702:0:16582:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.833784:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+2846:3491:x1796714784535872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5292us (5457us total) trans 4295960788 rc 0/0 00000100:00100000:2.0:1713481296.833788:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563395 00000100:00100000:3.0:1713481296.833791:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539008 00000100:00100000:3.0:1713481296.833794:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539008 00000100:00100000:0.0:1713481296.833803:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.833814:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.833815:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20398 00000100:00100000:3.0:1713481296.833818:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16582:x1796714784539008:12345-0@lo:105: 00000100:00100000:2.0:1713481296.833825:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510144 00010000:00010000:3.0:1713481296.833825:0:6917:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.833827:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510144 00010000:00010000:3.0:1713481296.833831:0:6917:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833834:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2804 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.833836:0:6917:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833841:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.833844:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820559 00010000:00010000:3.0:1713481296.833844:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.833847:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2804:1960:x1796714882510144:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.833848:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833852:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.833852:0:6917:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833854:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2804 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.833859:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2804 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.833861:0:6917:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800880a73c0) 00000100:00100000:0.0:1713481296.833865:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.833867:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b45200/0xdfc0fb148a3b710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a1e expref: 2804 pid: 10467 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.833877:0:15529:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000100:00100000:0.0:1713481296.833878:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.833880:0:15529:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 12 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833886:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 12 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833890:0:15529:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 12 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.833895:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:16582:x1796714784539008:12345-0@lo:105: Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.833899:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20398 00010000:00010000:2.0:1713481296.833900:0:15529:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 12 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833901:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0001_UUID:16582:1796714784539008:0@lo:105: 00000100:00100000:2.0:1713481296.833906:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000_UUID:15529:1796714784539072:0@lo:105: 00010000:00010000:0.0:1713481296.833914:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.833919:0:15529:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.833922:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2390:1959:x1796714882509568:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 329us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.833927:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820558 00000004:00080000:3.0:1713481296.833928:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a15880/2, rc 0, transno 993492 00000100:00100000:2.0:1713481296.833929:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089071c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.833933:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784535872:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.833938:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509696 00000100:00100000:2.0:1713481296.833940:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509696 00000100:00100000:0.0:1713481296.833941:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882509952 00000100:00100000:0.0:1713481296.833942:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882509952 00010000:00010000:2.0:1713481296.833947:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbd06c0/0xdfc0fb148802f15 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f7a expref: 20734 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.833948:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539072 00000100:00100000:3.0:1713481296.833949:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539072 00000100:00100000:0.0:1713481296.833955:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98376 00000100:00100000:0.0:1713481296.833958:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2205:1959:x1796714882509952:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.833958:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820560 00000100:00100000:2.0:1713481296.833961:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20734:1959:x1796714882509696:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.833961:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20399 00010000:00010000:0.0:1713481296.833962:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.833963:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15529:x1796714784539072:12345-0@lo:105: 00010000:00010000:2.0:1713481296.833965:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.833968:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbd06c0/0xdfc0fb148802f15 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2746:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f7a expref: 20734 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.833968:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833970:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800848e61c0/0xdfc0fb148a3b867 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ab8 expref: 2205 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833973:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbd06c0/0xdfc0fb148802f15 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2746:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f7a expref: 20734 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.833973:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.833977:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.833982:0:16582:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00010000:00010000:0.0:1713481296.833984:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.833985:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 5/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.833988:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd06c0/0xdfc0fb148802f15 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2746:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f7a expref: 20734 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.833989:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 6/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833990:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:1959:x1796714882509952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 32us (112us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.833993:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 6/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.833994:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98376 00010000:00010000:2.0:1713481296.833997:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833998:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.833999:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834004:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834007:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800978c4fc0) 00010000:00010000:0.0:1713481296.834009:0:15475:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 5/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.834014:0:15475:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834014:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.834022:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20733:1959:x1796714882509696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.834026:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820560 00000004:00080000:0.0:1713481296.834029:0:15475:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713481296.834039:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.834043:0:15475:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.834043:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15529:x1796714784539072:12345-0@lo:105: Request processed in 77us (122us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.834045:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.834047:0:15475:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.834048:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20399 00010000:00010000:2.0:1713481296.834050:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.834054:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539136:0@lo:101:mdt00_011.0 00010000:00010000:2.0:1713481296.834054:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834057:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834064:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.834067:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.834068:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092f87600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.834069:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834073:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.834075:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510400 00000100:00100000:3.0:1713481296.834078:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510400 00000100:00100000:0.0:1713481296.834079:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.834080:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834083:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f87600/0xdfc0fb148a3b875 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.834095:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485897 00000100:00100000:3.0:1713481296.834099:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2046:18991:x1796714882510400:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:3.0:1713481296.834106:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.834114:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a826880/0xdfc0fb148a3b9fd lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b0c expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.834162:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00200000:3.0:1713481296.834199:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2ca1:0x0]: returning size 4096 00000100:00100000:2.0:1713481296.834203:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+253:3490:x1796714784535808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5823us (5885us total) trans 4296040916 rc 0/0 00000100:00100000:2.0:1713481296.834207:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563394 00000004:00080000:2.0:1713481296.834234:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092329f80/2, rc 0, transno 1073620 00010000:00010000:3.0:1713481296.834240:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a826880/0xdfc0fb148a3b9fd lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b0c expref: 2048 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.834241:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784535808:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.834245:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a826880/0xdfc0fb148a3b9fd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b0c expref: 2048 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834260:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a826880, rc 0) 00000100:00100000:3.0:1713481296.834272:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18991:x1796714882510400:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 173us (431us total) trans 4295107618 rc 301/301 00000100:00100000:3.0:1713481296.834277:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485897 00000100:00100000:2.0:1713481296.834281:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713481296.834288:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784539200:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.834311:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.834319:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122b20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000_UUID:15529:1796714784539072:0@lo:105: 00000100:00100000:2.0:1713481296.834335:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784539264:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.834340:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.834353:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2803:1960:x1796714882510144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 505us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.834358:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820559 00000100:00100000:2.0:1713481296.834359:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.834377:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510080 00000100:00100000:3.0:1713481296.834378:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510080 00010000:00010000:3.0:1713481296.834388:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008807f840/0xdfc0fb148802f1c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f88 expref: 20733 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.834392:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539200 00000100:00100000:2.0:1713481296.834395:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539200 00000100:00100000:3.0:1713481296.834399:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820561 00000100:00100000:3.0:1713481296.834402:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20733:1959:x1796714882510080:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.834407:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.834408:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539264 00000100:00100000:2.0:1713481296.834410:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539264 00010000:00010000:3.0:1713481296.834410:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008807f840/0xdfc0fb148802f1c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f88 expref: 20733 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.834416:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008807f840/0xdfc0fb148802f1c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f88 expref: 20733 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.834423:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563425 00000100:00100000:2.0:1713481296.834426:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+253:3491:x1796714784539200:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.834430:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008807f840/0xdfc0fb148802f1c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962f88 expref: 20733 pid: 9202 timeout: 815 lvb_type: 1 00002000:00080000:2.0:1713481296.834434:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10063 count 1 00010000:00010000:3.0:1713481296.834438:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.834439:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.834441:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834441:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834446:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834448:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800801446c0/0xdfc0fb148802f54 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ff8 expref: 20732 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.834452:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.834453:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.834454:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834457:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.834464:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800801446c0/0xdfc0fb148802f54 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ff8 expref: 20732 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.834467:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20732:1959:x1796714882510080:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (305us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.834470:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800801446c0/0xdfc0fb148802f54 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ff8 expref: 20732 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.834471:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820561 00000100:00100000:2.0:1713481296.834475:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784539328:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.834491:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503540 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.834491:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563426 00000100:00100000:3.0:1713481296.834494:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2846:3491:x1796714784539264:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.834504:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539136 00002000:00080000:3.0:1713481296.834504:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43501 count 1 00000100:00100000:2.0:1713481296.834506:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539136 00010000:00010000:3.0:1713481296.834513:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834520:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135482d00/0xdfc0fb1486894d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30d5 expref: 26821 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.834524:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.834525:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.834526:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82938 00010000:00010000:3.0:1713481296.834526:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.834529:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:15475:x1796714784539136:12345-0@lo:101:mdt00_011.0 00010000:00010000:2.0:1713481296.834534:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.834537:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135482d00/0xdfc0fb1486894d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30d5 expref: 26821 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.834541:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3ba19 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3b9f6 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834544:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135482d00/0xdfc0fb1486894d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30d5 expref: 26821 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.834550:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3ba19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3b9f6 expref: 14 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.834550:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784539392:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.834556:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3ba19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b9f6 expref: 14 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.834560:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff880083968600) 00010000:00010000:2.0:1713481296.834561:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.834562:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012c33d240 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.834563:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081ca5440, rc 0) 00010000:00010000:3.0:1713481296.834573:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834578:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834583:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834587:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834590:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834593:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c204d80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.834594:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784539136:12345-0@lo:101:mdt00_011.0 Request processed in 64us (526us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.834595:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.834597:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539136:0@lo:101:mdt00_011.0 00000100:00100000:2.0:1713481296.834598:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82938 00010000:00010000:3.0:1713481296.834599:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.834606:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834608:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.834612:0:15475:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.834612:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c204d80/0xdfc0fb148a3b883 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.834624:0:15475:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:0.0:1713481296.834717:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539456:0@lo:1000:mdt00_011.0 00000100:00100000:0.0:1713481296.834735:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.834759:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f000 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.834761:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800787c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+254:3492:x1796714784536064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6042us (6110us total) trans 4296040917 rc 0/0 00000100:00100000:3.0:1713481296.834767:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563396 00000004:00080000:2.0:1713481296.834777:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a16d80/2, rc 0, transno 1073621 00000100:00100000:2.0:1713481296.834783:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784536064:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.834813:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784539520:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.834828:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.834845:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539520 00000100:00100000:3.0:1713481296.834848:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539520 00000100:00100000:2.0:1713481296.834852:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539456 00000100:00100000:2.0:1713481296.834854:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539456 00000100:00100000:2.0:1713481296.834865:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82939 00000100:00100000:2.0:1713481296.834868:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784539456:12345-0@lo:1000:mdt00_011.0 00000100:00100000:3.0:1713481296.834868:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563427 00000100:00100000:3.0:1713481296.834872:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+254:3492:x1796714784539520:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.834883:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10064 count 1 00010000:00010000:3.0:1713481296.834896:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.834898:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784539456:12345-0@lo:1000:mdt00_011.0 Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.834902:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82939 00010000:00010000:3.0:1713481296.834906:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123677180/0xdfc0fb148802f5b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963006 expref: 20731 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.834912:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.834913:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.834914:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+38:10467:x1796714784538496:12345-0@lo:403:mdt00_005.0 Request processed in 1974us (2013us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.834916:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.834919:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82937 00010000:00010000:3.0:1713481296.834934:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123677180/0xdfc0fb148802f5b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963006 expref: 20731 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.834948:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123677180/0xdfc0fb148802f5b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963006 expref: 20731 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.834957:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e724e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784535424:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.834958:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784539584:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.834963:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539456:0@lo:1000:mdt00_011.0 00010000:00010000:1.0:1713481296.834967:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.834985:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.834988:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089071c00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.834990:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.834994:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.834998:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539648:0@lo:1000:mdt00_011.0 00010000:00010000:1.0:1713481296.835007:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835010:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.835013:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.835014:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT0 00000100:00100000:1.0:1713481296.835021:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784539712:0@lo:101:mdt_io00_009.0 00000100:00100000:0.0:1713481296.835023:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.835034:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.835040:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b8d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:15550:1796714784536640:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.835050:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fbf6480 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.835050:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539648 00010000:00010000:0.0:1713481296.835052:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.835053:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539648 00010000:00010000:1.0:1713481296.835059:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835062:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539712 00010000:00010000:1.0:1713481296.835064:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835064:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539712 00000100:00100000:0.0:1713481296.835065:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1957:x1796714882508096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5150us (5256us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.835068:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.835070:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820545 00000100:00100000:2.0:1713481296.835071:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82940 00010000:00010000:1.0:1713481296.835072:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835074:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784539648:12345-0@lo:1000:mdt00_011.0 00010000:00010000:1.0:1713481296.835076:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835079:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009794f3c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.835080:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835084:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835093:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835097:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009794f3c0/0xdfc0fb148a3b76b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835112:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784539648:12345-0@lo:1000:mdt00_011.0 Request processed in 38us (99us total) trans 0 rc -2/-2 00000100:00100000:2.0:1713481296.835116:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82940 00000100:00100000:2.0:1713481296.835145:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82941 00000100:00100000:2.0:1713481296.835148:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+38:15514:x1796714784539712:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.835152:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.835159:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3ba35 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3ba2e expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835168:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3ba35 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3ba2e expref: 39 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835173:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3ba35 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3ba2e expref: 39 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835176:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff880083968500) 00010000:00010000:2.0:1713481296.835178:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.835179:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081ca4b40, rc 0) 00000100:00100000:2.0:1713481296.835198:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+39:15514:x1796714784539712:12345-0@lo:101:mdt_io00_009.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.835203:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82941 00000100:00100000:1.0:1713481296.835210:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2847:3491:x1796714784533440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12522us (12606us total) trans 4295960789 rc 0/0 00000100:00100000:1.0:1713481296.835214:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563378 00000004:00080000:2.0:1713481296.835228:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120075500/2, rc 0, transno 993493 00000100:00100000:1.0:1713481296.835238:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0000-mdtlov_UUID:15514:1796714784539712:0@lo:101:mdt_io00_009.0 00000100:00100000:2.0:1713481296.835239:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784533440:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.835245:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835250:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835255:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539648:0@lo:1000:mdt00_011.0 00010000:00010000:1.0:1713481296.835266:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835270:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835274:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT0 00000100:00100000:3.0:1713481296.835274:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784539776:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.835276:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120253b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784538496:0@lo:403:mdt00_005.0 00000100:00100000:3.0:1713481296.835298:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.835302:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539840:0@lo:1000:mdt00_011.0 00010000:00010000:1.0:1713481296.835309:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835313:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835316:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835319:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a9b9440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.835321:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.835321:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.835324:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835329:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff880081534400) 00010000:00010000:1.0:1713481296.835330:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.835331:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124d31900 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.835332:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835334:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9b9440/0xdfc0fb148a3ba3c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.835341:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539840 00000100:00100000:2.0:1713481296.835344:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539840 00010000:00010000:1.0:1713481296.835354:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835358:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835360:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82942 00010000:00010000:1.0:1713481296.835361:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835363:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784539840:12345-0@lo:1000:mdt00_011.0 00010000:00010000:1.0:1713481296.835368:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713481296.835371:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835374:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835377:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835383:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1713481296.835385:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835388:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835391:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835394:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012064fcc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.835395:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835397:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835401:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012bb20f00) 00010000:00010000:1.0:1713481296.835402:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1713481296.835403:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835406:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012064fcc0/0xdfc0fb148a3ba27 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.835412:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784539840:12345-0@lo:1000:mdt00_011.0 Request processed in 47us (89us total) trans 0 rc -2/-2 00000004:00080000:1.0:1713481296.835415:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:1.0:1713481296.835418:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835418:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82942 00010000:00010000:1.0:1713481296.835424:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835429:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835436:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1713481296.835441:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835443:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1713481296.835446:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:2.0:1713481296.835448:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012064f600 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.835449:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835452:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835454:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.835458:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835460:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835468:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1713481296.835471:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.835475:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835476:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835480:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.835480:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.835485:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d3158c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.835488:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.835491:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 1/0,0 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835493:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.835497:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012064f600/0xdfc0fb148a3ba2e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3ba35 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835499:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88009bf97a00) 00010000:00010000:1.0:1713481296.835502:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.835504:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.835509:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d3158c0/0xdfc0fb148a3b80c lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.835515:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1713481296.835518:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835523:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800880a73c0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.835526:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.835532:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835546:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835551:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.835556:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.835561:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2203:18943:x1796714882506560:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 9760us (9794us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713481296.835561:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a73c0/0xdfc0fb148a3b836 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b83d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.835565:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26111 00010000:00010000:2.0:1713481296.835578:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1713481296.835580:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835583:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801216f9440 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.835584:0:11387:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713481296.835585:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835587:0:11387:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.835589:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835591:0:11387:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800880a6880 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.835593:0:11387:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835597:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.835598:0:11387:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835600:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.835608:0:11387:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835611:0:11387:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.835613:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835615:0:11387:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835617:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801216f9440/0xdfc0fb148a3b813 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b81a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835619:0:11387:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800880a6880/0xdfc0fb148a3b821 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b828 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.835627:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784540096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.835631:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.835632:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.835633:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.835633:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.835634:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.835636:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.835639:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.835645:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784539904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.835652:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.835653:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539776 00000100:00100000:1.0:1713481296.835655:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539776 00000100:00100000:1.0:1713481296.835681:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563428 00000100:00100000:2.0:1713481296.835682:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784540032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.835684:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2847:3493:x1796714784539776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.835692:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43503 count 1 00000100:00100000:2.0:1713481296.835695:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.835700:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.835707:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.835708:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135480240/0xdfc0fb1486894da lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30e3 expref: 26821 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.835712:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.835714:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.835715:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.835715:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796714784539968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.835724:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135480240/0xdfc0fb1486894da lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30e3 expref: 26821 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.835730:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135480240/0xdfc0fb1486894da lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30e3 expref: 26821 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.835732:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.835736:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784540160:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.835748:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540096 00000100:00100000:1.0:1713481296.835750:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3d780 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.835750:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540032 00000100:00100000:3.0:1713481296.835751:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540096 00000100:00100000:2.0:1713481296.835753:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540032 00000100:00100000:1.0:1713481296.835763:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539904 00000100:00100000:1.0:1713481296.835765:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539904 00000100:00100000:2.0:1713481296.835765:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784539968 00000100:00100000:2.0:1713481296.835766:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784539968 00000100:00100000:3.0:1713481296.835774:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98377 00000100:00100000:3.0:1713481296.835780:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+42:3492:x1796714784540032:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.835783:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98378 00000100:00100000:2.0:1713481296.835786:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+42:3493:x1796714784540096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.835787:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98379 00010000:00010000:3.0:1713481296.835788:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.835790:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+42:3491:x1796714784539968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.835790:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.835794:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.835798:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a6d00/0xdfc0fb148a3b828 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b821 expref: 42 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.835800:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a46c0/0xdfc0fb148a3b81a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b813 expref: 42 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.835801:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800880a4000/0xdfc0fb148a3b83d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x50b7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b836 expref: 42 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835805:0:8074:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff8800842d0e00) 00010000:00010000:1.0:1713481296.835810:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x50b7:0x0].0x0 (ffff88012ba3a300) 00010000:00010000:2.0:1713481296.835815:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.835816:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.835816:0:15550:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.835819:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.835839:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+39:3493:x1796714784540096:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.835840:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+39:3491:x1796714784539968:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.835843:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98378 00000100:00100000:1.0:1713481296.835845:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98379 00000100:00100000:3.0:1713481296.835856:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+38:3492:x1796714784540032:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.835858:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98380 00000100:00100000:2.0:1713481296.835860:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+37:3490:x1796714784539904:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.835862:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98377 00010000:00010000:2.0:1713481296.835865:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.835870:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3ba35 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x38b1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3ba2e expref: 37 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.835879:0:8074:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x0 (ffff880083968500) 00010000:00010000:2.0:1713481296.835884:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.835899:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+35:3490:x1796714784539904:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.835902:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98380 00000100:00100000:3.0:1713481296.835909:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784540032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.835926:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796714784539968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.835952:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784539840:0@lo:1000:mdt00_011.0 00000100:00100000:3.0:1713481296.835964:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3490:1796714784539904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.835991:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784540096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.835993:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784540224:0@lo:1000:mdt00_011.0 00000100:00100000:2.0:1713481296.836045:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.836055:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800848d5900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.836063:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540224 00000100:00100000:2.0:1713481296.836065:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540224 00000100:00100000:2.0:1713481296.836075:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82943 00000100:00100000:2.0:1713481296.836077:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784540224:12345-0@lo:1000:mdt00_011.0 00010000:00010000:1.0:1713481296.836166:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.836191:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784540224:12345-0@lo:1000:mdt00_011.0 Request processed in 111us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.836197:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82943 00000100:00100000:2.0:1713481296.836227:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784536896:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.836243:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784536960:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.836248:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.836266:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.836276:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784540224:0@lo:1000:mdt00_011.0 00000100:00100000:1.0:1713481296.836306:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.836318:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510464 00000100:00100000:1.0:1713481296.836320:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510464 00000100:00100000:1.0:1713481296.836333:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563429 00000100:00100000:1.0:1713481296.836337:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:15045:x1796714882510464:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.836343:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.836352:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a9baf40/0xdfc0fb148a3ba4a lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9be9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b13 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.836363:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9be9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.836371:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.836373:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.836377:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a9baf40/0xdfc0fb148a3ba4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b13 expref: 24484 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.836387:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a9baf40/0xdfc0fb148a3ba4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9be9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b13 expref: 24484 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.836394:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a9baf40, rc 0) 00000100:00100000:1.0:1713481296.836412:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:15045:x1796714882510464:12345-192.168.202.24@tcp:101:dd.0 Request processed in 73us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.836418:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563429 00000100:00100000:2.0:1713481296.836446:0:15475:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784540288:0@lo:1000:mdt00_011.0 00000100:00100000:2.0:1713481296.836500:0:15475:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.836510:0:15475:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.836527:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784537024:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.836528:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009090e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784537088:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.836540:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.836551:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540288 00000100:00100000:2.0:1713481296.836552:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540288 00010000:00010000:1.0:1713481296.836553:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xdfc0fb148a3b8d0 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a9c expref: 16921 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.836562:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c07d680, rc 0) 00000100:00100000:2.0:1713481296.836562:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82944 00000100:00100000:2.0:1713481296.836565:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784540288:12345-0@lo:1000:mdt00_011.0 00000100:00100000:1.0:1713481296.836579:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16921:18836:x1796714882508224:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6067us (6110us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.836584:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563405 00000100:00100000:2.0:1713481296.836642:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15475:x1796714784540288:12345-0@lo:1000:mdt00_011.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.836646:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82944 00000100:00100000:2.0:1713481296.836679:0:15475:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:15475:1796714784540288:0@lo:1000:mdt00_011.0 00000100:00100000:1.0:1713481296.836701:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.836709:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510720 00000100:00100000:1.0:1713481296.836711:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510720 00000100:00100000:1.0:1713481296.836722:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563430 00000100:00100000:1.0:1713481296.836725:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20732:18792:x1796714882510720:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.836730:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.836736:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a9bb600/0xdfc0fb148a3ba51 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc524:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b1a expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.836748:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc524:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.836754:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.836755:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.836758:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a9bb600/0xdfc0fb148a3ba51 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc524:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b1a expref: 20733 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.836764:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007a9bb600/0xdfc0fb148a3ba51 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc524:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b1a expref: 20733 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.836768:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a9bb600, rc 0) 00000100:00100000:1.0:1713481296.836781:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20733:18792:x1796714882510720:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 55us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.836786:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563430 00000100:00100000:1.0:1713481296.836888:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009090c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784537536:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.836909:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099fef180/0xdfc0fb148a3b939 lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae2 expref: 20732 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.836919:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099fef180, rc 0) 00000100:00100000:1.0:1713481296.836932:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20732:10479:x1796714882509312:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5371us (5399us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.836935:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563413 00000040:00080000:2.0:1713481296.837019:0:15475:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x9a:0x0].1985, 1080 off1629232 00000100:00100000:1.0:1713481296.837037:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000040:00080000:2.0:1713481296.837051:0:15475:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xa5:0x0].860, 1224 off796168 00000004:00080000:2.0:1713481296.837053:0:15475:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800848d5900 with version 16902 00000100:00100000:1.0:1713481296.837055:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.837069:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.837073:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880086ec2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784537728:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.837077:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.837086:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.837093:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.837099:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510528 00000100:00100000:2.0:1713481296.837100:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26821:1960:x1796714882508928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5280us (5794us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.837104:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820552 00000100:00100000:3.0:1713481296.837104:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510528 00010000:00010000:3.0:1713481296.837140:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123674480/0xdfc0fb148802f2a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fa4 expref: 20732 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.837159:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.837160:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510656 00000100:00100000:3.0:1713481296.837163:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510656 00000100:00100000:1.0:1713481296.837170:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510848 00000100:00100000:2.0:1713481296.837171:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510976 00000100:00100000:1.0:1713481296.837172:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510848 00000100:00100000:2.0:1713481296.837173:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510976 00010000:00010000:3.0:1713481296.837175:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbd2400/0xdfc0fb148802f31 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fb2 expref: 20733 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.837181:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007daba400/0xdfc0fb1488e7e68 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0x8e9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b552c expref: 16921 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.837182:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134fa5d40/0xdfc0fb1486894b7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d308f expref: 26821 pid: 15496 timeout: 815 lvb_type: 1 00000040:00080000:0.0:1713481296.837191:0:10467:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x9e:0x0].1842, 944 off1554968 00000100:00100000:3.0:1713481296.837191:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511104 00000100:00100000:2.0:1713481296.837193:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511168 00000100:00100000:2.0:1713481296.837194:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511168 00000100:00100000:3.0:1713481296.837194:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511104 00000100:00100000:1.0:1713481296.837197:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820562 00010000:00010000:2.0:1713481296.837199:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932898c0/0xdfc0fb14891d44c lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca71d expref: 24484 pid: 16464 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.837200:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20733:1959:x1796714882510528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.837203:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120508d80/0xdfc0fb14893ab3d lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ea expref: 26822 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.837205:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.837209:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123674480/0xdfc0fb148802f2a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fa4 expref: 20733 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.837209:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820563 00000100:00100000:2.0:1713481296.837213:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20733:1959:x1796714882510656:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.837215:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123674480/0xdfc0fb148802f2a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fa4 expref: 20733 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.837217:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.837220:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbd2400/0xdfc0fb148802f31 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fb2 expref: 20733 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.837223:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820564 00010000:00010000:1.0:1713481296.837225:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123674480/0xdfc0fb148802f2a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fa4 expref: 20733 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.837226:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbd2400/0xdfc0fb148802f31 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fb2 expref: 20733 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.837228:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16921:1959:x1796714882510976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.837235:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.837236:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.837237:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd2400/0xdfc0fb148802f31 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x274a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fb2 expref: 20732 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.837237:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.837238:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.837242:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.837242:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007daba400/0xdfc0fb1488e7e68 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0x8e9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b552c expref: 16921 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.837247:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.837248:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.837250:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.837251:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007daba400/0xdfc0fb1488e7e68 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b552c expref: 16921 pid: 16487 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.837254:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.837258:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.837266:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20731:1959:x1796714882510528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.837270:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820562 00010000:00010000:3.0:1713481296.837273:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.837275:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.837275:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.837279:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b901 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49abf expref: 16921 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.837287:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b901 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8e9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49abf expref: 16921 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.837293:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20730:1959:x1796714882510656:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.837300:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820563 00010000:00010000:3.0:1713481296.837307:0:15529:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b901 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8e9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49abf expref: 16921 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.837317:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784540352:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.837321:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820565 00000100:00100000:1.0:1713481296.837324:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820566 00000100:00100000:2.0:1713481296.837325:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882510848:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.837327:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1959:x1796714882511168:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.837331:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.837332:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.837334:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932898c0/0xdfc0fb14891d44c lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca71d expref: 24484 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.837337:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134fa5d40/0xdfc0fb1486894b7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d308f expref: 26822 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.837339:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d378840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.837340:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932898c0/0xdfc0fb14891d44c lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca71d expref: 24484 pid: 16464 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.837350:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134fa5d40/0xdfc0fb1486894b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d308f expref: 26822 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.837351:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:0.0:1713481296.837359:0:10467:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xb7:0x0].645, 1024 off641304 00000100:00100000:3.0:1713481296.837362:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820567 00000004:00080000:0.0:1713481296.837363:0:10467:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880097861f00 with version 16268 00010000:00010000:2.0:1713481296.837367:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.837368:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.837368:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882511104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.837369:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1959:x1796714882511168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 40us (209us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.837371:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.837375:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820566 00010000:00010000:3.0:1713481296.837376:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.837378:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.837380:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120508d80/0xdfc0fb14893ab3d lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ea expref: 26822 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.837384:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784537216:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.837390:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120508d80/0xdfc0fb14893ab3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ea expref: 26822 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.837391:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.837401:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b8ec lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49aaa expref: 26822 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.837403:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837408:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ff69d40, rc 0) 00000100:00100000:2.0:1713481296.837408:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:1959:x1796714882510848:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (336us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.837410:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.837412:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.837414:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820565 00010000:00010000:3.0:1713481296.837414:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.837417:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.837418:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb148a3b932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49adb expref: 24483 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.837422:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26822:18817:x1796714882508352:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6497us (6614us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.837424:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.837426:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563407 00010000:00010000:3.0:1713481296.837427:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb148a3b932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49adb expref: 24483 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.837435:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.837436:0:8077:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a5738e40 version 16902 rpc_version 16902 00010000:00010000:1.0:1713481296.837441:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800914c46c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.837443:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.837446:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb148a3b932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49adb expref: 24483 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.837450:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1713481296.837450:0:8077:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1713481296.837453:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fa5d40/0xdfc0fb1486894b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d308f expref: 26820 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.837455:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784540416:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.837456:0:8077:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880076a90700 x1796714784540544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1713481296.837461:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.837467:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3b8bb lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.837468:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ae1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784537280:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.837469:0:8077:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784540544:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713481296.837475:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b09f540 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.837488:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.837488:0:8077:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.837496:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.837500:0:8077:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fbf6480 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.837502:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837508:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.837509:0:8638:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88007e4bd780 version 16268 rpc_version 16268 00010000:00010000:0.0:1713481296.837515:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1713481296.837518:0:8638:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713481296.837521:0:8638:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880076a91180 x1796714784540672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713481296.837526:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837531:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986cd680 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.837531:0:8638:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a91180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784540672:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713481296.837534:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837539:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.837542:0:8638:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.837548:0:8638:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098ec1cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.837551:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837557:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800986cd680/0xdfc0fb148a3b8fa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837560:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837566:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837570:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837574:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837577:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837581:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800914c5b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.837582:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837586:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.837589:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+255:3491:x1796714784536704:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7296us (7362us total) trans 4296040918 rc 0/0 00000100:00100000:1.0:1713481296.837595:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563402 00010000:00010000:2.0:1713481296.837595:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.837602:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800914c5b00/0xdfc0fb148a3b8c9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x274a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.837627:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ee5d180/2, rc 0, transno 1073622 00000100:00100000:1.0:1713481296.837634:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784536704:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.837679:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.837685:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784540736:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.837699:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.837718:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540736 00000100:00100000:1.0:1713481296.837720:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540736 00000100:00100000:2.0:1713481296.837730:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+256:3492:x1796714784536832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7297us (7358us total) trans 4296040919 rc 0/0 00000100:00100000:1.0:1713481296.837731:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563431 00000100:00100000:1.0:1713481296.837733:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+256:3491:x1796714784540736:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.837734:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563404 00002000:00080000:1.0:1713481296.837741:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10065 count 1 00000004:00080000:3.0:1713481296.837744:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ee5ed80/2, rc 0, transno 1073623 00010000:00010000:1.0:1713481296.837750:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.837752:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540544 00000100:00100000:3.0:1713481296.837752:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784536832:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.837754:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540544 00010000:00010000:1.0:1713481296.837758:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099266880/0xdfc0fb148802f62 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963014 expref: 20729 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.837762:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.837762:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540672 00010000:00010000:1.0:1713481296.837763:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.837763:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540672 00010000:00010000:1.0:1713481296.837764:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.837765:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2848:3493:x1796714784537152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6758us (6871us total) trans 4295960790 rc 0/0 00000004:00080000:3.0:1713481296.837768:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ee5e300/2, rc 0, transno 993494 00000100:00100000:0.0:1713481296.837770:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563409 00000100:00100000:2.0:1713481296.837771:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82945 00000100:00100000:3.0:1713481296.837772:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784537152:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.837774:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099266880/0xdfc0fb148802f62 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963014 expref: 20729 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.837774:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:8077:x1796714784540544:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1713481296.837779:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099266880/0xdfc0fb148802f62 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963014 expref: 20729 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.837788:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e726a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784540800:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.837796:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713481296.837797:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007daba400/0xdfc0fb1488e7e68 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b552c expref: 16921 pid: 16487 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.837801:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784540864:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.837806:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081ec8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784537344:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.837807:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b96ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.837818:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.837821:0:16491:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800986cc6c0/0xdfc0fb148a3b901 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8e9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49abf expref: 16920 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837829:0:16491:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986cc6c0, rc 0) 00000100:00100000:1.0:1713481296.837836:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540864 00000100:00100000:0.0:1713481296.837839:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16920:8499:x1796714882508864:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6608us (6703us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.837839:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540864 00000100:00100000:0.0:1713481296.837842:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563410 00000100:00100000:3.0:1713481296.837848:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.837852:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784540928:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.837855:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563432 00000100:00100000:0.0:1713481296.837858:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2848:3490:x1796714784540864:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.837863:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1713481296.837866:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43505 count 1 00010000:00010000:0.0:1713481296.837874:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837880:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848558c0/0xdfc0fb1486894e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30f1 expref: 26819 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.837884:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.837884:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784540928 00010000:00010000:0.0:1713481296.837885:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.837886:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.837887:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784540928 00010000:00010000:0.0:1713481296.837896:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800848558c0/0xdfc0fb1486894e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30f1 expref: 26819 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.837900:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563433 00010000:00010000:0.0:1713481296.837901:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800848558c0/0xdfc0fb1486894e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30f1 expref: 26819 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.837903:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+256:3493:x1796714784540928:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.837907:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784540992:192.168.202.24@tcp:104: 00002000:00080000:1.0:1713481296.837911:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10066 count 1 00000100:00100000:0.0:1713481296.837918:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.837918:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.837925:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd21c0/0xdfc0fb148802f69 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963022 expref: 20729 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.837929:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.837930:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.837931:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.837935:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077a83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784537408:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.837941:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbd21c0/0xdfc0fb148802f69 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963022 expref: 20729 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.837946:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbd21c0/0xdfc0fb148802f69 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963022 expref: 20729 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.837946:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8077:x1796714784540544:12345-0@lo:1000:osp_up0-1.0 Request processed in 170us (456us total) trans 4295105924 rc 0/0 00000100:00100000:2.0:1713481296.837950:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82945 00000100:00100000:1.0:1713481296.837951:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784541056:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.837953:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132099b00/0xdfc0fb148a3b91d lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ad4 expref: 16919 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.837958:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132099b00, rc 0) 00000100:00100000:1.0:1713481296.837962:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.837963:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82946 00000100:00100000:2.0:1713481296.837965:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+35:8638:x1796714784540672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713481296.837966:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16919:11552:x1796714882509184:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6566us (6588us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.837970:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563411 00000100:00100000:1.0:1713481296.837981:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.837990:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120508d80/0xdfc0fb14893ab3d lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ea expref: 26819 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.837997:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510592 00000100:00100000:1.0:1713481296.837999:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510592 00000100:00100000:0.0:1713481296.838002:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078614a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784537472:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.838008:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c7d200/0xdfc0fb1486894a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3081 expref: 26819 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.838009:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932898c0/0xdfc0fb14891d44c lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca71d expref: 24483 pid: 16464 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.838017:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16493:1796714784537600:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.838029:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820568 00000100:00100000:1.0:1713481296.838032:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26819:1959:x1796714882510592:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.838037:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.838039:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c7d200/0xdfc0fb1486894a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3081 expref: 26819 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.838041:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092f021c0/0xdfc0fb148a3b932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x1f25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49adb expref: 24482 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838045:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c7d200/0xdfc0fb1486894a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3081 expref: 26819 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.838046:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f021c0, rc 0) 00000100:00100000:0.0:1713481296.838053:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:10409:x1796714882509248:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6496us (6541us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.838056:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563412 00010000:00010000:1.0:1713481296.838058:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c7d200/0xdfc0fb1486894a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3081 expref: 26819 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.838068:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.838068:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.838070:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838075:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.838087:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.838088:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.838096:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26818:1959:x1796714882510592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.838100:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820568 00000100:00100000:3.0:1713481296.838105:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510784 00000100:00100000:3.0:1713481296.838108:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510784 00000100:00100000:0.0:1713481296.838109:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.838116:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882510912 00000100:00100000:0.0:1713481296.838133:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.838135:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124e8a640/0xdfc0fb14891eec4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb75b expref: 20730 pid: 16452 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.838137:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882510912 00000100:00100000:3.0:1713481296.838148:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511040 00010000:00010000:1.0:1713481296.838149:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ceffcc0/0xdfc0fb1489cff39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223e6 expref: 24482 pid: 16537 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.838151:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511040 00010000:00010000:3.0:1713481296.838158:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbd6d00/0xdfc0fb14895a15a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec9b expref: 16919 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.838170:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820569 00000100:00100000:3.0:1713481296.838175:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820570 00000100:00100000:1.0:1713481296.838176:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4018c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20730:1959:x1796714882510784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.838179:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882510912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.838183:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.838185:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.838186:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124e8a640/0xdfc0fb14891eec4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb75b expref: 20730 pid: 16452 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.838188:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:8638:x1796714784540672:12345-0@lo:1000:osp_up1-0.0 Request processed in 221us (644us total) trans 4295107620 rc 0/0 00010000:00010000:3.0:1713481296.838188:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ceffcc0/0xdfc0fb1489cff39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223e6 expref: 24482 pid: 16537 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.838193:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124e8a640/0xdfc0fb14891eec4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb75b expref: 20730 pid: 16452 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.838193:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82946 00010000:00010000:3.0:1713481296.838195:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ceffcc0/0xdfc0fb1489cff39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223e6 expref: 24482 pid: 16537 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.838211:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124e8a640/0xdfc0fb14891eec4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb75b expref: 20730 pid: 16452 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.838211:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ceffcc0/0xdfc0fb1489cff39 lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa223e6 expref: 24482 pid: 16537 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.838216:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820571 00000100:00100000:2.0:1713481296.838220:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16919:1959:x1796714882511040:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.838221:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.838222:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.838223:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120253800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784538112:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.838225:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.838225:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.838225:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49aaa expref: 26817 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838227:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.838230:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49aaa expref: 26817 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838231:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xdfc0fb148a3b8d0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a9c expref: 16919 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.838233:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cbd6d00/0xdfc0fb14895a15a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec9b expref: 16919 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.838237:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838238:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xdfc0fb148a3b8d0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a9c expref: 16919 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.838240:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cbd6d00/0xdfc0fb14895a15a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec9b expref: 16919 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.838243:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007ff69d40/0xdfc0fb148a3b8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49aaa expref: 26817 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.838254:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbd6d00/0xdfc0fb14895a15a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eec9b expref: 16919 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.838254:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784541120:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.838255:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xdfc0fb148a3b8d0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8063:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a9c expref: 16919 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.838261:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784541184:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.838263:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.838264:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.838264:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.838266:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132099b00/0xdfc0fb148a3b91d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ad4 expref: 16918 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838266:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.838271:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132099b00/0xdfc0fb148a3b91d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ad4 expref: 16918 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.838275:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084aabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.838280:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511232 00000100:00100000:0.0:1713481296.838281:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.838282:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132099b00/0xdfc0fb148a3b91d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ad4 expref: 16918 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838282:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511232 00010000:00010000:1.0:1713481296.838287:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.838287:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784541248:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.838290:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e64fc0/0xdfc0fb148916dbb lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a0 expref: 20730 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.838294:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.838297:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.838298:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801224d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.838302:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820572 00010000:00010000:1.0:1713481296.838304:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838305:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20730:1959:x1796714882511232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.838307:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511360 00000100:00100000:0.0:1713481296.838309:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511360 00010000:00010000:3.0:1713481296.838309:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.838310:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838316:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.838318:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e64fc0/0xdfc0fb148916dbb lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a0 expref: 20730 pid: 15547 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.838321:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c07dd40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.838324:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.838324:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e64fc0/0xdfc0fb148916dbb lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a0 expref: 20730 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.838327:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125698 00000100:00100000:0.0:1713481296.838330:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18947:x1796714882511360:12345-192.168.202.24@tcp:33:lfs.0 00010000:00010000:1.0:1713481296.838330:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.838330:0:8638:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a91180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784540672:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713481296.838340:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e64fc0/0xdfc0fb148916dbb lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a0 expref: 20730 pid: 15547 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.838343:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838349:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c07dd40/0xdfc0fb148a3b8c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.838351:0:8077:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a90700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784540544:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713481296.838354:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.838355:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.838358:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099fef180/0xdfc0fb148a3b939 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae2 expref: 20729 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.838363:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099fef180/0xdfc0fb148a3b939 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae2 expref: 20729 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.838374:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099fef180/0xdfc0fb148a3b939 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae2 expref: 20729 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.838378:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca6ac0/0xdfc0fb148a3ba6d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x34d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:3.0:1713481296.838381:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784541312:192.168.202.24@tcp:105: 00000004:00200000:0.0:1713481296.838382:0:15487:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3431:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.838384:0:15487:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713481296.838384:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca6ac0/0xdfc0fb148a3ba6d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.838388:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca6ac0/0xdfc0fb148a3ba6d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.838391:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94e40 going to sleep for 11 seconds 00000004:00010000:2.0:1713481296.838395:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009e724a80 reply state ffff88007c1ad000 transno 4295107619 ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca6ac0/0xdfc0fb148a3ba6d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x34d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.838399:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca6ac0/0xdfc0fb148a3ba6d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x34d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:2.0:1713481296.838403:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d7:0x0].0x0 (ffff880122a33900) 00010000:00010000:2.0:1713481296.838404:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.838405:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713481296.838407:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18947:x1796714882511360:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 76us (113us total) trans 0 rc 0/0 00000004:00200000:2.0:1713481296.838407:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34d7:0x0]: returning size 4096 00000004:00080000:2.0:1713481296.838410:0:15475:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:3.0:1713481296.838410:0:16769:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511296 00000100:00100000:0.0:1713481296.838411:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125698 00000100:00100000:3.0:1713481296.838412:0:16769:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511296 00000004:00200000:0.0:1713481296.838431:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x517c:0x0]: returning size 4096 00002000:00010000:3.0:1713481296.838431:0:16769:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161095/47696 (0->18446744073709551615) 00002000:00100000:3.0:1713481296.838433:0:16769:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801201a6300 with x1796714882511296 ext(0->18446744073709551615) 00010000:00010000:0.0:1713481296.838438:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00002000:00010000:3.0:1713481296.838438:0:16769:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801201a6300. 00010000:00010000:0.0:1713481296.838442:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838445:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.838448:0:16769:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 376554 00010000:00010000:0.0:1713481296.838450:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa14fc0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:3.0:1713481296.838451:0:16769:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_075:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882511296:12345-192.168.202.24@tcp:10:dir_create.sh.0 00010000:00010000:0.0:1713481296.838452:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838456:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838461:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x236:0x0].0x0 (ffff880085d8e700) 00000100:00100000:1.0:1713481296.838461:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2849:3491:x1796714784536768:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8091us (8133us total) trans 4295960791 rc 0/0 00010000:00010000:0.0:1713481296.838462:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713481296.838464:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 2/0,0 mode: --/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.838466:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563403 00010000:00010000:0.0:1713481296.838467:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3b94e lrc: 0/0,0 mode: --/EX res: [0x200000400:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838479:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.838483:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.838486:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.838493:0:10467:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1713481296.838496:0:10467:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x1d3:0x0] 00010000:00010000:0.0:1713481296.838500:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838503:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838508:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838510:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa16880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.838512:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838514:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838518:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x517c:0x0].0x0 (ffff880096f1ac00) 00010000:00010000:0.0:1713481296.838519:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713481296.838520:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838523:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3b947 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x517c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00002000:00010000:3.0:1713481296.838539:0:16769:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000407:0xba50:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1713481296.838541:0:16769:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000407:0xba50:0x0] updating lvb mtime from disk: 0 -> 1713481296 00002000:00010000:3.0:1713481296.838543:0:16769:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000407:0xba50:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1713481296.838545:0:16769:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000407:0xba50:0x0] updating lvb ctime from disk: 0 -> 1713481296 00002000:00010000:3.0:1713481296.838546:0:16769:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000407:0xba50:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1713481296.838558:0:16769:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_075:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1959:x1796714882511296:12345-192.168.202.24@tcp:10:dir_create.sh.0 Request processed in 106us (276us total) trans 4295960792 rc 0/0 00010000:00010000:2.0:1713481296.838561:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838562:0:16769:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 376554 00002000:00010000:3.0:1713481296.838564:0:16769:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161095/47696 (0->18446744073709551615) 00010000:00010000:2.0:1713481296.838566:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1713481296.838566:0:16769:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801201a6300 with x1796714882511296 ext(0->18446744073709551615) 00002000:00010000:3.0:1713481296.838568:0:16769:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801201a6300. 00010000:00010000:2.0:1713481296.838569:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.838577:0:15475:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1713481296.838579:0:15475:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:2.0:1713481296.838581:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.838585:0:15475:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.838612:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2391:18910:x1796714882507072:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 10724us (10890us total) trans 4295107619 rc 0/0 00000100:00100000:2.0:1713481296.838617:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485890 00010000:00010000:1.0:1713481296.838659:0:11387:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1713481296.838674:0:11387:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838679:0:11387:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa158c0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.838682:0:11387:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.838689:0:11387:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838689:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784538304:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.838691:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838695:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838698:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.838698:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784538240:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.838701:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838703:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa15d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.838703:0:11387:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.838705:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.838708:0:11387:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713481296.838710:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.838713:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.838713:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.838715:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c4:0x0].0x0 (ffff88009d34a500) 00010000:00010000:0.0:1713481296.838716:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.838717:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 3/0,0 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838720:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3b92b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.838720:0:11387:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838727:0:11387:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007aa158c0/0xdfc0fb148a3b955 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b9a9 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838729:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784541376:0@lo:103:ldlm_bl.0 00000004:00010000:0.0:1713481296.838733:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880084ae2d80 reply state ffff88007c1af000 transno 4295105923 ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.838737:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.838740:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9203:1796714784538368:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.838741:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c4:0x0].0x3631 (ffff88009d34a700) 00010000:00010000:0.0:1713481296.838742:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.838743:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713481296.838745:0:11387:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.838747:0:11387:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838748:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.838750:0:11387:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978c4fc0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.838750:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838752:0:11387:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.838759:0:11387:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.838763:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18578:x1796714882508672:12345-192.168.202.24@tcp:36:rm.0 Request processed in 7277us (7661us total) trans 4295105923 rc 0/0 00000100:00100000:0.0:1713481296.838766:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485893 00010000:00010000:1.0:1713481296.838769:0:11387:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838772:0:11387:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713481296.838776:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f84c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784538560:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.838780:0:11387:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838781:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784541376 00010000:00010000:0.0:1713481296.838782:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.838783:0:11387:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800978c4fc0/0xdfc0fb148a3b8a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3b8ad expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838783:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784541376 00010000:00010000:2.0:1713481296.838784:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.838796:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713481296.838796:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98381 00010000:00010000:1.0:1713481296.838797:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.838798:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713481296.838799:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000-mdtlov_UUID+36:3493:x1796714784541376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.838804:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.838811:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009708e400/0xdfc0fb148a3b9a9 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b955 expref: 36 pid: 15506 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.838814:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ee5ea00/2, rc 0, transno 993495 00000100:00100000:2.0:1713481296.838814:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784538624:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.838816:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.838820:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784536768:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.838822:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x0 (ffff880130505e00) 00000100:00100000:1.0:1713481296.838823:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.838827:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784541440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.838831:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b0c4240/0xdfc0fb148a3b9e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b05 expref: 24482 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.838833:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.838837:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b0c4240, rc 0) 00000100:00100000:1.0:1713481296.838846:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.838853:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784538944:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.838855:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882510272:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5627us (5654us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.838860:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563422 00000100:00100000:3.0:1713481296.838863:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000-mdtlov_UUID+35:3493:x1796714784541376:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (115us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.838866:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.838868:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98381 00000100:00100000:1.0:1713481296.838872:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511744 00000100:00100000:1.0:1713481296.838874:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511744 00000100:00100000:3.0:1713481296.838877:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784541440 00000100:00100000:3.0:1713481296.838878:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784541440 00000100:00100000:2.0:1713481296.838883:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16542:1796714784538048:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.838885:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.838888:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563434 00000100:00100000:3.0:1713481296.838890:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98382 00000100:00100000:0.0:1713481296.838893:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511936 00000100:00100000:1.0:1713481296.838893:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16919:11388:x1796714882511744:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.838893:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0001-mdtlov_UUID+15:3491:x1796714784541440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.838895:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511936 00010000:00010000:3.0:1713481296.838897:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.838899:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.838899:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.838904:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880084958d80/0xdfc0fb148a3b8ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3b8a6 expref: 15 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.838905:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485898 00000100:00100000:0.0:1713481296.838909:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2391:18937:x1796714882511936:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:1.0:1713481296.838909:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c261c0/0xdfc0fb148a3ba74 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b21 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.838914:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.838914:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784538752:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.838916:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:3.0:1713481296.838918:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.838920:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092f861c0/0xdfc0fb148a3ba7b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b28 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.838925:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.838927:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880121cdcd80/0xdfc0fb14894218e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03db expref: 20729 pid: 15559 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.838932:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.838934:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.838934:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1960:x1796714882509888:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5583us (5615us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.838937:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c261c0/0xdfc0fb148a3ba74 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b21 expref: 16920 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.838940:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820556 00000100:00100000:3.0:1713481296.838942:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0001-mdtlov_UUID+14:3491:x1796714784541440:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.838948:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98382 00010000:00010000:0.0:1713481296.838949:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.838951:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880121cdcd80/0xdfc0fb14894218e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03db expref: 20729 pid: 15559 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.838955:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.838959:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.838959:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880121cdcd80/0xdfc0fb14894218e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03db expref: 20729 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.838964:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.838967:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009090d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784541504:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.838968:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.838971:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:1.0:1713481296.838982:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3d540 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.838994:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3ba90 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.838997:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784541568:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.838999:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3ba90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839004:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3ba90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.839006:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784538880:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.839013:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:0.0:1713481296.839024:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x347f:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.839027:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713481296.839029:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784541568 00010000:00010000:3.0:1713481296.839030:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.839033:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784541440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.839033:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784541568 00000004:00010000:0.0:1713481296.839035:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3ba90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839041:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839046:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00000100:00100000:2.0:1713481296.839050:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563435 00010000:00010000:0.0:1713481296.839051:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.839051:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3493:1796714784541376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.839054:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009232b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2849:3491:x1796714784541568:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.839056:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839060:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fde98c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.839062:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00002000:00080000:2.0:1713481296.839063:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43507 count 1 00010000:00010000:0.0:1713481296.839067:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839073:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:2.0:1713481296.839073:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.839075:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.839076:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839080:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde98c0/0xdfc0fb148a3ba82 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.839080:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084857180/0xdfc0fb1486894e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ff expref: 26817 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.839084:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.839086:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.839087:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.839089:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839093:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839096:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.839097:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084857180/0xdfc0fb1486894e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ff expref: 26817 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.839098:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fdeba80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.839099:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839102:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839105:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff880122555500) 00010000:00010000:0.0:1713481296.839106:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.839106:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084857180/0xdfc0fb1486894e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ff expref: 26817 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.839107:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.839110:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3ba89 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:2.0:1713481296.839112:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081eced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784541632:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.839150:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092f861c0/0xdfc0fb148a3ba7b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b28 expref: 2393 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.839153:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009af53480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.839159:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.839160:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3ba90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b28 expref: 2392 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.839163:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:0.0:1713481296.839164:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713481296.839166:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fde9d40, rc 0) 00000100:00100000:0.0:1713481296.839178:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18937:x1796714882511936:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 268us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.839184:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485898 00000100:00100000:0.0:1713481296.839199:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512064 00000100:00100000:0.0:1713481296.839202:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512064 00000100:00100000:2.0:1713481296.839219:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784539392:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.839220:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485899 00000100:00100000:1.0:1713481296.839221:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.839225:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2204:18948:x1796714882512064:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.839232:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.839236:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.839240:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3ba9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b2f expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.839249:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.839253:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512192 00000100:00100000:2.0:1713481296.839255:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512192 00000100:00100000:2.0:1713481296.839273:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563436 00000100:00100000:2.0:1713481296.839277:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16921:18844:x1796714882512192:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.839283:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.839284:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.839290:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.839293:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120baeac0/0xdfc0fb148a3baac lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b36 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.839295:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.839296:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.839298:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512256 00000100:00100000:3.0:1713481296.839301:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512256 00010000:00010000:0.0:1713481296.839302:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00002000:00010000:2.0:1713481296.839304:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.839309:0:10467:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3ba19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3b9f6 expref: 13 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.839311:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511808 00010000:00010000:2.0:1713481296.839313:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.839315:0:10467:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.839315:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511808 00010000:00010000:2.0:1713481296.839315:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.839315:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485900 00010000:00010000:2.0:1713481296.839318:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120baeac0/0xdfc0fb148a3baac lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b36 expref: 16922 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.839319:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18918:x1796714882512256:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:2.0:1713481296.839324:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120baeac0/0xdfc0fb148a3baac lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b36 expref: 16922 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839325:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.839327:0:10467:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3ba19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdfc0fb148a3b9f6 expref: 13 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839327:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820f7cc0/0xdfc0fb148a13f1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3801f expref: 24481 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839333:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077a83100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10467:1796714784541696:0@lo:104: 00010000:00010000:2.0:1713481296.839333:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120baeac0, rc 0) 00010000:00010000:3.0:1713481296.839333:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3baba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b3d expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.839343:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820573 00000100:00100000:2.0:1713481296.839344:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16922:18844:x1796714882512192:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.839347:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1957:x1796714882511808:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.839347:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563436 00000100:00100000:0.0:1713481296.839349:0:10467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.839353:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.839362:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820f7cc0/0xdfc0fb148a13f1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3801f expref: 24481 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839366:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9bd80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.839369:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820f7cc0/0xdfc0fb148a13f1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3801f expref: 24481 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839374:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784541696 00000100:00100000:0.0:1713481296.839376:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784541696 00010000:00010000:1.0:1713481296.839384:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820f7cc0/0xdfc0fb148a13f1f lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3801f expref: 24481 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839384:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bac1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.839389:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20400 00010000:00010000:3.0:1713481296.839390:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bac1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.839392:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10467:x1796714784541696:12345-0@lo:104: 00010000:00010000:1.0:1713481296.839395:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839395:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bac1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.839397:0:6917:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839397:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.839400:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0c4240/0xdfc0fb148a3b9e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b05 expref: 24480 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839404:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0c4240/0xdfc0fb148a3b9e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b05 expref: 24480 pid: 15562 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.839409:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3431:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.839411:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.839416:0:6917:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1713481296.839417:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007b0c4240/0xdfc0fb148a3b9e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b05 expref: 24480 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.839419:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10467:x1796714784541696:12345-0@lo:104: Request processed in 27us (70us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.839421:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713481296.839422:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16580:1796714784541760:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.839423:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20400 00010000:00010000:2.0:1713481296.839424:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839428:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124311f80 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:3.0:1713481296.839428:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3baba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b3d expref: 2394 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839430:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.839433:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099fafcc0 going to sleep for 11 seconds 00000004:00010000:2.0:1713481296.839434:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839442:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bac1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b3d expref: 2393 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839444:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839447:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713481296.839447:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff8800898d4a00) 00010000:00010000:3.0:1713481296.839448:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.839450:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffa0240, rc 0) 00010000:00010000:2.0:1713481296.839456:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839460:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880124311f80/0xdfc0fb148a3b9f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdfc0fb148a3ba19 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.839462:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2393:18918:x1796714882512256:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 143us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.839465:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485900 00010000:00010000:2.0:1713481296.839471:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.839472:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.839473:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.839480:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784541824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.839484:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.839490:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077a83100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10467:1796714784541696:0@lo:104: 00000100:00100000:3.0:1713481296.839497:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784539584:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.839498:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512000 00010000:00010000:0.0:1713481296.839499:0:10467:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.839501:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512000 00000100:00100000:2.0:1713481296.839501:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.839511:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839512:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941eb840/0xdfc0fb1486894cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30c7 expref: 26818 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839519:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.839529:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784541824 00000100:00100000:1.0:1713481296.839530:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512320 00000100:00100000:3.0:1713481296.839530:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122b20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784539328:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.839531:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784541824 00000100:00100000:0.0:1713481296.839532:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.839532:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512320 00010000:00010000:2.0:1713481296.839538:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3ba19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdfc0fb148a3b9f6 expref: 14 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.839541:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.839541:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800801446c0/0xdfc0fb148802f54 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ff8 expref: 20730 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.839548:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511872 00000100:00100000:2.0:1713481296.839550:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511872 00000100:00100000:0.0:1713481296.839551:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.839552:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839556:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008807d440/0xdfc0fb148802f38 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fc0 expref: 20731 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.839559:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512128 00000100:00100000:1.0:1713481296.839561:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512128 00000100:00100000:2.0:1713481296.839562:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512384 00000100:00100000:2.0:1713481296.839564:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512384 00000100:00100000:3.0:1713481296.839568:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820574 00010000:00010000:1.0:1713481296.839569:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbd3840/0xdfc0fb148802f4d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fea expref: 20732 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839569:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135482d00/0xdfc0fb1486894d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30d5 expref: 26819 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839572:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820575 00000100:00100000:3.0:1713481296.839572:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26819:1957:x1796714882512000:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.839576:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0001-mdtlov_UUID+14:3492:x1796714784541824:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.839577:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820576 00010000:00010000:3.0:1713481296.839579:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.839580:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20732:1957:x1796714882512320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.839581:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.839581:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820577 00010000:00010000:3.0:1713481296.839582:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941eb840/0xdfc0fb1486894cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30c7 expref: 26819 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.839585:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20732:1957:x1796714882511872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.839585:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.839587:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800801446c0/0xdfc0fb148802f54 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ff8 expref: 20732 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839589:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941eb840/0xdfc0fb1486894cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30c7 expref: 26819 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839591:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.839593:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800801446c0/0xdfc0fb148802f54 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ff8 expref: 20732 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839594:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008807d440/0xdfc0fb148802f38 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fc0 expref: 20732 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839602:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008807d440/0xdfc0fb148802f38 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fc0 expref: 20732 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839602:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941eb840/0xdfc0fb1486894cc lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30c7 expref: 26819 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839606:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800801446c0/0xdfc0fb148802f54 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x274f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962ff8 expref: 20732 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839609:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.839610:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.839611:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839613:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839615:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008807d440/0xdfc0fb148802f38 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x274b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fc0 expref: 20731 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839616:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.839617:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839617:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839619:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.839620:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.839623:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.839623:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839624:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.839626:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839629:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.839633:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.839636:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.839636:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.839641:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26818:1957:x1796714882512000:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.839646:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820574 00000100:00100000:2.0:1713481296.839647:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20730:1957:x1796714882512320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.839648:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.839649:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.839651:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820576 00000100:00100000:0.0:1713481296.839657:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.839660:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20729:1957:x1796714882511872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.839662:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511424 00000100:00100000:2.0:1713481296.839677:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511552 00000100:00100000:1.0:1713481296.839679:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820577 00000100:00100000:2.0:1713481296.839679:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511552 00000100:00100000:0.0:1713481296.839680:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.839680:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511424 00000100:00100000:0.0:1713481296.839688:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.839691:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c7c000/0xdfc0fb1486894b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ab expref: 26818 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839691:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801236773c0/0xdfc0fb148802f3f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fce expref: 20729 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.839694:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511680 00000100:00100000:0.0:1713481296.839696:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.839696:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511680 00010000:00010000:1.0:1713481296.839703:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c7c240/0xdfc0fb1486894c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30b9 expref: 26819 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.839704:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511488 00000100:00100000:0.0:1713481296.839705:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.839705:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882511616 00000100:00100000:3.0:1713481296.839706:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511488 00000100:00100000:2.0:1713481296.839707:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882511616 00000100:00100000:1.0:1713481296.839710:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512448 00000100:00100000:1.0:1713481296.839712:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512448 00010000:00010000:3.0:1713481296.839713:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135480900/0xdfc0fb1486894a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d309d expref: 26820 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839716:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123677180/0xdfc0fb148802f5b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963006 expref: 20731 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839716:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099264fc0/0xdfc0fb148802f46 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fdc expref: 20731 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839720:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.839723:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820578 00000100:00100000:3.0:1713481296.839727:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26820:1957:x1796714882512384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.839728:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.839728:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512704 00000100:00100000:1.0:1713481296.839730:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512704 00010000:00010000:3.0:1713481296.839732:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.839733:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820579 00010000:00010000:1.0:1713481296.839735:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135480240/0xdfc0fb1486894da lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30e3 expref: 26821 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839735:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135482d00/0xdfc0fb1486894d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30d5 expref: 26821 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839737:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.839737:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20731:1957:x1796714882512128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.839742:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135482d00/0xdfc0fb1486894d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30d5 expref: 26821 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839744:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.839745:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512896 00000100:00100000:1.0:1713481296.839745:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820580 00000100:00100000:0.0:1713481296.839747:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512896 00000100:00100000:1.0:1713481296.839748:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26821:1959:x1796714882511552:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.839748:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbd3840/0xdfc0fb148802f4d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fea expref: 20731 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839752:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.839754:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135482d00/0xdfc0fb1486894d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30d5 expref: 26821 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839755:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c7c000/0xdfc0fb1486894b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ab expref: 26821 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839758:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbd3840/0xdfc0fb148802f4d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fea expref: 20731 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839759:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125699 00010000:00010000:1.0:1713481296.839760:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c7c000/0xdfc0fb1486894b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ab expref: 26820 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.839762:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2047:18678:x1796714882512896:12345-192.168.202.24@tcp:35:rm.0 00010000:00010000:3.0:1713481296.839767:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839767:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839769:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839771:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd3840/0xdfc0fb148802f4d lrc: 0/0,0 mode: --/PR res: [0x280000408:0x274e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fea expref: 20731 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839772:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c7c000/0xdfc0fb1486894b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ab expref: 26820 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839774:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839781:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.839782:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.839784:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839784:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.839785:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839787:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.839788:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839789:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839794:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.839797:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26819:1957:x1796714882512384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (245us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.839801:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.839801:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820578 00000100:00100000:1.0:1713481296.839811:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26819:1959:x1796714882511552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (174us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.839813:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.839815:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820580 00000100:00100000:3.0:1713481296.839820:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820581 00000100:00100000:3.0:1713481296.839823:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20730:1959:x1796714882511424:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.839826:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2048:18678:x1796714882512896:12345-192.168.202.24@tcp:35:rm.0 Request processed in 62us (88us total) trans 4295107621 rc 0/0 00000100:00100000:1.0:1713481296.839827:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820582 00010000:00010000:3.0:1713481296.839827:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.839830:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125699 00000100:00100000:1.0:1713481296.839830:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26817:1959:x1796714882511680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.839830:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20730:1957:x1796714882512128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (287us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.839830:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801236773c0/0xdfc0fb148802f3f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fce expref: 20730 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839833:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.839836:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c7c240/0xdfc0fb1486894c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30b9 expref: 26817 pid: 16525 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.839836:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820579 00010000:00010000:3.0:1713481296.839837:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801236773c0/0xdfc0fb148802f3f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fce expref: 20730 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839842:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c7c240/0xdfc0fb1486894c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30b9 expref: 26817 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.839846:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839849:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801236773c0/0xdfc0fb148802f3f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x274c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fce expref: 20730 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839852:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c7c240/0xdfc0fb1486894c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30b9 expref: 26817 pid: 16525 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.839853:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839858:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.839858:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820583 00010000:00010000:1.0:1713481296.839859:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839859:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.839860:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839860:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839860:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.839862:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26816:1959:x1796714882511488:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.839862:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839864:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.839866:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839866:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839870:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.839873:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.839874:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135480900/0xdfc0fb1486894a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d309d expref: 26816 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839876:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.839878:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.839880:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26816:1959:x1796714882511680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 50us (231us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.839880:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135480900/0xdfc0fb1486894a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d309d expref: 26816 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.839883:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134639680 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.839884:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820582 00000100:00100000:3.0:1713481296.839885:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20728:1959:x1796714882511424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (274us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.839886:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.839888:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820581 00010000:00010000:0.0:1713481296.839892:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839892:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135480900/0xdfc0fb1486894a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d309d expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.839895:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820584 00000100:00100000:1.0:1713481296.839898:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20727:1959:x1796714882512448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.839899:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820585 00010000:00010000:1.0:1713481296.839902:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.839902:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.839902:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20727:1959:x1796714882511616:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.839903:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.839904:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 2/0,0 mode: --/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839904:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839905:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123677180/0xdfc0fb148802f5b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2750:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963006 expref: 20727 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839907:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.839909:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839910:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123677180/0xdfc0fb148802f5b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2750:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963006 expref: 20727 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.839911:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134639680/0xdfc0fb148a3b9ef lrc: 0/0,0 mode: --/PW res: [0x280000408:0x274e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839911:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099264fc0/0xdfc0fb148802f46 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x274d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fdc expref: 20727 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.839917:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099264fc0/0xdfc0fb148802f46 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x274d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fdc expref: 20727 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839922:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123677180/0xdfc0fb148802f5b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2750:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963006 expref: 20727 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839922:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.839929:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099264fc0/0xdfc0fb148802f46 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x274d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f962fdc expref: 20726 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.839931:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.839932:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.839932:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:1959:x1796714882511488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 70us (274us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.839933:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.839936:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820583 00010000:00010000:1.0:1713481296.839937:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839937:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839938:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.839940:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839945:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.839946:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.839953:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:1959:x1796714882512448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (265us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.839954:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.839955:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820586 00000100:00100000:1.0:1713481296.839957:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820584 00000100:00100000:2.0:1713481296.839958:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26813:1958:x1796714882512704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.839961:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.839962:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:1959:x1796714882511616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (282us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.839964:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135480240/0xdfc0fb1486894da lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30e3 expref: 26813 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.839966:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820585 00010000:00010000:2.0:1713481296.839970:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135480240/0xdfc0fb1486894da lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30e3 expref: 26813 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.839976:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.839978:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.839979:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839983:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839984:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.839988:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.839990:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.839993:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.839997:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26813:1958:x1796714882512704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 39us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.839997:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840000:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820586 00010000:00010000:3.0:1713481296.840004:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840008:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a826f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.840010:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840014:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840020:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840021:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512576 00000100:00100000:2.0:1713481296.840022:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512576 00010000:00010000:3.0:1713481296.840024:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a826f40/0xdfc0fb148a3b9e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840032:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+257:3492:x1796714784538688:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6540us (6610us total) trans 4296040920 rc 0/0 00000100:00100000:2.0:1713481296.840032:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512640 00000100:00100000:2.0:1713481296.840033:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512640 00000100:00100000:0.0:1713481296.840037:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563423 00000100:00100000:2.0:1713481296.840042:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512768 00000100:00100000:2.0:1713481296.840043:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512768 00000100:00100000:0.0:1713481296.840049:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563437 00000100:00100000:0.0:1713481296.840052:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:17924:x1796714882512576:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.840052:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563438 00000100:00100000:2.0:1713481296.840055:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26813:17935:x1796714882512640:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.840057:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.840060:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.840064:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148a3bac8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b4b expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840066:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120baed00/0xdfc0fb148a3bacf lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb79a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b52 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.840075:0:15510:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb79a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.840078:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081e52640/0xdfc0fb148a15fe8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39852 expref: 20726 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.840081:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.840081:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.840082:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.840083:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.840084:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120baed00/0xdfc0fb148a3bacf lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b52 expref: 26814 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.840085:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148a3bac8 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b4b expref: 20726 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840090:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120baed00/0xdfc0fb148a3bacf lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b52 expref: 26814 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.840095:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081e52640/0xdfc0fb148a15fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39852 expref: 20726 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.840095:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120baed00, rc 0) 00010000:00010000:0.0:1713481296.840100:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081e52640/0xdfc0fb148a15fe8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39852 expref: 20726 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.840103:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:17935:x1796714882512640:12345-192.168.202.24@tcp:101:dd.0 Request processed in 47us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.840106:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784541888:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.840106:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563438 00000100:00100000:0.0:1713481296.840116:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.840117:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563439 00000100:00100000:2.0:1713481296.840137:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20726:15045:x1796714882512768:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.840142:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.840149:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120baef40/0xdfc0fb148a3bad6 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b59 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.840151:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c34380/2, rc 0, transno 1073624 00002000:00010000:2.0:1713481296.840156:0:15510:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.840158:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784538688:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.840162:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.840163:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.840164:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2850:3492:x1796714784538816:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6668us (6716us total) trans 4295960793 rc 0/0 00010000:00010000:2.0:1713481296.840165:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120baef40/0xdfc0fb148a3bad6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b59 expref: 20727 pid: 15510 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.840167:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c36680/2, rc 0, transno 993497 00000100:00100000:3.0:1713481296.840169:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563424 00000100:00100000:0.0:1713481296.840171:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784538816:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.840171:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880120baef40/0xdfc0fb148a3bad6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b59 expref: 20727 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840175:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120baef40, rc 0) 00000100:00100000:2.0:1713481296.840184:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20727:15045:x1796714882512768:12345-192.168.202.24@tcp:101:dd.0 Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.840188:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563439 00000100:00100000:3.0:1713481296.840189:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512512 00000100:00100000:3.0:1713481296.840191:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512512 00000100:00100000:3.0:1713481296.840203:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485901 00010000:00010000:2.0:1713481296.840204:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840205:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784542016:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.840206:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2393:18933:x1796714882512512:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1713481296.840211:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840212:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.840218:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840219:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3badd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b44 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840220:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.840224:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840231:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840236:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099da6640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.840239:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840240:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784541952:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.840246:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840248:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.840263:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840263:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.840268:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840268:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135480240/0xdfc0fb1486894da lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30e3 expref: 26813 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.840269:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099da6640/0xdfc0fb148a3b9be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.840272:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.840276:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.840277:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784540160:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.840280:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840280:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6640/0xdfc0fb148a3bae4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.840283:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708d440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.840285:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.840288:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840288:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6640/0xdfc0fb148a3bae4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.840295:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.840296:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840296:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6640/0xdfc0fb148a3bae4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.840300:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3b9b7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x274c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840303:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840307:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840311:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840315:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840319:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.840320:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x1cd:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.840322:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a9ba400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.840323:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713481296.840323:0:15642:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1713481296.840327:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840335:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840339:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a9ba400/0xdfc0fb148a3ba43 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840346:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3badd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b44 expref: 2395 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840356:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d6640/0xdfc0fb148a3bae4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1cd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b44 expref: 2394 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840361:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1cd:0x0].0x0 (ffff8800898d4900) 00010000:00010000:3.0:1713481296.840362:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.840364:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c0d6640, rc 0) 00000100:00100000:3.0:1713481296.840376:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2394:18933:x1796714882512512:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 169us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.840379:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485901 00000100:00100000:2.0:1713481296.840386:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2850:3493:x1796714784537984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7947us (8025us total) trans 4295960794 rc 0/0 00000100:00100000:2.0:1713481296.840393:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563417 00010000:00010000:3.0:1713481296.840399:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840404:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840412:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840416:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840420:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542016 00010000:00010000:3.0:1713481296.840420:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840423:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542016 00010000:00010000:3.0:1713481296.840423:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a825680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.840425:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840428:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840437:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784541952 00010000:00010000:3.0:1713481296.840438:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840439:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784541952 00010000:00010000:3.0:1713481296.840441:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a825680/0xdfc0fb148a3b9c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.840446:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2851:3493:x1796714784539776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4761us (5148us total) trans 4295960795 rc 0/0 00000100:00100000:2.0:1713481296.840451:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563440 00000100:00100000:1.0:1713481296.840454:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563428 00000100:00100000:2.0:1713481296.840455:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2851:3490:x1796714784542016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.840465:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43509 count 1 00000100:00100000:1.0:1713481296.840468:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563441 00000100:00100000:1.0:1713481296.840470:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+258:3493:x1796714784541952:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.840474:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.840478:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10067 count 1 00010000:00010000:2.0:1713481296.840484:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c7dd40/0xdfc0fb1486894ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d310d expref: 26812 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.840486:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840489:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.840491:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.840493:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080144240/0xdfc0fb148802f70 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963030 expref: 20726 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.840493:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840497:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.840498:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.840499:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840506:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c7dd40/0xdfc0fb1486894ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d310d expref: 26812 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.840509:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080144240/0xdfc0fb148802f70 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963030 expref: 20726 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.840513:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c7dd40/0xdfc0fb1486894ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d310d expref: 26812 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.840514:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080144240/0xdfc0fb148802f70 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963030 expref: 20726 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.840520:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784542144:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.840522:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784542080:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.840531:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008344bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.840539:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e000 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.840547:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840551:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.840551:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2851:3493:x1796714784537920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8100us (8141us total) trans 4295960796 rc 0/0 00010000:00010000:1.0:1713481296.840555:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.840556:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563418 00010000:00010000:1.0:1713481296.840559:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840561:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840563:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840566:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b0c73c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.840567:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840568:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840571:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840575:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840577:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840579:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840581:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840582:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840583:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b0c73c0/0xdfc0fb148a3b9d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840587:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840587:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840590:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840593:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b0c7180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.840594:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840596:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840597:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d8f9b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.840599:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840602:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840603:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840609:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840613:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840613:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3ba20 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840619:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b0c7180/0xdfc0fb148a3ba0b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x274f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840679:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+259:3490:x1796714784537856:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8332us (8380us total) trans 4296040921 rc 0/0 00000100:00100000:0.0:1713481296.840684:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563416 00000100:00100000:1.0:1713481296.840692:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2851:3490:x1796714784538432:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7834us (7908us total) trans 4295960797 rc 0/0 00000100:00100000:1.0:1713481296.840697:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563420 00000004:00080000:0.0:1713481296.840711:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077af3480/2, rc 0, transno 993499 00000100:00100000:0.0:1713481296.840715:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784539776:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.840718:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.840721:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e317480/2, rc 0, transno 993500 00000100:00100000:0.0:1713481296.840723:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784537920:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.840723:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840727:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840730:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.840731:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e317b80/2, rc 0, transno 993498 00000100:00100000:0.0:1713481296.840734:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784537984:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.840734:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840737:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099da4000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.840739:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840742:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.840745:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+259:3492:x1796714784539520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5872us (5915us total) trans 4296040922 rc 0/0 00010000:00010000:1.0:1713481296.840750:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.840751:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563427 00010000:00010000:1.0:1713481296.840754:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099da4000/0xdfc0fb148a3b9b0 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x274b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840760:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+259:3491:x1796714784539200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6332us (6448us total) trans 4296040923 rc 0/0 00000100:00100000:2.0:1713481296.840768:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563425 00010000:00010000:3.0:1713481296.840772:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840777:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.840780:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c35180/2, rc 0, transno 993501 00010000:00010000:3.0:1713481296.840782:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840785:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840786:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784538432:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.840789:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840792:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d8f8fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.840793:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840795:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.840796:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e315880/2, rc 0, transno 1073625 00010000:00010000:3.0:1713481296.840797:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840800:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784537856:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.840803:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1713481296.840803:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840805:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840808:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784542208:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.840809:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3ba12 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840810:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840816:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840822:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840827:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b0c4d80 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.840828:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.840830:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840836:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.840842:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+258:3490:x1796714784537792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8521us (8581us total) trans 4296040924 rc 0/0 00000004:00080000:0.0:1713481296.840845:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e315500/2, rc 0, transno 1073628 00000100:00100000:1.0:1713481296.840846:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563415 00000100:00100000:0.0:1713481296.840847:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784537792:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.840849:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 2/0,0 mode: --/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.840856:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b0c4d80/0xdfc0fb148a3b9cc lrc: 0/0,0 mode: --/PW res: [0x280000408:0x274d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.840860:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542208 00000100:00100000:1.0:1713481296.840862:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542208 00000100:00100000:1.0:1713481296.840873:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563442 00000100:00100000:0.0:1713481296.840875:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784542336:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.840876:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2852:3490:x1796714784542208:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.840883:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43510 count 1 00000100:00100000:0.0:1713481296.840886:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.840890:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.840897:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084857cc0/0xdfc0fb1486894f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d311b expref: 26812 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.840899:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:1.0:1713481296.840901:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.840902:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.840904:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784542272:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.840904:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.840910:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2852:3491:x1796714784539264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6414us (6550us total) trans 4295960798 rc 0/0 00010000:00010000:1.0:1713481296.840913:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084857cc0/0xdfc0fb1486894f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d311b expref: 26812 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.840915:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563426 00010000:00010000:1.0:1713481296.840918:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084857cc0/0xdfc0fb1486894f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d311b expref: 26812 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.840922:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.840924:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784542592:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.840929:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542336 00000100:00100000:3.0:1713481296.840931:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542336 00000100:00100000:1.0:1713481296.840935:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096236840 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.840942:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800772f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784542528:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.840942:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542272 00000100:00100000:3.0:1713481296.840943:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542272 00000100:00100000:1.0:1713481296.840948:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563443 00000100:00100000:1.0:1713481296.840952:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800772f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2853:3493:x1796714784542336:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.840956:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563444 00000100:00100000:0.0:1713481296.840958:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1713481296.840958:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43514 count 1 00000100:00100000:3.0:1713481296.840959:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800772f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2853:3493:x1796714784542272:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.840965:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.840969:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43512 count 1 00010000:00010000:1.0:1713481296.840971:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c7eac0/0xdfc0fb1486894fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3137 expref: 26812 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.840974:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.840975:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.840976:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.840977:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.840979:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+258:3491:x1796714784538176:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8365us (8430us total) trans 4296040925 rc 0/0 00000100:00100000:0.0:1713481296.840982:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800772f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784542464:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.840984:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fa6f40/0xdfc0fb148689504 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3129 expref: 26812 pid: 16491 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.840985:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c7eac0/0xdfc0fb1486894fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3137 expref: 26812 pid: 16509 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.840985:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563419 00010000:00010000:3.0:1713481296.840988:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.840989:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.840990:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c7eac0/0xdfc0fb1486894fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3137 expref: 26812 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.840991:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.840995:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.840995:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007712b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784542656:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.840999:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542528 00000100:00100000:2.0:1713481296.841001:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542528 00010000:00010000:3.0:1713481296.841002:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fa6f40/0xdfc0fb148689504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3129 expref: 26812 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.841006:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086caed80 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.841007:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fa6f40/0xdfc0fb148689504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3129 expref: 26812 pid: 16491 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.841011:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542464 00000004:00080000:0.0:1713481296.841012:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077af0a80/2, rc 0, transno 993502 00000100:00100000:2.0:1713481296.841012:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542464 00000100:00100000:0.0:1713481296.841017:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784539264:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.841018:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784542720:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.841020:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563445 00000100:00100000:2.0:1713481296.841022:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2854:3493:x1796714784542528:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.841024:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122b22680/2, rc 0, transno 1073627 00000100:00100000:0.0:1713481296.841029:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784539200:0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.841030:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43517 count 1 00000100:00100000:3.0:1713481296.841031:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503600 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.841038:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.841040:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ee5dc00/2, rc 0, transno 1073629 00000100:00100000:0.0:1713481296.841041:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784538176:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.841046:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.841048:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563446 00000100:00100000:0.0:1713481296.841049:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784542400:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.841049:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800831baac0/0xdfc0fb14868950b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3145 expref: 26812 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.841051:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+258:3491:x1796714784542464:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.841055:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.841057:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.841059:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.841059:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10069 count 1 00000100:00100000:0.0:1713481296.841062:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.841066:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.841073:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099265b00/0xdfc0fb148802f7e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96304c expref: 20726 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.841076:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800831baac0/0xdfc0fb14868950b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3145 expref: 26812 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.841077:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.841078:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.841080:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.841089:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099265b00/0xdfc0fb148802f7e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96304c expref: 20726 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.841090:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800831baac0/0xdfc0fb14868950b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3145 expref: 26812 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.841095:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099265b00/0xdfc0fb148802f7e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96304c expref: 20726 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.841099:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784542784:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.841100:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784542912:192.168.202.24@tcp:104: 00000004:00080000:0.0:1713481296.841104:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122b21c00/2, rc 0, transno 1073626 00000100:00100000:0.0:1713481296.841107:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784539520:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.841109:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.841110:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.841113:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007719b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784542848:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.841116:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.841136:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542400 00000100:00100000:0.0:1713481296.841139:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.841139:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542400 00000100:00100000:2.0:1713481296.841151:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542848 00000100:00100000:3.0:1713481296.841152:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563447 00000100:00100000:2.0:1713481296.841154:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542848 00000100:00100000:3.0:1713481296.841155:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007719b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+259:3491:x1796714784542400:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.841162:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10068 count 1 00000100:00100000:0.0:1713481296.841164:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784542976:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.841169:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.841172:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563448 00000100:00100000:0.0:1713481296.841174:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.841177:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+260:3492:x1796714784542848:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.841177:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123676400/0xdfc0fb148802f77 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96303e expref: 20726 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.841181:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.841182:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.841183:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.841189:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10070 count 1 00010000:00010000:3.0:1713481296.841192:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123676400/0xdfc0fb148802f77 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96303e expref: 20726 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.841193:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784542976 00000100:00100000:1.0:1713481296.841196:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784542976 00010000:00010000:3.0:1713481296.841196:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123676400/0xdfc0fb148802f77 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96303e expref: 20726 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.841198:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.841199:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.841202:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784543040:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.841203:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784543168:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.841208:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd0b40/0xdfc0fb148802f85 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96305a expref: 20726 pid: 16489 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.841212:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.841213:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563449 00010000:00010000:2.0:1713481296.841213:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.841214:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.841216:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503540 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.841217:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.841218:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007719a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+261:3490:x1796714784542976:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.841226:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784543040 00002000:00080000:1.0:1713481296.841227:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10071 count 1 00000100:00100000:3.0:1713481296.841228:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784543040 00010000:00010000:2.0:1713481296.841232:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbd0b40/0xdfc0fb148802f85 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96305a expref: 20726 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.841237:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.841240:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbd0b40/0xdfc0fb148802f85 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96305a expref: 20726 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.841240:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563450 00000100:00100000:3.0:1713481296.841243:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2855:3490:x1796714784543040:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.841245:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012432d440/0xdfc0fb148802f8c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963068 expref: 20726 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.841249:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713481296.841249:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43519 count 1 00010000:00010000:1.0:1713481296.841250:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.841251:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.841254:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784543104:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.841254:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784543232:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.841257:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.841263:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012432d440/0xdfc0fb148802f8c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963068 expref: 20726 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.841265:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c7c6c0/0xdfc0fb148689512 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3153 expref: 26812 pid: 16509 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.841266:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.841268:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012432d440/0xdfc0fb148802f8c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963068 expref: 20726 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.841269:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.841270:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ef00 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.841270:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.841272:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.841274:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784543296:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.841281:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c7c6c0/0xdfc0fb148689512 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3153 expref: 26812 pid: 16509 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.841285:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc34600 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.841286:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c7c6c0/0xdfc0fb148689512 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3153 expref: 26812 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.841288:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784543104 00000100:00100000:2.0:1713481296.841291:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784543104 00000100:00100000:3.0:1713481296.841292:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784543360:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.841303:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.841303:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.841309:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563451 00000100:00100000:2.0:1713481296.841313:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007719aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+262:3492:x1796714784543104:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.841315:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.841318:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882512960 00000100:00100000:3.0:1713481296.841319:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882512960 00002000:00080000:2.0:1713481296.841323:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10072 count 1 00000100:00100000:1.0:1713481296.841331:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513024 00000100:00100000:3.0:1713481296.841332:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485902 00000100:00100000:0.0:1713481296.841333:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.841333:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.841334:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513024 00000100:00100000:3.0:1713481296.841335:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2048:18604:x1796714882512960:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:3.0:1713481296.841340:0:15577:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.841341:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513088 00010000:00010000:2.0:1713481296.841343:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099266f40/0xdfc0fb148802f93 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963076 expref: 20727 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.841344:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513088 00010000:00010000:3.0:1713481296.841345:0:15577:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3bb3f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b60 expref: -99 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.841349:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.841350:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.841351:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563452 00010000:00010000:2.0:1713481296.841353:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.841356:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125700 00000100:00100000:1.0:1713481296.841356:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20727:18792:x1796714882513024:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.841359:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18991:x1796714882513088:12345-192.168.202.24@tcp:33:lfs.0 00010000:00010000:1.0:1713481296.841366:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.841368:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099266f40/0xdfc0fb148802f93 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963076 expref: 20727 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.841375:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b185440/0xdfc0fb148a3bb46 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc525:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b67 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.841377:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099266f40/0xdfc0fb148802f93 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963076 expref: 20727 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.841385:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784543424:192.168.202.24@tcp:104: 00002000:00010000:1.0:1713481296.841386:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc525:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.841393:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.841394:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.841396:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:1.0:1713481296.841398:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b185440/0xdfc0fb148a3bb46 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc525:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b67 expref: 20728 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.841402:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013045e180 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.841402:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:1.0:1713481296.841406:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b185440/0xdfc0fb148a3bb46 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc525:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b67 expref: 20728 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.841407:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:1.0:1713481296.841413:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b185440, rc 0) 00010000:00010000:3.0:1713481296.841414:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.841418:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841421:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:1.0:1713481296.841425:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20728:18792:x1796714882513024:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 69us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.841430:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563452 00000004:00200000:0.0:1713481296.841445:0:15487:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2ca1:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.841448:0:15487:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713481296.841452:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123674240/0xdfc0fb148a3bb5b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:3.0:1713481296.841456:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123674240/0xdfc0fb148a3bb5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841459:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123674240/0xdfc0fb148a3bb5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.841467:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18991:x1796714882513088:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 107us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.841471:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125700 00000004:00200000:3.0:1713481296.841473:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3474:0x0]: returning size 4096 00000004:00200000:3.0:1713481296.841474:0:15577:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713481296.841481:0:15577:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880123674240/0xdfc0fb148a3bb5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841486:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841489:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841495:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841499:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841501:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af3cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.841503:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841506:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841510:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.841511:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.841513:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841516:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bb4d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841524:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841527:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841530:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841533:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af1200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.841534:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841540:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841543:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880135a06700) 00010000:00010000:3.0:1713481296.841545:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.841546:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.841548:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079af1200/0xdfc0fb148a3bb54 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.841562:0:6914:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.841567:0:6914:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.841568:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3bb3f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b60 expref: 2050 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.841576:0:15577:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880123674240/0xdfc0fb148a3bb5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b60 expref: 2049 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.841579:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff8800993c6300) 00010000:00010000:3.0:1713481296.841580:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713481296.841581:0:15577:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123674240, rc 0) 00010000:00010000:0.0:1713481296.841584:0:6914:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.841588:0:6914:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713481296.841594:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2049:18604:x1796714882512960:12345-192.168.202.24@tcp:101:rm.0 Request processed in 258us (291us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.841598:0:6914:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011d0f6f40/0xdfc0fb148a3a98e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3a995 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.841598:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485902 00000100:00100000:1.0:1713481296.841600:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.841618:0:6914:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009e69c240/0xdfc0fb148a38553 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3857d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.841619:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513152 00000100:00100000:1.0:1713481296.841622:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513152 00000004:00010000:0.0:1713481296.841629:0:6914:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009e69c240/0xdfc0fb148a38553 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3857d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.841641:0:6914:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009e69c240/0xdfc0fb148a38553 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3857d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.841646:0:6914:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713481296.841649:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563453 00010000:00010000:0.0:1713481296.841654:0:6914:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009e69c240/0xdfc0fb148a38553 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3857d expref: -99 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.841654:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16922:17009:x1796714882513152:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.841660:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.841682:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800970a6640/0xdfc0fb148a3bb62 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b6e expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1713481296.841687:0:6914:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295105924 is committed 00002000:00010000:1.0:1713481296.841692:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.841700:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.841701:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.841704:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800970a6640/0xdfc0fb148a3bb62 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b6e expref: 16923 pid: 16481 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1713481296.841709:0:6914:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295105923 is committed 00010000:00010000:1.0:1713481296.841713:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800970a6640/0xdfc0fb148a3bb62 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b6e expref: 16923 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.841719:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800970a6640, rc 0) 00010000:00010000:2.0:1713481296.841721:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00000001:00080000:0.0:1713481296.841726:0:6914:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295105920 is committed 00010000:00010000:2.0:1713481296.841729:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.841731:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16923:17009:x1796714882513152:12345-192.168.202.24@tcp:101:dd.0 Request processed in 77us (132us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.841734:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00000100:00100000:1.0:1713481296.841735:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563453 00010000:00010000:2.0:1713481296.841739:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135ac3600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.841742:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.841747:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00000001:00080000:3.0:1713481296.841747:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040906 00010000:00010000:2.0:1713481296.841756:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51fb:0x0].0x0 (ffff88012f10b400) 00010000:00010000:2.0:1713481296.841758:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.841761:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.841765:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ac3600/0xdfc0fb148a388be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x51fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.841790:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841795:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841800:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841808:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007de26880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.841811:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841815:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841820:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385e:0x0].0x38 (ffff880096340700) 00010000:00010000:2.0:1713481296.841822:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.841824:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841828:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007de26880/0xdfc0fb148a3a1a0 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x385e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00002000:00080000:3.0:1713481296.841845:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57426 00010000:00010000:2.0:1713481296.841866:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841871:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841875:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841878:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c1c9b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.841880:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00000020:00080000:0.0:1713481296.841885:0:6914:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 8662 batchid updated 00010000:00010000:2.0:1713481296.841885:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841891:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x385d:0x0].0x38 (ffff88012cf69300) 00010000:00010000:2.0:1713481296.841893:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.841895:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.841900:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c1c9b00/0xdfc0fb148a3a408 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x385d:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.841919:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac4fc0/0xdfc0fb148a39433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.841924:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac4fc0/0xdfc0fb148a39433 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.841927:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.841928:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac4fc0/0xdfc0fb148a39433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.841930:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124ac4fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.841932:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac4fc0/0xdfc0fb148a39433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.841932:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.841935:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac4fc0/0xdfc0fb148a39433 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.841936:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.841940:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086f60480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.841941:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3631 (ffff88009c260d00) 00010000:00010000:2.0:1713481296.841942:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.841943:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.841945:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac4fc0/0xdfc0fb148a39433 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.841946:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.841948:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac4fc0/0xdfc0fb148a39433 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.841952:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b1:0x0].0x31 (ffff88007354db00) 00010000:00010000:2.0:1713481296.841953:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.841955:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.841959:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880121c633c0/0xdfc0fb148a3942c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.841959:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880086f60480/0xdfc0fb148a3a439 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x38b1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.841962:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880121c633c0/0xdfc0fb148a3942c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.841965:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880121c633c0/0xdfc0fb148a3942c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.841968:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121c633c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.841969:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121c633c0/0xdfc0fb148a3942c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.841972:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121c633c0/0xdfc0fb148a3942c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.841976:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x33 (ffff88009c260800) 00010000:00010000:0.0:1713481296.841977:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.841978:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880121c633c0/0xdfc0fb148a3942c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.841981:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121c633c0/0xdfc0fb148a3942c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842004:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac5440/0xdfc0fb148a39441 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x3889:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842007:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac5440/0xdfc0fb148a39441 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x3889:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842011:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac5440/0xdfc0fb148a39441 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x3889:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842013:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124ac5440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.842015:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac5440/0xdfc0fb148a39441 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x3889:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842017:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac5440/0xdfc0fb148a39441 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x3889:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842021:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3889:0x0].0x0 (ffff8800978d7e00) 00010000:00010000:0.0:1713481296.842022:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1713481296.842023:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac5440/0xdfc0fb148a39441 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x3889:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842026:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124ac5440/0xdfc0fb148a39441 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x3889:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.842043:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.842046:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.842048:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842049:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.842051:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008219c000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.842052:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.842053:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842055:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.842059:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842060:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x3866:0x0].0x35 (ffff88007aaaf600) 00010000:00010000:0.0:1713481296.842061:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.842062:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.842063:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800908af840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.842065:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008219c000/0xdfc0fb148a38c4c lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x3866:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.842065:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.842069:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.842076:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x39 (ffff880088059300) 00010000:00010000:2.0:1713481296.842078:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.842080:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.842084:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800908af840/0xdfc0fb148a3a4be lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x230:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.842111:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.842116:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.842139:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.842144:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083acdd40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.842146:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.842150:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.842158:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x38b5:0x0].0x0 (ffff880096325c00) 00010000:00010000:0.0:1713481296.842159:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.842160:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.842162:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.842163:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.842165:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:2.0:1713481296.842166:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083acdd40/0xdfc0fb148a3a566 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x38b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.842168:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085ef9200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.842169:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.842172:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.842177:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x522e:0x0].0x0 (ffff8801314b1200) 00010000:00010000:0.0:1713481296.842178:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.842179:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.842182:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085ef9200/0xdfc0fb148a39a0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x522e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15483 initiator: MDT0 00010000:00010000:0.0:1713481296.842195:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.842199:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.842199:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842202:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.842204:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086831200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.842204:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842206:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.842208:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.842208:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.842211:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708d8c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.842212:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3631 (ffff88009c260d00) 00010000:00010000:0.0:1713481296.842213:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.842214:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.842214:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842216:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880086831200/0xdfc0fb148a3b2fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.842219:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.842225:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x236:0x0].0x3031 (ffff880084acd500) 00010000:00010000:2.0:1713481296.842227:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.842229:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842231:0:3476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.842233:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3b6bc lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x236:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.842234:0:3476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.842237:0:3476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.842239:0:3476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009aac18c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.842241:0:3476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.842246:0:3476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15479 initiator: MDT0 00010000:00010000:0.0:1713481296.842250:0:3476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5230:0x0].0x0 (ffff88009852ee00) 00010000:00010000:0.0:1713481296.842251:0:3476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.842252:0:3476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.842254:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.842255:0:3476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aac18c0/0xdfc0fb148a3b319 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15479 initiator: MDT0 00010000:00010000:2.0:1713481296.842260:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.842266:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.842270:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa15680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.842272:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.842276:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000020:00080000:0.0:1713481296.842278:0:6961:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8662 00010000:00010000:2.0:1713481296.842282:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c4:0x0].0x3631 (ffff88009d34a700) 00010000:00010000:2.0:1713481296.842283:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.842285:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.842289:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007aa15680/0xdfc0fb148a3b940 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x37c4:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000004:00080000:0.0:1713481296.842298:0:6961:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009b96b3c0 with version 16269 00000020:00080000:0.0:1713481296.842302:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8661 cancel update log [0x240000401:0xb7:0x0].640: rc = 0 00010000:00010000:2.0:1713481296.842317:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842322:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00000020:00080000:0.0:1713481296.842325:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8661 cancel update log [0x200000400:0x9e:0x0].1837: rc = 0 00010000:00010000:2.0:1713481296.842326:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842330:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012c2a9680 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.842333:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842337:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842344:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88008bd1d900) 00010000:00010000:2.0:1713481296.842345:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.842347:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842352:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a9680/0xdfc0fb148a3afca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842380:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842385:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842389:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842393:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d76400 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.842395:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842399:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842404:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3431 (ffff88008bd1d500) 00010000:00010000:2.0:1713481296.842406:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.842408:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000004:00080000:0.0:1713481296.842412:0:6961:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800820e7b40 with version 16270 00010000:00010000:2.0:1713481296.842412:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880081d76400/0xdfc0fb148a3afd1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000020:00080000:0.0:1713481296.842414:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8662 cancel update log [0x240000401:0xb7:0x0].641: rc = 0 00000020:00080000:0.0:1713481296.842427:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8662 cancel update log [0x200000400:0x9e:0x0].1838: rc = 0 00010000:00010000:2.0:1713481296.842438:0:3477:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00000020:00080000:0.0:1713481296.842441:0:6961:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8662 00010000:00010000:2.0:1713481296.842444:0:3477:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842449:0:3477:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842452:0:3477:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081d75d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.842454:0:3477:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842458:0:3477:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842464:0:3477:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff88008bd1dc00) 00010000:00010000:2.0:1713481296.842465:0:3477:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1713481296.842467:0:3477:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.842471:0:3477:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880081d75d40/0xdfc0fb148a3afdf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x51f4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.842482:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3ba19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdfc0fb148a3b9f6 expref: 10 pid: 8640 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.842507:0:8638:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88007e4bd780 version 16269 rpc_version 16269 00000020:00100000:2.0:1713481296.842521:0:8638:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713481296.842526:0:8638:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88007866d180 x1796714784543680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713481296.842538:0:16582:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff880083968600) 00000100:00100000:2.0:1713481296.842540:0:8638:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784543680:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713481296.842541:0:16582:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.842545:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.842550:0:16582:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.842567:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.842571:0:8638:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.842585:0:10467:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.842590:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.842591:0:8638:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3d780 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.842599:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:lustre-MDT0001-mdtlov_UUID+9:3492:x1796714784541824:12345-0@lo:103:ldlm_bl.0 Request processed in 3022us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.842605:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820575 00000100:00100000:2.0:1713481296.842617:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784543680 00000100:00100000:2.0:1713481296.842620:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784543680 00000100:00100000:1.0:1713481296.842628:0:10467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784543744:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1713481296.842645:0:10467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.842646:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82947 00000100:00100000:2.0:1713481296.842651:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007866f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+35:8638:x1796714784543680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1713481296.842653:0:10467:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.842676:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784541824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.842676:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784543744 00000100:00100000:1.0:1713481296.842678:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784543744 00000100:00100000:0.0:1713481296.842688:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.842691:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82948 00000100:00100000:0.0:1713481296.842693:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784543488:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1713481296.842694:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+36:10467:x1796714784543744:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1713481296.842707:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.842727:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.842728:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+37:10467:x1796714784543744:12345-0@lo:1000:mdt00_005.0 Request processed in 34us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.842730:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796714784543552:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1713481296.842732:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82948 00000100:00100000:0.0:1713481296.842746:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.842754:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784543488 00000100:00100000:1.0:1713481296.842756:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784543488 00000100:00100000:0.0:1713481296.842764:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784543552 00000100:00100000:0.0:1713481296.842766:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784543552 00000100:00100000:1.0:1713481296.842775:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98383 00000100:00100000:1.0:1713481296.842778:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:lustre-MDT0000-mdtlov_UUID+38:3492:x1796714784543488:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1713481296.842782:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.842782:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007866f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+38:8638:x1796714784543680:12345-0@lo:1000:osp_up1-0.0 Request processed in 129us (210us total) trans 4295107622 rc 0/0 00000100:00100000:2.0:1713481296.842788:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82947 00010000:00010000:1.0:1713481296.842790:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009430d440/0xdfc0fb148a3a995 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x1d3:0x0].0x37 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3a98e expref: 38 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.842801:0:16624:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1d3:0x0].0x37 (ffff880096325400) 00010000:00010000:1.0:1713481296.842807:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.842823:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:lustre-MDT0000-mdtlov_UUID+36:3492:x1796714784543488:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.842827:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98383 00000100:00100000:1.0:1713481296.842838:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98384 00000100:00100000:1.0:1713481296.842840:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:lustre-MDT0000-mdtlov_UUID+35:3491:x1796714784543552:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1713481296.842844:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.842846:0:8638:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784543680:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713481296.842849:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d87d8c0/0xdfc0fb148a3857d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3474:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a38553 expref: 35 pid: 15522 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.842854:0:8638:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88007e4bd780 version 16270 rpc_version 16270 00010000:00010000:1.0:1713481296.842862:0:16624:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x3531 (ffff880086c82400) 00000020:00100000:2.0:1713481296.842865:0:8638:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713481296.842870:0:8638:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88011f84c380 x1796714784543872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1713481296.842873:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.842881:0:8638:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f84c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784543872:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713481296.842915:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784543488:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1713481296.842918:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:lustre-MDT0000-mdtlov_UUID+34:3491:x1796714784543552:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 76us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.842922:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98384 00000100:00100000:2.0:1713481296.842922:0:8638:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.842937:0:8638:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098ec1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.842955:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784543872 00000100:00100000:2.0:1713481296.842957:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784543872 00000100:00100000:1.0:1713481296.842973:0:10467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:10467:1796714784543744:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1713481296.842977:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82949 00000100:00100000:2.0:1713481296.842981:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+34:8638:x1796714784543872:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713481296.842999:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3491:1796714784543552:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1713481296.843009:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800970a4240/0xdfc0fb148a3bb69 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843017:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800970a4240/0xdfc0fb148a3bb69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843021:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800970a4240/0xdfc0fb148a3bb69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000004:00010000:1.0:1713481296.843029:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800970a4240/0xdfc0fb148a3bb69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843035:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843038:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843041:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843044:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843046:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800842e4900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.843048:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843051:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843055:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.843056:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.843058:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843060:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800842e4900/0xdfc0fb148a3baa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843068:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843071:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843074:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843076:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007deb46c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.843077:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843080:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.843083:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff880083968600) 00010000:00010000:1.0:1713481296.843084:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.843085:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.843087:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+35:8638:x1796714784543872:12345-0@lo:1000:osp_up1-0.0 Request processed in 103us (163us total) trans 4295107623 rc 0/0 00010000:00010000:1.0:1713481296.843088:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007deb46c0/0xdfc0fb148a3bab3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.843093:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82949 00010000:00010000:1.0:1713481296.843138:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800978c6640/0xdfc0fb148a3ba9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b2f expref: 2169 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.843141:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784540352:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.843148:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800970a4240/0xdfc0fb148a3bb69 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b2f expref: 2168 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.843151:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d7:0x0].0x0 (ffff880097b2b700) 00010000:00010000:1.0:1713481296.843152:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.843154:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800970a4240, rc 0) 00000100:00100000:2.0:1713481296.843156:0:8638:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f84c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784543872:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1713481296.843166:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.843174:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e726a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784540800:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.843195:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.843196:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16922:1959:x1796714882510976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5966us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.843197:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784540992:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.843207:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820564 00010000:00010000:0.0:1713481296.843212:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.843218:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2168:18948:x1796714882512064:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 3993us (4060us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.843222:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485899 00000100:00100000:1.0:1713481296.843247:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784541056:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.843250:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784540416:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.843264:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.843269:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.843306:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:1959:x1796714882511104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5937us (6210us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.843313:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820567 00000100:00100000:2.0:1713481296.843351:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784541248:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.843363:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.843376:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784541312:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.843377:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513216 00000100:00100000:0.0:1713481296.843380:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513216 00010000:00010000:2.0:1713481296.843381:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.843384:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009090d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784541504:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.843399:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c261c0/0xdfc0fb148a3ba74 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b21 expref: 16922 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.843401:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.843406:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c261c0, rc 0) 00000100:00100000:2.0:1713481296.843406:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16922:1959:x1796714882511040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5184us (5285us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.843414:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820571 00000100:00100000:1.0:1713481296.843420:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16922:11388:x1796714882511744:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4527us (4604us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.843420:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20727:1959:x1796714882511232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5113us (5155us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.843424:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563434 00000100:00100000:3.0:1713481296.843427:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820572 00000100:00100000:0.0:1713481296.843432:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563454 00000100:00100000:0.0:1713481296.843436:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16920:8499:x1796714882513216:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.843442:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.843449:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b088240/0xdfc0fb148a3bb70 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b75 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.843460:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c3321c0/0xdfc0fb1488e7ebc lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5533 expref: 16921 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.843464:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.843465:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.843467:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b088240/0xdfc0fb148a3bb70 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b75 expref: 16921 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.843467:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081eced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784541632:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.843468:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.843477:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c3321c0/0xdfc0fb1488e7ebc lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5533 expref: 16921 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.843481:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c3321c0/0xdfc0fb1488e7ebc lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5533 expref: 16921 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.843487:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132b43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784543936:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.843501:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.843503:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.843526:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513280 00000100:00100000:2.0:1713481296.843529:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513280 00000100:00100000:2.0:1713481296.843547:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563455 00000100:00100000:2.0:1713481296.843551:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:10409:x1796714882513280:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.843559:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.843569:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009053f180/0xdfc0fb148a3bb77 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b7c expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.843569:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16568:1796714784541120:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.843585:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096bae1c0/0xdfc0fb14891d174 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca724 expref: 24482 pid: 16526 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.843586:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784541184:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.843588:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.843594:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cafed00/0xdfc0fb14893abbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f1 expref: 26811 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.843598:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.843600:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.843603:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009053f180/0xdfc0fb148a3bb77 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b7c expref: 24482 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.843606:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.843607:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882510912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5426us (5495us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.843613:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820570 00010000:00010000:2.0:1713481296.843618:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cafed00/0xdfc0fb14893abbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f1 expref: 26811 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.843619:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4018c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20726:1959:x1796714882510784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5443us (5531us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.843624:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820569 00010000:00010000:2.0:1713481296.843626:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cafed00/0xdfc0fb14893abbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f1 expref: 26811 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.843635:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784544000:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.843678:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096bae1c0/0xdfc0fb14891d174 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca724 expref: 24481 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.843688:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096bae1c0/0xdfc0fb14891d174 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca724 expref: 24481 pid: 16526 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.843697:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784544064:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.843713:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3d780 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.843714:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.843730:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513536 00000100:00100000:0.0:1713481296.843733:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513536 00000100:00100000:0.0:1713481296.843750:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125701 00000100:00100000:0.0:1713481296.843753:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2049:18947:x1796714882513536:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:2.0:1713481296.843754:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.843788:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513728 00000100:00100000:1.0:1713481296.843791:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513728 00010000:00010000:1.0:1713481296.843799:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121cdcd80/0xdfc0fb14894218e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03db expref: 20726 pid: 15559 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.843815:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18947:x1796714882513536:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 60us (101us total) trans 4295107624 rc 0/0 00000100:00100000:1.0:1713481296.843818:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820587 00000100:00100000:1.0:1713481296.843821:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20726:1957:x1796714882513728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.843822:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125701 00010000:00010000:1.0:1713481296.843826:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.843828:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121cdcd80/0xdfc0fb14894218e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6977:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03db expref: 20726 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.843834:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121cdcd80/0xdfc0fb14894218e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6977:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03db expref: 20726 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.843844:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121cdcd80/0xdfc0fb14894218e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6977:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03db expref: 20726 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.843854:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.843855:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.843857:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c261c0/0xdfc0fb148a3ba74 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b21 expref: 16921 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.843862:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c261c0/0xdfc0fb148a3ba74 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b21 expref: 16921 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.843876:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c261c0/0xdfc0fb148a3ba74 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6977:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b21 expref: 16921 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.843882:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784541888:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.843882:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009090e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784544128:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.843894:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b96ba80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.843900:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148a3bac8 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b4b expref: 20725 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.843907:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800992661c0, rc 0) 00000100:00100000:1.0:1713481296.843912:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16580:1796714784541760:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.843919:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:17924:x1796714882512576:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3866us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.843923:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563437 00010000:00010000:1.0:1713481296.843926:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.843935:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1957:x1796714882511808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4588us (4640us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.843939:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820573 00000100:00100000:1.0:1713481296.844056:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784542144:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.844059:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.844068:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513856 00000100:00100000:0.0:1713481296.844070:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513856 00010000:00010000:1.0:1713481296.844072:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.844080:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563456 00000100:00100000:0.0:1713481296.844083:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:10479:x1796714882513856:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.844088:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.844095:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b44240/0xdfc0fb148a3bb7e lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b83 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.844105:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990133c0/0xdfc0fb148916dd7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a7 expref: 24482 pid: 16476 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.844109:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.844110:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.844112:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b44240/0xdfc0fb148a3bb7e lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b83 expref: 24482 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.844147:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990133c0/0xdfc0fb148916dd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a7 expref: 24482 pid: 16476 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.844152:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990133c0/0xdfc0fb148916dd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a7 expref: 24482 pid: 16476 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.844158:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132b42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784544192:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.844173:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.844476:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.844505:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513984 00000100:00100000:1.0:1713481296.844508:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513984 00000100:00100000:1.0:1713481296.844526:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125702 00000100:00100000:1.0:1713481296.844529:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2394:18765:x1796714882513984:12345-192.168.202.24@tcp:35:dir_create.sh.0 00000100:00100000:2.0:1713481296.844548:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122b20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784542080:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.844587:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.844605:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784543168:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.844627:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2395:18765:x1796714882513984:12345-192.168.202.24@tcp:35:dir_create.sh.0 Request processed in 96us (151us total) trans 4295107625 rc 0/0 00010000:00010000:3.0:1713481296.844629:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.844632:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125702 00000100:00100000:2.0:1713481296.844632:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784542720:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.844655:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784542912:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.844679:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.844688:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.844704:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784543232:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.844727:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.844747:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784542784:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.844762:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.844784:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784543360:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.844792:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.844800:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784543424:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.844805:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.844811:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.844821:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.844824:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784542592:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.844830:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.844842:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.844842:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514880 00010000:00010000:1.0:1713481296.844843:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.844846:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514880 00000100:00100000:1.0:1713481296.844857:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007712b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784542656:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.844857:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514944 00000100:00100000:2.0:1713481296.844859:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514944 00000100:00100000:3.0:1713481296.844864:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515008 00000100:00100000:3.0:1713481296.844867:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515008 00010000:00010000:1.0:1713481296.844873:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.844877:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515072 00000100:00100000:2.0:1713481296.844880:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515072 00000100:00100000:3.0:1713481296.844880:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485903 00000100:00100000:3.0:1713481296.844885:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18604:x1796714882514880:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:1.0:1713481296.844886:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784543296:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.844894:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563457 00000100:00100000:2.0:1713481296.844899:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16922:18817:x1796714882514944:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.844901:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.844905:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.844907:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.844909:0:15642:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.844914:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513792 00000100:00100000:1.0:1713481296.844916:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513792 00010000:00010000:2.0:1713481296.844919:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009053e880/0xdfc0fb148a3bb85 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b8a expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.844919:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123674240/0xdfc0fb148a3bb5b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b60 expref: 2051 pid: 15577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.844923:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081e52640/0xdfc0fb148a15fe8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39852 expref: 20726 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.844935:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820588 00010000:00010000:2.0:1713481296.844935:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb1489d0043 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2243a expref: 20726 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.844937:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20726:1958:x1796714882513792:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.844940:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff8800993c6300) 00010000:00010000:1.0:1713481296.844942:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.844942:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.844943:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.844944:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081e52640/0xdfc0fb148a15fe8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39852 expref: 20726 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.844946:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009053e880/0xdfc0fb148a3bb85 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b8a expref: 16923 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.844947:0:15642:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.844949:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081e52640/0xdfc0fb148a15fe8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39852 expref: 20726 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.844958:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.844961:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081e52640/0xdfc0fb148a15fe8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39852 expref: 20726 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.844966:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb1489d0043 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2243a expref: 20726 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.844966:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.844973:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.844975:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb1489d0043 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2243a expref: 20725 pid: 16538 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.844977:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.844978:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.844980:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148a3bac8 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b4b expref: 20725 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.844983:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784544256:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.844984:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.844985:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148a3bac8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b4b expref: 20725 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.844994:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.844995:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800992661c0/0xdfc0fb148a3bac8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b4b expref: 20725 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.845000:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009090c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784544320:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.845000:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.845008:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3d900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.845014:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fc34600 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.845026:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485904 00000100:00100000:2.0:1713481296.845026:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563458 00000100:00100000:1.0:1713481296.845029:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18948:x1796714882515008:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.845030:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:18792:x1796714882515072:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.845035:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:1.0:1713481296.845036:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.845037:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.845042:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800970a5440/0xdfc0fb148a3bba1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x34d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b98 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845042:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.845047:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009053df80/0xdfc0fb148a3bba8 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc526:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b91 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845048:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00002000:00010000:2.0:1713481296.845060:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc526:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.845069:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.845070:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.845072:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008491f840/0xdfc0fb148a3bbaf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.845074:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009053df80/0xdfc0fb148a3bba8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc526:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b91 expref: 20726 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.845077:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008491f840/0xdfc0fb148a3bbaf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.845082:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008491f840/0xdfc0fb148a3bbaf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.845084:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009053df80/0xdfc0fb148a3bba8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc526:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b91 expref: 20726 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.845091:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009053df80, rc 0) 00000004:00200000:1.0:1713481296.845096:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34d7:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.845098:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713481296.845107:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20726:18792:x1796714882515072:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.845112:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563458 00010000:00010000:3.0:1713481296.845112:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.845116:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800970a5440/0xdfc0fb148a3bba1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x34d7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b98 expref: 2052 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845142:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.845146:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.845146:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008491f840/0xdfc0fb148a3bbaf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b98 expref: 2051 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845148:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.845150:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d7:0x0].0x0 (ffff880122a33900) 00010000:00010000:1.0:1713481296.845152:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.845152:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800914c46c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.845153:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008491f840, rc 0) 00010000:00010000:3.0:1713481296.845155:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845160:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.845166:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515136 00000100:00100000:1.0:1713481296.845167:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18948:x1796714882515008:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 137us (346us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.845167:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88012ba3a300) 00000100:00100000:2.0:1713481296.845169:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515136 00010000:00010000:3.0:1713481296.845169:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1713481296.845170:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485904 00010000:00010000:3.0:1713481296.845173:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845177:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bb9a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.845185:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563459 00000100:00100000:2.0:1713481296.845189:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16924:18836:x1796714882515136:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.845195:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.845199:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132b43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784543936:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.845199:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845204:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.845205:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800898a0b40/0xdfc0fb148a3bbb6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49b9f expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845209:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845213:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.845214:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b088240/0xdfc0fb148a3bb70 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b75 expref: 16925 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845217:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123674480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.845219:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942d2640/0xdfc0fb14891eff1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb7a1 expref: 20725 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845220:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.845221:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b088240, rc 0) 00010000:00010000:2.0:1713481296.845224:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.845225:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.845226:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.845229:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800898a0b40/0xdfc0fb148a3bbb6 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b9f expref: 16925 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.845232:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16925:8499:x1796714882513216:12345-192.168.202.24@tcp:101:dd.0 Request processed in 1795us (1869us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.845232:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:3.0:1713481296.845234:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.845236:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563454 00010000:00010000:3.0:1713481296.845236:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.845241:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942d2640/0xdfc0fb14891eff1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb7a1 expref: 20725 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.845241:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123674480/0xdfc0fb148a3bb8c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.845249:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942d2640/0xdfc0fb14891eff1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb7a1 expref: 20725 pid: 16533 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1713481296.845254:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.845258:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784544384:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.845263:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845268:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845273:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123676880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.845275:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:2.0:1713481296.845279:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013045e180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.845280:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009090e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784544128:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.845281:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845287:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880084b4fd00) 00010000:00010000:3.0:1713481296.845289:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.845291:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.845291:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.845296:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123676880/0xdfc0fb148a3bb93 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.845302:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:1957:x1796714882513728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1480us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.845306:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820587 00000100:00100000:3.0:1713481296.845339:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18604:x1796714882514880:12345-192.168.202.24@tcp:36:rm.0 Request processed in 452us (546us total) trans 0 rc -39/-39 00000100:00100000:3.0:1713481296.845346:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485903 00000100:00100000:2.0:1713481296.845351:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784544000:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.845361:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784544064:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.845383:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132b42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784544192:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.845401:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b44240/0xdfc0fb148a3bb7e lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b83 expref: 24482 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.845405:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009053f180/0xdfc0fb148a3bb77 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b7c expref: 24482 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.845410:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b44240, rc 0) 00010000:00010000:2.0:1713481296.845414:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009053f180, rc 0) 00000100:00100000:1.0:1713481296.845429:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:10479:x1796714882513856:12345-192.168.202.24@tcp:101:dd.0 Request processed in 1344us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.845432:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:10409:x1796714882513280:12345-192.168.202.24@tcp:101:dd.0 Request processed in 1879us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.845435:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563456 00000100:00100000:2.0:1713481296.845439:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563455 00000100:00100000:1.0:1713481296.847091:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.847108:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.847116:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515264 00000100:00100000:1.0:1713481296.847131:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515264 00000100:00100000:1.0:1713481296.847153:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515520 00000100:00100000:1.0:1713481296.847154:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515520 00000100:00100000:2.0:1713481296.847164:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563460 00000100:00100000:1.0:1713481296.847169:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563461 00000100:00100000:2.0:1713481296.847171:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:15045:x1796714882515264:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.847172:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:11388:x1796714882515520:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.847177:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.847180:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.847184:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008491db00/0xdfc0fb148a3bbbd lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bad expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847193:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b8cd80/0xdfc0fb148a3bbc4 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ba6 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847195:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a4d680/0xdfc0fb148942427 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e2 expref: 24481 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.847199:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.847200:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.847202:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008491db00/0xdfc0fb148a3bbbd lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bad expref: 26813 pid: 16515 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.847207:0:16523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.847211:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a4d680/0xdfc0fb148942427 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e2 expref: 24481 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.847216:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a4d680/0xdfc0fb148942427 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e2 expref: 24482 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.847216:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.847218:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.847222:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b8cd80/0xdfc0fb148a3bbc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ba6 expref: 24482 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.847225:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784544448:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.847232:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b8cd80/0xdfc0fb148a3bbc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ba6 expref: 24482 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847239:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b8cd80, rc 0) 00000100:00100000:1.0:1713481296.847240:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b96ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.847260:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.847260:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:15045:x1796714882515264:12345-192.168.202.24@tcp:101:dd.0 Request processed in 88us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.847266:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563460 00000100:00100000:1.0:1713481296.847285:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.847291:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515584 00000100:00100000:2.0:1713481296.847294:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515584 00000100:00100000:2.0:1713481296.847311:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515648 00000100:00100000:2.0:1713481296.847315:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515648 00000100:00100000:1.0:1713481296.847324:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.847329:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563462 00000100:00100000:1.0:1713481296.847334:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513344 00000100:00100000:2.0:1713481296.847334:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16925:17935:x1796714882515584:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.847337:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513344 00010000:00010000:2.0:1713481296.847341:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.847345:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099266880/0xdfc0fb148802f62 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963014 expref: 20725 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.847351:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fe07a80/0xdfc0fb148a3bbcb lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bb4 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.847355:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563463 00000100:00100000:1.0:1713481296.847356:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820589 00000100:00100000:1.0:1713481296.847359:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:1959:x1796714882513344:12345-192.168.202.24@tcp:103:ldlm_bl.0 00002000:00010000:2.0:1713481296.847362:0:16523:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.847362:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:11552:x1796714882515648:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.847364:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.847366:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099266880/0xdfc0fb148802f62 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2751:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963014 expref: 20725 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.847371:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.847372:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099266880/0xdfc0fb148802f62 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2751:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963014 expref: 20725 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.847372:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.847373:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.847378:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe07a80/0xdfc0fb148a3bbcb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bb4 expref: 16926 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.847381:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800914c5b00/0xdfc0fb148a3bbd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bbb expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847386:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099266880/0xdfc0fb148802f62 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2751:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963014 expref: 20725 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.847387:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007fe07a80/0xdfc0fb148a3bbcb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bb4 expref: 16926 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847393:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fe07a80, rc 0) 00010000:00010000:1.0:1713481296.847394:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.847395:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.847397:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.847400:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.847401:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.847401:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e096880/0xdfc0fb14895a050 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeca9 expref: 26815 pid: 15510 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.847408:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.847409:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.847412:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16926:17935:x1796714882515584:12345-192.168.202.24@tcp:101:dd.0 Request processed in 77us (150us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.847412:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914c5b00/0xdfc0fb148a3bbd2 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bbb expref: 26815 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847413:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.847418:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563462 00000100:00100000:1.0:1713481296.847424:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20724:1959:x1796714882513344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.847428:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820589 00010000:00010000:3.0:1713481296.847428:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e096880/0xdfc0fb14895a050 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeca9 expref: 26815 pid: 15510 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.847437:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e096880/0xdfc0fb14895a050 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeca9 expref: 26815 pid: 15510 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.847445:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.847447:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784544512:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.847450:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847455:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847459:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847462:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.847465:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.847466:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097c25b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.847468:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.847471:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.847475:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847482:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847486:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c25b00/0xdfc0fb148a3ba58 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.847493:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516480 00000100:00100000:3.0:1713481296.847497:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516480 00000100:00100000:3.0:1713481296.847522:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485905 00000100:00100000:3.0:1713481296.847527:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2168:18578:x1796714882516480:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:0.0:1713481296.847536:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.847543:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.847552:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513600 00000100:00100000:0.0:1713481296.847555:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513600 00010000:00010000:3.0:1713481296.847556:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca4b40/0xdfc0fb148a3bbd9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x37c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bd7 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.847567:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbd21c0/0xdfc0fb148802f69 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963022 expref: 20724 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.847582:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514048 00000100:00100000:0.0:1713481296.847585:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514048 00010000:00010000:0.0:1713481296.847593:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080144240/0xdfc0fb148802f70 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963030 expref: 20725 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.847595:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820590 00000100:00100000:2.0:1713481296.847600:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:1959:x1796714882513600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.847607:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820591 00010000:00010000:2.0:1713481296.847609:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.847610:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20725:1959:x1796714882514048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.847614:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbd21c0/0xdfc0fb148802f69 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2752:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963022 expref: 20725 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.847616:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.847618:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080144240/0xdfc0fb148802f70 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2753:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963030 expref: 20725 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.847621:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbd21c0/0xdfc0fb148802f69 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2752:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963022 expref: 20725 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.847623:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+264:3491:x1796714784540736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9888us (9922us total) trans 4296040927 rc 0/0 00010000:00010000:0.0:1713481296.847624:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080144240/0xdfc0fb148802f70 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2753:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963030 expref: 20725 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.847628:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563431 00010000:00010000:0.0:1713481296.847637:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080144240/0xdfc0fb148802f70 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2753:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963030 expref: 20725 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.847637:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd21c0/0xdfc0fb148802f69 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2752:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963022 expref: 20725 pid: 16489 timeout: 815 lvb_type: 1 00000004:00200000:3.0:1713481296.847639:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x37c5:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.847644:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.847645:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.847647:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847648:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.847649:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.847652:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.847656:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.847657:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.847659:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.847681:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.847683:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514176 00000100:00100000:1.0:1713481296.847685:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514176 00010000:00010000:2.0:1713481296.847693:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.847694:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20723:1959:x1796714882514048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.847694:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084857cc0/0xdfc0fb1486894f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d311b expref: 26816 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.847698:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820591 00000100:00100000:1.0:1713481296.847706:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820592 00000100:00100000:1.0:1713481296.847709:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26816:1959:x1796714882514176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.847711:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20722:1959:x1796714882513600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 110us (246us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.847713:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.847716:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084857cc0/0xdfc0fb1486894f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d311b expref: 26816 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.847718:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820590 00010000:00010000:1.0:1713481296.847722:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084857cc0/0xdfc0fb1486894f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d311b expref: 26816 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.847724:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca4b40/0xdfc0fb148a3bbd9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x37c4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bd7 expref: 2170 pid: 15476 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.847726:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077af2a00/2, rc 0, transno 1073631 00000100:00100000:0.0:1713481296.847731:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784540736:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.847732:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880081ca4b40/0xdfc0fb148a3bbd9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37c4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bd7 expref: 2170 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847733:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084857cc0/0xdfc0fb1486894f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d311b expref: 26816 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.847740:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847743:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.847744:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.847746:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847746:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.847748:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081ca4b40, rc 0) 00010000:00010000:1.0:1713481296.847750:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847758:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847760:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.847762:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1713481296.847764:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.847767:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784544576:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.847771:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.847771:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18578:x1796714882516480:12345-192.168.202.24@tcp:101:rm.0 Request processed in 242us (372us total) trans 4295105925 rc 301/301 00000100:00100000:1.0:1713481296.847773:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26815:1959:x1796714882514176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (116us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.847776:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097c27180 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.847777:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485905 00000100:00100000:1.0:1713481296.847778:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820592 00010000:00010000:2.0:1713481296.847778:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.847781:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.847785:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847795:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847798:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847799:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847803:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.847804:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c27180/0xdfc0fb148a3ba66 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847807:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847814:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.847815:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.847818:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097c26880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.847819:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847823:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847832:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.847835:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c26880/0xdfc0fb148a3baf2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.847839:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514304 00000100:00100000:3.0:1713481296.847842:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514304 00010000:00010000:3.0:1713481296.847856:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c7eac0/0xdfc0fb1486894fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3137 expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.847857:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.847875:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514432 00000100:00100000:3.0:1713481296.847877:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514432 00000100:00100000:0.0:1713481296.847885:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.847888:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099265b00/0xdfc0fb148802f7e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96304c expref: 20722 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.847912:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514560 00000100:00100000:3.0:1713481296.847914:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514560 00000100:00100000:0.0:1713481296.847924:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820593 00010000:00010000:3.0:1713481296.847927:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbd0b40/0xdfc0fb148802f85 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96305a expref: 20723 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.847932:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+265:3493:x1796714784540928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10026us (10066us total) trans 4296040928 rc 0/0 00000100:00100000:2.0:1713481296.847938:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563433 00000100:00100000:3.0:1713481296.847944:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820594 00000100:00100000:3.0:1713481296.847948:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20723:1959:x1796714882514432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.847957:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.847959:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784544576 00000100:00100000:1.0:1713481296.847960:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+264:3493:x1796714784541952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7486us (7708us total) trans 4296040929 rc 0/0 00000100:00100000:2.0:1713481296.847962:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784544576 00010000:00010000:3.0:1713481296.847962:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099265b00/0xdfc0fb148802f7e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2755:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96304c expref: 20723 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.847966:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563441 00010000:00010000:3.0:1713481296.847971:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099265b00/0xdfc0fb148802f7e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2755:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96304c expref: 20723 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.847974:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563464 00000100:00100000:2.0:1713481296.847978:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+265:3490:x1796714784544576:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.847988:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099265b00/0xdfc0fb148802f7e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2755:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96304c expref: 20723 pid: 15499 timeout: 815 lvb_type: 1 00002000:00080000:2.0:1713481296.847990:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10073 count 1 00010000:00010000:2.0:1713481296.847999:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848001:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.848002:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848002:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.848005:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848008:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848009:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084818480/0xdfc0fb148802f9a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963084 expref: 20722 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.848013:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848014:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.848015:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848015:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848018:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.848019:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26815:1959:x1796714882514304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.848021:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848027:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.848028:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848031:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c7eac0/0xdfc0fb1486894fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3137 expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.848031:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084818480/0xdfc0fb148802f9a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963084 expref: 20722 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.848032:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.848033:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b185680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.848036:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848037:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c7eac0/0xdfc0fb1486894fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3137 expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.848039:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084818480/0xdfc0fb148802f9a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963084 expref: 20722 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.848042:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.848047:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784544640:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.848053:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c7eac0/0xdfc0fb1486894fd lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3137 expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.848054:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20722:1959:x1796714882514432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 104us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.848057:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.848062:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820594 00010000:00010000:0.0:1713481296.848063:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.848063:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b185680/0xdfc0fb148a3baf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.848063:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ef00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.848064:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.848066:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848070:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.848079:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820595 00010000:00010000:0.0:1713481296.848082:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.848082:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20721:1959:x1796714882514560:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.848088:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.848091:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbd0b40/0xdfc0fb148802f85 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96305a expref: 20721 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.848095:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:1959:x1796714882514304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 166us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.848095:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848098:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbd0b40/0xdfc0fb148802f85 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96305a expref: 20721 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.848099:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820593 00010000:00010000:3.0:1713481296.848102:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848108:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbd0b40/0xdfc0fb148802f85 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96305a expref: 20721 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.848110:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848116:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848134:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848136:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848139:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848140:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.848145:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007de2d180/2, rc 0, transno 1073633 00010000:00010000:3.0:1713481296.848147:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.848149:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784541952:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.848152:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.848153:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800737af600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.848157:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.848158:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076a4aa00/2, rc 0, transno 1073632 00000100:00100000:0.0:1713481296.848160:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784540928:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.848164:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.848166:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:1959:x1796714882514560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.848169:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820595 00010000:00010000:0.0:1713481296.848170:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848174:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848176:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848182:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848183:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800737af600/0xdfc0fb148a3bb15 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848186:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848189:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848193:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848198:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848205:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848208:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848212:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120bae640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.848213:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848217:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848225:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848228:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bb23 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.848232:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2856:3490:x1796714784542208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7353us (7401us total) trans 4295960799 rc 0/0 00010000:00010000:0.0:1713481296.848234:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.848238:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563442 00010000:00010000:0.0:1713481296.848239:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b186ac0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.848241:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848245:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848254:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.848258:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b186ac0/0xdfc0fb148a3bb00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.848285:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.848335:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+266:3492:x1796714784542848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7158us (7195us total) trans 4296040931 rc 0/0 00000100:00100000:2.0:1713481296.848339:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563448 00000100:00100000:3.0:1713481296.848342:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+266:3491:x1796714784542464:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7289us (7344us total) trans 4296040930 rc 0/0 00000100:00100000:3.0:1713481296.848350:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563446 00000100:00100000:1.0:1713481296.848356:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.848367:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007719b100/2, rc 0, transno 1073635 00000100:00100000:2.0:1713481296.848370:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007719b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784542848:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.848383:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514688 00000100:00100000:2.0:1713481296.848385:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514688 00010000:00010000:2.0:1713481296.848394:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012432d440/0xdfc0fb148802f8c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963068 expref: 20720 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.848396:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:3.0:1713481296.848400:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800772f5880/2, rc 0, transno 1073634 00000100:00100000:2.0:1713481296.848405:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515200 00000100:00100000:3.0:1713481296.848406:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800772f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784542464:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.848407:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515200 00010000:00010000:2.0:1713481296.848411:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c3321c0/0xdfc0fb1488e7ebc lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5533 expref: 16926 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.848418:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515392 00000100:00100000:2.0:1713481296.848419:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515392 00000100:00100000:1.0:1713481296.848425:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.848425:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cafed00/0xdfc0fb14893abbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f1 expref: 26814 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.848430:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820596 00000100:00100000:3.0:1713481296.848436:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:1959:x1796714882514688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.848437:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800772f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2856:3493:x1796714784542336:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7483us (7549us total) trans 4295960800 rc 0/0 00000100:00100000:2.0:1713481296.848439:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820597 00000100:00100000:2.0:1713481296.848442:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16926:1959:x1796714882515200:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.848443:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563443 00010000:00010000:3.0:1713481296.848444:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.848446:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515776 00010000:00010000:2.0:1713481296.848446:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.848449:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515776 00010000:00010000:2.0:1713481296.848449:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c3321c0/0xdfc0fb1488e7ebc lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5533 expref: 16926 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.848450:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012432d440/0xdfc0fb148802f8c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963068 expref: 20720 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.848454:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c3321c0/0xdfc0fb1488e7ebc lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5533 expref: 16926 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.848459:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012432d440/0xdfc0fb148802f8c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963068 expref: 20720 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.848466:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c3321c0/0xdfc0fb1488e7ebc lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5533 expref: 16926 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.848473:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26112 00010000:00010000:2.0:1713481296.848473:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848474:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848476:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b088240/0xdfc0fb148a3bb70 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b75 expref: 16925 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848477:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012432d440/0xdfc0fb148802f8c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963068 expref: 20720 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.848478:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2395:18937:x1796714882515776:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:2.0:1713481296.848481:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b088240/0xdfc0fb148a3bb70 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b75 expref: 16925 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848488:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.848490:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848492:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b088240/0xdfc0fb148a3bb70 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b75 expref: 16925 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.848492:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.848494:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784544832:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.848497:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784544960:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.848500:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848501:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:0.0:1713481296.848507:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.848513:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3ba90 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b28 expref: 2395 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.848515:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178e000 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.848520:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1713481296.848525:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c9b100/2, rc 0, transno 993503 00000100:00100000:0.0:1713481296.848529:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784542208:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.848533:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013224d440/0xdfc0fb148a37abe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x347f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47963 expref: 2394 pid: 15577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.848534:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.848535:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820598 00000100:00100000:0.0:1713481296.848537:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784544896:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.848539:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26814:1959:x1796714882515392:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.848541:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20719:1959:x1796714882514688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 104us (256us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.848545:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff8800933ac000) 00010000:00010000:2.0:1713481296.848546:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.848547:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.848549:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820596 00010000:00010000:2.0:1713481296.848551:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cafed00/0xdfc0fb14893abbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f1 expref: 26814 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.848560:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3b97f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49acd expref: 2393 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848560:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cafed00/0xdfc0fb14893abbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f1 expref: 26814 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.848568:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784544768:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.848570:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88011d9f2c00) 00010000:00010000:2.0:1713481296.848571:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cafed00/0xdfc0fb14893abbb lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f1 expref: 26814 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.848578:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.848578:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.848578:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848582:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.848587:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.848591:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c99180/2, rc 0, transno 993504 00010000:00010000:1.0:1713481296.848592:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.848594:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784542336:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.848595:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.848598:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:1.0:1713481296.848599:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.848599:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26813:1959:x1796714882515392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.848600:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784544704:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.848602:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848603:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.848608:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820598 00000100:00100000:0.0:1713481296.848609:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.848609:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848610:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.848613:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.848615:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b184240 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.848616:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784545024:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.848618:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848620:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.848624:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.848625:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848629:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.848634:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.848637:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784544832 00010000:00010000:1.0:1713481296.848639:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.848639:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784544832 00010000:00010000:3.0:1713481296.848641:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.848644:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784545088:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.848647:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b184240/0xdfc0fb148a3bb2a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.848648:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784544896 00000100:00100000:2.0:1713481296.848649:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784544896 00000100:00100000:0.0:1713481296.848653:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.848656:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784544768 00000100:00100000:2.0:1713481296.848658:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784544768 00000100:00100000:2.0:1713481296.848681:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784544704 00000100:00100000:2.0:1713481296.848684:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784544704 00000100:00100000:2.0:1713481296.848695:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784545024 00000100:00100000:2.0:1713481296.848697:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784545024 00000100:00100000:2.0:1713481296.848708:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784545088 00000100:00100000:2.0:1713481296.848710:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784545088 00010000:00010000:1.0:1713481296.848717:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.848721:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563465 00010000:00010000:1.0:1713481296.848725:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.848725:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+268:3490:x1796714784544832:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.848732:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00002000:00080000:2.0:1713481296.848734:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10076 count 1 00010000:00010000:1.0:1713481296.848740:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.848744:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848746:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.848751:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.848753:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800922b4d80/0xdfc0fb148802faf lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630ae expref: 20718 pid: 15499 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.848755:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563466 00000100:00100000:0.0:1713481296.848758:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+269:3490:x1796714784544896:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.848759:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848760:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848762:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.848767:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10077 count 1 00010000:00010000:0.0:1713481296.848775:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848776:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800922b4d80/0xdfc0fb148802faf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630ae expref: 20718 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.848783:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c5833c0/0xdfc0fb148802b56 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630d1 expref: 20718 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.848788:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800922b4d80/0xdfc0fb148802faf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630ae expref: 20718 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.848791:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.848792:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.848793:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.848795:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784545152:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.848803:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c5833c0/0xdfc0fb148802b56 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630d1 expref: 20718 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.848808:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c5833c0/0xdfc0fb148802b56 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630d1 expref: 20718 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.848814:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007719a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+269:3490:x1796714784542976:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7594us (7636us total) trans 4296040932 rc 0/0 00000100:00100000:0.0:1713481296.848815:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784545216:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.848816:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.848816:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009af53480 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.848822:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.848822:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563449 00010000:00010000:1.0:1713481296.848827:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.848828:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665e40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.848832:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e718c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.848834:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.848840:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.848843:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563467 00010000:00010000:1.0:1713481296.848847:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff88007aae3600) 00000100:00100000:2.0:1713481296.848848:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+268:3493:x1796714784544768:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713481296.848849:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077198a80/2, rc 0, transno 1073636 00010000:00010000:1.0:1713481296.848849:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1713481296.848849:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563468 00010000:00010000:1.0:1713481296.848852:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.848853:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784542976:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.848855:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+268:3493:x1796714784544704:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.848856:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3bc0a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00002000:00080000:2.0:1713481296.848861:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10075 count 1 00002000:00080000:3.0:1713481296.848868:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10074 count 1 00000100:00100000:0.0:1713481296.848870:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784545280:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.848872:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848878:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.848881:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.848881:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012432ef40/0xdfc0fb148802fa8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630a0 expref: 20718 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.848881:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848883:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.848887:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.848888:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.848888:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.848890:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 4/0,1 mode: --/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848891:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e71f80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.848892:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097643180/0xdfc0fb148802fa1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963092 expref: 20718 pid: 16489 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.848893:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.848897:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.848898:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.848899:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.848902:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784545280 00010000:00010000:3.0:1713481296.848902:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.848903:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012432ef40/0xdfc0fb148802fa8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630a0 expref: 20718 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.848904:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784545280 00010000:00010000:1.0:1713481296.848907:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff880097b2bf00) 00010000:00010000:1.0:1713481296.848909:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1713481296.848910:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012432ef40/0xdfc0fb148802fa8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630a0 expref: 20718 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.848911:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.848915:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563469 00010000:00010000:1.0:1713481296.848916:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bc03 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.848918:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2857:3493:x1796714784545024:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.848920:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097643180/0xdfc0fb148802fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963092 expref: 20718 pid: 16489 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.848924:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081eced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784545344:192.168.202.24@tcp:104: 00002000:00080000:0.0:1713481296.848925:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43521 count 1 00010000:00010000:3.0:1713481296.848929:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097643180/0xdfc0fb148802fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963092 expref: 20718 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.848931:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.848933:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848937:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.848940:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078c34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784545408:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.848941:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801224d39c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.848942:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.848943:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095c04480/0xdfc0fb1486893ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3161 expref: 26812 pid: 16504 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.848946:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.848947:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.848948:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.848949:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.848950:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aab2d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.848953:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.848958:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.848959:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095c04480/0xdfc0fb1486893ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3161 expref: 26812 pid: 16504 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.848959:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503540 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.848960:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563470 00010000:00010000:0.0:1713481296.848964:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095c04480/0xdfc0fb1486893ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3161 expref: 26812 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.848964:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:2.0:1713481296.848965:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2857:3493:x1796714784545088:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.848966:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.848968:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.848969:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e368000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784545472:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.848973:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3bbee lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00002000:00080000:2.0:1713481296.848974:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43523 count 1 00000100:00100000:0.0:1713481296.848980:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665780 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.848983:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.848990:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563471 00010000:00010000:1.0:1713481296.848991:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.848991:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083b76880/0xdfc0fb1486893c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d316f expref: 26812 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.848996:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.848996:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+269:3490:x1796714784545280:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.848997:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.848998:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.849000:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849001:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.849005:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aab0fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.849007:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00002000:00080000:3.0:1713481296.849007:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10078 count 1 00010000:00010000:1.0:1713481296.849011:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.849012:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083b76880/0xdfc0fb1486893c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d316f expref: 26812 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.849017:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff880097b2b900) 00010000:00010000:1.0:1713481296.849018:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.849019:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083b76880/0xdfc0fb1486893c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d316f expref: 26812 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.849020:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.849020:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849024:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3bbf5 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.849026:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784545536:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.849027:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.849034:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c18000/0xdfc0fb148802b5d lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630df expref: 20718 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.849036:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513408 00000100:00100000:0.0:1713481296.849038:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513408 00000100:00100000:2.0:1713481296.849038:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098ec1cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.849041:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.849042:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.849045:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849046:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.849050:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.849055:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.849059:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e72d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.849060:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085c18000/0xdfc0fb148802b5d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630df expref: 20718 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.849062:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.849067:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.849069:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085c18000/0xdfc0fb148802b5d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630df expref: 20718 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.849072:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff880097b2b800) 00010000:00010000:1.0:1713481296.849074:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.849076:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.849078:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784545600:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.849081:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bbfc lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.849090:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800848558c0/0xdfc0fb1486894e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30f1 expref: 26813 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.849093:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503600 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.849104:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820599 00000100:00100000:1.0:1713481296.849115:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18937:x1796714882515776:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 637us (689us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.849145:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26112 00000100:00100000:0.0:1713481296.849168:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26813:1959:x1796714882513408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.849174:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.849178:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800848558c0/0xdfc0fb1486894e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30f1 expref: 26813 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.849184:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800848558c0/0xdfc0fb1486894e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30f1 expref: 26813 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.849196:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800848558c0/0xdfc0fb1486894e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30f1 expref: 26813 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.849203:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.849207:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849208:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849210:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849215:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.849219:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882513664 00000100:00100000:1.0:1713481296.849222:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.849223:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882513664 00010000:00010000:0.0:1713481296.849226:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.849235:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26813:1959:x1796714882513408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 127us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.849236:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084857180/0xdfc0fb1486894e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ff expref: 26813 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.849239:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820599 00000100:00100000:3.0:1713481296.849246:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514112 00000100:00100000:1.0:1713481296.849249:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.849249:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514112 00000100:00100000:0.0:1713481296.849252:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514240 00000100:00100000:0.0:1713481296.849254:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514240 00000100:00100000:2.0:1713481296.849257:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820600 00010000:00010000:0.0:1713481296.849262:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123676400/0xdfc0fb148802f77 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96303e expref: 20719 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.849262:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26813:1959:x1796714882513664:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.849265:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c7dd40/0xdfc0fb1486894ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d310d expref: 26813 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.849268:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.849269:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.849273:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514368 00010000:00010000:2.0:1713481296.849273:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084857180/0xdfc0fb1486894e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ff expref: 26813 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.849275:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514368 00010000:00010000:0.0:1713481296.849280:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134fa6f40/0xdfc0fb148689504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3129 expref: 26814 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.849282:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084857180/0xdfc0fb1486894e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ff expref: 26814 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.849287:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820601 00000100:00100000:1.0:1713481296.849288:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.849293:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20719:1959:x1796714882514240:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.849299:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514496 00010000:00010000:3.0:1713481296.849300:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.849301:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514496 00010000:00010000:2.0:1713481296.849301:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084857180/0xdfc0fb1486894e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d30ff expref: 26814 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.849303:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.849306:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123676400/0xdfc0fb148802f77 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2754:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96303e expref: 20719 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.849307:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800831baac0/0xdfc0fb14868950b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3145 expref: 26814 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.849311:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.849313:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.849316:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514624 00010000:00010000:2.0:1713481296.849316:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849316:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123676400/0xdfc0fb148802f77 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2754:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96303e expref: 20719 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.849317:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514624 00000100:00100000:1.0:1713481296.849321:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.849322:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c7c6c0/0xdfc0fb148689512 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3153 expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.849323:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.849334:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882514752 00010000:00010000:3.0:1713481296.849334:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123676400/0xdfc0fb148802f77 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2754:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96303e expref: 20719 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.849335:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882514752 00010000:00010000:0.0:1713481296.849342:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099266f40/0xdfc0fb148802f93 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963076 expref: 20719 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.849342:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.849343:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820602 00010000:00010000:3.0:1713481296.849346:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.849347:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26815:1959:x1796714882514112:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.849348:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.849349:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820603 00010000:00010000:3.0:1713481296.849350:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.849352:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26815:1959:x1796714882514368:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.849353:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.849356:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.849356:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849357:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c7dd40/0xdfc0fb1486894ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d310d expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.849358:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134fa6f40/0xdfc0fb148689504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3129 expref: 26815 pid: 16491 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.849361:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26815:1959:x1796714882513664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.849364:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134fa6f40/0xdfc0fb148689504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3129 expref: 26815 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.849367:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c7dd40/0xdfc0fb1486894ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d310d expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.849367:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820600 00010000:00010000:0.0:1713481296.849373:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fa6f40/0xdfc0fb148689504 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3129 expref: 26815 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.849374:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.849379:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c7dd40/0xdfc0fb1486894ef lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d310d expref: 26815 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.849387:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849388:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.849388:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.849389:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849390:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849391:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.849393:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820604 00010000:00010000:0.0:1713481296.849394:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849395:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.849395:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20719:1959:x1796714882514240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 102us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.849397:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:1959:x1796714882514496:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.849403:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.849403:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820601 00010000:00010000:2.0:1713481296.849405:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.849407:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.849410:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800831baac0/0xdfc0fb14868950b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3145 expref: 26812 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.849413:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:1959:x1796714882514368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.849416:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26812:1959:x1796714882514112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.849417:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820603 00010000:00010000:2.0:1713481296.849418:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800831baac0/0xdfc0fb14868950b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3145 expref: 26812 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.849420:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820602 00000100:00100000:3.0:1713481296.849427:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820605 00000100:00100000:0.0:1713481296.849431:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820606 00010000:00010000:2.0:1713481296.849431:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800831baac0/0xdfc0fb14868950b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3145 expref: 26811 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.849432:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26811:1959:x1796714882514624:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.849434:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20718:1959:x1796714882514752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.849438:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.849440:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.849441:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099266f40/0xdfc0fb148802f93 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2758:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963076 expref: 20718 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.849442:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849444:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.849445:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c7c6c0/0xdfc0fb148689512 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3153 expref: 26809 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.849446:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849446:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849447:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099266f40/0xdfc0fb148802f93 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2758:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963076 expref: 20718 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.849449:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849450:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849454:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c7c6c0/0xdfc0fb148689512 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3153 expref: 26809 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.849456:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099266f40/0xdfc0fb148802f93 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2758:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963076 expref: 20718 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.849456:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849457:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849461:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849462:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849463:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.849464:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120bafcc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.849465:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849466:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849469:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849469:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849470:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.849476:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.849477:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c7c6c0/0xdfc0fb148689512 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3153 expref: 26809 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.849479:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849482:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3baeb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.849483:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26809:1959:x1796714882514496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.849484:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:1959:x1796714882514752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.849487:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820606 00000100:00100000:2.0:1713481296.849490:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820604 00010000:00010000:3.0:1713481296.849492:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.849494:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.849497:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849502:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849505:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849507:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849511:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849515:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849518:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849518:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849521:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092f84d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.849523:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849524:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.849527:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849529:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849534:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849537:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f84d80/0xdfc0fb148a3ba5f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849537:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.849540:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26807:1959:x1796714882514624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 107us (235us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.849543:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.849547:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820605 00010000:00010000:2.0:1713481296.849549:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849555:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800784b4d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.849558:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849564:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849575:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2858:3490:x1796714784542016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9119us (9354us total) trans 4295960801 rc 0/0 00010000:00010000:2.0:1713481296.849577:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849580:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563440 00010000:00010000:3.0:1713481296.849580:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.849584:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3ba97 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849588:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849596:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849603:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.849610:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c9a680/2, rc 0, transno 993505 00010000:00010000:3.0:1713481296.849614:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849615:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784542016:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.849620:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007da38b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.849623:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849630:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.849644:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2859:3490:x1796714784540864:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11784us (11824us total) trans 4295960802 rc 0/0 00000004:00080000:1.0:1713481296.849645:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076a48e00/2, rc 0, transno 993506 00010000:00010000:3.0:1713481296.849645:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.849648:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563432 00000100:00100000:1.0:1713481296.849648:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784540864:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.849651:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713481296.849652:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bb1c lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849655:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784545664:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.849682:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849684:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.849688:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849692:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849695:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849699:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849705:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120bae880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.849707:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849710:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784545728:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.849711:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849719:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849722:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.849723:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880120bae880/0xdfc0fb148a3bb38 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.849739:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009232b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2858:3491:x1796714784541568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10683us (10724us total) trans 4295960803 rc 0/0 00000100:00100000:1.0:1713481296.849740:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784545664 00000100:00100000:1.0:1713481296.849742:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784545664 00000100:00100000:2.0:1713481296.849746:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563435 00000100:00100000:1.0:1713481296.849751:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784545728 00000100:00100000:1.0:1713481296.849752:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784545728 00000100:00100000:1.0:1713481296.849759:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563472 00000100:00100000:1.0:1713481296.849762:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2859:3490:x1796714784545664:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.849769:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43525 count 1 00010000:00010000:1.0:1713481296.849778:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849785:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121e32f40/0xdfc0fb1486893b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d317d expref: 26806 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.849789:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.849790:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.849792:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.849801:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121e32f40/0xdfc0fb1486893b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d317d expref: 26806 pid: 16509 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.849801:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007719b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+271:3491:x1796714784542400:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8643us (8736us total) trans 4296040933 rc 0/0 00010000:00010000:1.0:1713481296.849807:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121e32f40/0xdfc0fb1486893b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d317d expref: 26806 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.849809:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563447 00000100:00100000:1.0:1713481296.849813:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784545792:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.849829:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086caed80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.849830:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563473 00000100:00100000:0.0:1713481296.849833:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007719aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+270:3492:x1796714784543104:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8519us (8565us total) trans 4296040934 rc 0/0 00000100:00100000:3.0:1713481296.849835:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2859:3492:x1796714784545728:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.849838:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563451 00002000:00080000:3.0:1713481296.849848:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43527 count 1 00000004:00080000:1.0:1713481296.849854:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077198700/2, rc 0, transno 1073638 00010000:00010000:0.0:1713481296.849858:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849861:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849862:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784543104:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.849863:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849867:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849871:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849872:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bd72880/0xdfc0fb1486893bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d318b expref: 26806 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.849875:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849878:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800737ae1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.849879:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849880:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849880:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.849883:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849883:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849889:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.849893:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3bb07 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849896:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.849900:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bd72880/0xdfc0fb1486893bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d318b expref: 26806 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.849908:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bd72880/0xdfc0fb1486893bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d318b expref: 26806 pid: 15509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.849919:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784545856:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.849936:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e06b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.849941:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.849952:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849959:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849967:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849974:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.849977:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.849981:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.849987:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af1f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.849990:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.849994:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800772f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2860:3493:x1796714784542272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9033us (9071us total) trans 4295960804 rc 0/0 00010000:00010000:3.0:1713481296.849997:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.849998:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563444 00000004:00080000:1.0:1713481296.850005:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c9ad80/2, rc 0, transno 993508 00000100:00100000:2.0:1713481296.850008:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515840 00000100:00100000:1.0:1713481296.850010:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784542272:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.850011:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515840 00010000:00010000:3.0:1713481296.850012:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.850019:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079af1f80/0xdfc0fb148a3bb31 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850020:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515328 00000100:00100000:0.0:1713481296.850021:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515328 00000100:00100000:2.0:1713481296.850024:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563474 00000100:00100000:2.0:1713481296.850027:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16926:18844:x1796714882515840:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.850029:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096bae1c0/0xdfc0fb14891d174 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca724 expref: 24482 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.850032:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.850035:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.850038:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515456 00000100:00100000:0.0:1713481296.850039:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515456 00010000:00010000:2.0:1713481296.850039:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fe3180/0xdfc0fb148a3bc50 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bc2 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.850042:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784545920:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.850044:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990133c0/0xdfc0fb148916dd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a7 expref: 24483 pid: 16476 timeout: 815 lvb_type: 1 00002000:00010000:2.0:1713481296.850047:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713481296.850052:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820607 00010000:00010000:2.0:1713481296.850054:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.850055:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1959:x1796714882515328:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.850055:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.850058:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fe3180/0xdfc0fb148a3bc50 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bc2 expref: 16927 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850059:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.850060:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.850062:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096bae1c0/0xdfc0fb14891d174 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca724 expref: 24483 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.850063:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fe3180/0xdfc0fb148a3bc50 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bc2 expref: 16927 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850067:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096bae1c0/0xdfc0fb14891d174 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca724 expref: 24483 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.850068:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fe3180, rc 0) 00010000:00010000:0.0:1713481296.850076:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096bae1c0/0xdfc0fb14891d174 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca724 expref: 24483 pid: 16526 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.850077:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16927:18844:x1796714882515840:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 50us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.850080:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784545920 00000100:00100000:2.0:1713481296.850081:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563474 00010000:00010000:0.0:1713481296.850082:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850083:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.850083:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784545920 00010000:00010000:0.0:1713481296.850086:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009053f180/0xdfc0fb148a3bb77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b7c expref: 24482 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850090:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009053f180/0xdfc0fb148a3bb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b7c expref: 24482 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850102:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009053f180/0xdfc0fb148a3bb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b7c expref: 24482 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.850102:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563475 00000100:00100000:1.0:1713481296.850106:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2861:3492:x1796714784545920:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.850107:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e368700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784545984:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.850113:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820608 00002000:00080000:1.0:1713481296.850116:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43529 count 1 00000100:00100000:2.0:1713481296.850116:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882515456:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.850132:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665240 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.850141:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.850144:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850149:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990133c0/0xdfc0fb148916dd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a7 expref: 24482 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.850155:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121e32400/0xdfc0fb1486893c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3199 expref: 26806 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.850155:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990133c0/0xdfc0fb148916dd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a7 expref: 24482 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.850161:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.850163:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.850165:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990133c0/0xdfc0fb148916dd7 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65a7 expref: 24482 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.850166:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850171:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.850173:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.850174:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.850176:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b44240/0xdfc0fb148a3bb7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b83 expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850181:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b44240/0xdfc0fb148a3bb7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b83 expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.850182:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121e32400/0xdfc0fb1486893c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3199 expref: 26806 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.850191:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121e32400/0xdfc0fb1486893c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3199 expref: 26806 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.850191:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096b44240/0xdfc0fb148a3bb7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b83 expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850197:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.850197:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f935880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784546176:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.850201:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784546112:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.850207:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516160 00000100:00100000:0.0:1713481296.850209:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516160 00000100:00100000:3.0:1713481296.850210:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2861:3490:x1796714784543040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8964us (8995us total) trans 4295960805 rc 0/0 00000100:00100000:2.0:1713481296.850211:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800993f0480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.850216:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800929adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.850218:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563450 00000100:00100000:0.0:1713481296.850222:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563476 00000100:00100000:0.0:1713481296.850225:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007df6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16927:17009:x1796714882516160:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.850230:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.850231:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784546048:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.850236:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fde98c0/0xdfc0fb148a3bc5e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bc9 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.850244:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.850250:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850251:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850254:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fde98c0/0xdfc0fb148a3bc5e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bc9 expref: 16928 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.850254:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.850259:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078c99c00/2, rc 0, transno 1073637 00010000:00010000:0.0:1713481296.850260:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007fde98c0/0xdfc0fb148a3bc5e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bc9 expref: 16928 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850264:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fde98c0, rc 0) 00000100:00100000:3.0:1713481296.850269:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784542400:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.850281:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007df6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16928:17009:x1796714882516160:12345-192.168.202.24@tcp:101:dd.0 Request processed in 56us (84us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.850283:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077198380/2, rc 0, transno 993509 00000100:00100000:0.0:1713481296.850285:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563476 00000100:00100000:1.0:1713481296.850289:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784543040:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713481296.850294:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007841ca80/2, rc 0, transno 993507 00000100:00100000:0.0:1713481296.850297:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784546048 00000100:00100000:0.0:1713481296.850298:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784546048 00000100:00100000:3.0:1713481296.850299:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784541568:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.850307:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563477 00000100:00100000:0.0:1713481296.850309:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+270:3490:x1796714784546048:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.850316:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10079 count 1 00010000:00010000:0.0:1713481296.850322:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850329:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083115b00/0xdfc0fb148802b64 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630fb expref: 20716 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.850330:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784546240:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.850332:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850333:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850335:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.850339:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784546304:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.850345:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083115b00/0xdfc0fb148802b64 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630fb expref: 20716 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.850350:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083115b00/0xdfc0fb148802b64 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630fb expref: 20716 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.850355:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.850356:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007710b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784546368:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.850371:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.850372:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516096 00000100:00100000:1.0:1713481296.850375:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516096 00000100:00100000:3.0:1713481296.850389:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.850393:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26113 00000100:00100000:1.0:1713481296.850397:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18918:x1796714882516096:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:0.0:1713481296.850400:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784546240 00000100:00100000:0.0:1713481296.850402:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784546240 00000100:00100000:3.0:1713481296.850408:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.850411:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784546304 00010000:00010000:1.0:1713481296.850411:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.850412:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784546304 00000100:00100000:3.0:1713481296.850414:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007710b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784546432:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.850419:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563478 00010000:00010000:1.0:1713481296.850420:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bac1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b3d expref: 2392 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850422:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2862:3491:x1796714784546240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713481296.850428:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43531 count 1 00010000:00010000:1.0:1713481296.850433:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff8800898d4a00) 00010000:00010000:0.0:1713481296.850435:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.850436:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.850441:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb14868953c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31a7 expref: 26806 pid: 16491 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.850442:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.850445:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850446:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850447:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850456:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb14868953c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31a7 expref: 26806 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.850460:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784546560:0@lo:1000:mdt_io00_009.0 00010000:00010000:0.0:1713481296.850461:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb14868953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31a7 expref: 26806 pid: 16491 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.850463:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784546432 00000100:00100000:0.0:1713481296.850466:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077109f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784546496:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.850466:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784546432 00000100:00100000:2.0:1713481296.850467:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563479 00000100:00100000:2.0:1713481296.850472:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2862:3492:x1796714784546304:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.850476:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098098300 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.850479:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1713481296.850482:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43533 count 1 00000100:00100000:3.0:1713481296.850485:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563480 00000100:00100000:1.0:1713481296.850488:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800915d2180 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.850490:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+271:3492:x1796714784546432:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.850491:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850502:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00080000:3.0:1713481296.850502:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10080 count 1 00010000:00010000:2.0:1713481296.850505:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800831ba640/0xdfc0fb148689543 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31b5 expref: 26806 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.850509:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784546560 00010000:00010000:2.0:1713481296.850510:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.850511:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784546560 00000100:00100000:0.0:1713481296.850512:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516224 00010000:00010000:2.0:1713481296.850512:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.850514:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516224 00010000:00010000:2.0:1713481296.850514:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.850516:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850524:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563481 00000100:00100000:0.0:1713481296.850526:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:14753:x1796714882516224:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.850527:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800868b1b00/0xdfc0fb148802b6b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963109 expref: 20717 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.850528:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82950 00010000:00010000:2.0:1713481296.850529:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800831ba640/0xdfc0fb148689543 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31b5 expref: 26806 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.850531:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.850531:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+9:15514:x1796714784546560:12345-0@lo:1000:mdt_io00_009.0 00010000:00010000:3.0:1713481296.850533:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.850535:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850537:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3bc81 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc17a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bd0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850537:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800831ba640/0xdfc0fb148689543 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31b5 expref: 26806 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.850538:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.850545:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784546624:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.850549:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097dc58c0/0xdfc0fb148a13f26 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38026 expref: 20718 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.850553:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850554:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.850554:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800868b1b00/0xdfc0fb148802b6b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963109 expref: 20718 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.850556:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3bc81 lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bd0 expref: 20718 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.850559:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6e2180 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.850563:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800868b1b00/0xdfc0fb148802b6b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963109 expref: 20718 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.850565:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097dc58c0/0xdfc0fb148a13f26 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38026 expref: 20718 pid: 15507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.850570:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097dc58c0/0xdfc0fb148a13f26 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38026 expref: 20718 pid: 15507 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.850571:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+9:15514:x1796714784546560:12345-0@lo:1000:mdt_io00_009.0 Request processed in 39us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.850574:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784546688:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.850576:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784546752:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.850576:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82950 00010000:00010000:2.0:1713481296.850576:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850583:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850585:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.850590:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.850595:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.850596:0:15514:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295105924 gen 2 00010000:00010000:2.0:1713481296.850596:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.850598:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295105890 committed transno 4295105924 00010000:00010000:2.0:1713481296.850600:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850602:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.850604:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120baf180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.850606:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850609:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850613:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.850618:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.850619:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515904 00010000:00010000:2.0:1713481296.850621:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120baf180/0xdfc0fb148a3bb0e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xa9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.850622:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515904 00000100:00100000:0.0:1713481296.850624:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.850633:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295105891 committed transno 4295105924 00000100:00100000:0.0:1713481296.850634:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.850641:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.850644:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882515968 00000100:00100000:3.0:1713481296.850647:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882515968 00000004:00080000:1.0:1713481296.850659:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295105898 committed transno 4295105924 00000100:00100000:3.0:1713481296.850677:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98385 00000100:00100000:3.0:1713481296.850683:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:1958:x1796714882515904:12345-192.168.202.24@tcp:103:mrename.0 00000100:00100000:0.0:1713481296.850686:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.850690:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.850694:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516672 00000100:00100000:0.0:1713481296.850696:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516672 00000004:00080000:1.0:1713481296.850701:0:15514:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295105924 committed transno 4295105924 00010000:00010000:3.0:1713481296.850703:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a825d40/0xdfc0fb148a3b99b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ae9 expref: 2795 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850706:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516736 00000100:00100000:0.0:1713481296.850708:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516736 00000100:00100000:0.0:1713481296.850715:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563482 00000100:00100000:0.0:1713481296.850718:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20719:18792:x1796714882516672:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.850721:0:9218:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00010000:00010000:0.0:1713481296.850723:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.850725:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.850730:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3bc88 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc527:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bde expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.850736:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784546560:0@lo:1000:mdt_io00_009.0 00002000:00010000:0.0:1713481296.850740:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc527:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.850742:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:1958:x1796714882515904:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.850743:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2863:3493:x1796714784542528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9719us (9784us total) trans 4295960806 rc 0/0 00010000:00010000:0.0:1713481296.850746:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850747:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.850748:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563445 00000100:00100000:3.0:1713481296.850749:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98385 00010000:00010000:0.0:1713481296.850750:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3bc88 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc527:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bde expref: 20720 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850755:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007aa14fc0/0xdfc0fb148a3bc88 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc527:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bde expref: 20720 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850760:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007aa14fc0, rc 0) 00000100:00100000:2.0:1713481296.850762:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563483 00000100:00100000:2.0:1713481296.850765:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:17924:x1796714882516736:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.850770:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:18792:x1796714882516672:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 51us (128us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.850770:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.850774:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00000100:00100000:0.0:1713481296.850776:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563482 00010000:00010000:2.0:1713481296.850776:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3bc96 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49be5 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.850776:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98386 00010000:00010000:1.0:1713481296.850778:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.850781:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:1958:x1796714882515968:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:1.0:1713481296.850783:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.850788:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.850789:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784546816:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.850790:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b224d80/0xdfc0fb148a16273 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39859 expref: 24483 pid: 16469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.850793:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.850794:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.850796:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3bc96 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49be5 expref: 24483 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.850799:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124310000/0xdfc0fb148a3b741 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a25 expref: 2793 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850801:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.850803:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.850806:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b224d80/0xdfc0fb148a16273 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39859 expref: 24483 pid: 16469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.850811:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b224d80/0xdfc0fb148a16273 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39859 expref: 24483 pid: 16469 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.850812:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.850813:0:9218:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880091b3c000) 00000100:00100000:0.0:1713481296.850814:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.850816:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784546880:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.850827:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.850828:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.850829:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009090c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784544320:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.850830:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cfa1180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.850838:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516928 00000100:00100000:2.0:1713481296.850839:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516352 00000100:00100000:0.0:1713481296.850840:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516928 00000100:00100000:2.0:1713481296.850841:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516352 00010000:00010000:1.0:1713481296.850844:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.850844:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:1958:x1796714882515968:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 62us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.850846:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb1489d0043 lrc: 5/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2243a expref: 20720 pid: 16538 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1713481296.850851:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98386 00000100:00100000:1.0:1713481296.850853:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:1958:x1796714882513792:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5915us (5949us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.850853:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516608 00000100:00100000:2.0:1713481296.850854:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516608 00000100:00100000:1.0:1713481296.850858:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820588 00000100:00100000:0.0:1713481296.850861:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820609 00000100:00100000:2.0:1713481296.850861:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516800 00000100:00100000:2.0:1713481296.850862:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516800 00000100:00100000:0.0:1713481296.850864:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:1958:x1796714882516928:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.850868:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.850869:0:15577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516864 00010000:00010000:0.0:1713481296.850870:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb1489d0043 lrc: 5/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2243a expref: 20719 pid: 16538 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.850870:0:15577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516864 00010000:00010000:0.0:1713481296.850875:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb1489d0043 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2243a expref: 20719 pid: 16538 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.850880:0:15577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485906 00000100:00100000:2.0:1713481296.850883:0:15577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18678:x1796714882516352:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:3.0:1713481296.850885:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485907 00010000:00010000:0.0:1713481296.850887:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850888:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.850890:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009053e880/0xdfc0fb148a3bb85 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b8a expref: 16927 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.850890:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18933:x1796714882516608:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:0.0:1713481296.850894:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009053e880/0xdfc0fb148a3bb85 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b8a expref: 16927 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850901:0:15577:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1713481296.850905:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009053e880/0xdfc0fb148a3bb85 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b8a expref: 16927 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850910:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081ca0fc0/0xdfc0fb148a3b57a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa499ae expref: 2051 pid: 15484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.850911:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784546944:192.168.202.24@tcp:105: 00000004:00080000:1.0:1713481296.850920:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800772f7800/2, rc 0, transno 993510 00000100:00100000:0.0:1713481296.850921:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800890153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.850924:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800772f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784542528:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.850924:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800801a7840/0xdfc0fb148a07a9a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa34483 expref: 2050 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850932:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x0 (ffff880099cf8500) 00000100:00100000:0.0:1713481296.850939:0:6932:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485908 00000100:00100000:0.0:1713481296.850942:0:6932:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18948:x1796714882516800:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:1.0:1713481296.850946:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784547008:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.850946:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3a902 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4957f expref: 2049 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.850947:0:6932:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.850954:0:6932:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800986cd680/0xdfc0fb148a3bc9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bec expref: -99 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.850957:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88008ad2f200) 00000100:00100000:1.0:1713481296.850958:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.850959:0:15577:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.850965:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18933:x1796714882516608:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 74us (329us total) trans 0 rc -17/-17 00010000:00010000:2.0:1713481296.850967:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.850971:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00000100:00100000:3.0:1713481296.850972:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485907 00010000:00010000:2.0:1713481296.850976:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:1.0:1713481296.850978:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784546816 00000100:00100000:1.0:1713481296.850980:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784546816 00010000:00010000:2.0:1713481296.850982:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099264fc0/0xdfc0fb148a3bcab lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2c36:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:2.0:1713481296.850985:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099264fc0/0xdfc0fb148a3bcab lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.850988:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099264fc0/0xdfc0fb148a3bcab lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00000100:00100000:1.0:1713481296.850992:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82951 00000100:00100000:1.0:1713481296.850994:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:15514:x1796714784546816:12345-0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.850998:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485909 00010000:00010000:1.0:1713481296.850999:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.851000:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00000100:00100000:3.0:1713481296.851003:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2048:18811:x1796714882516864:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.851006:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:1.0:1713481296.851006:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e215d40/0xdfc0fb148a3bcb9 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3bc8f expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851011:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.851011:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.851013:0:15577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15577 initiator: MDT0 00010000:00010000:1.0:1713481296.851016:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e215d40/0xdfc0fb148a3bcb9 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3bc8f expref: 10 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851017:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00010000:00010000:2.0:1713481296.851020:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.851020:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bcce lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bf3 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851021:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:1.0:1713481296.851021:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e215d40/0xdfc0fb148a3bcb9 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bc8f expref: 10 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851023:0:15577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.851024:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00010000:00010000:1.0:1713481296.851025:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880122555500) 00010000:00010000:1.0:1713481296.851027:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.851028:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e215d40, rc 0) 00000100:00100000:1.0:1713481296.851042:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:15514:x1796714784546816:12345-0@lo:101:mdt_io00_009.0 Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.851046:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82951 00010000:00010000:0.0:1713481296.851047:0:6932:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851051:0:6932:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851054:0:6932:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00000004:00010000:0.0:1713481296.851063:0:6932:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00000100:00100000:1.0:1713481296.851065:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784546816:0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.851069:0:6932:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851072:0:6932:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT0 00010000:00010000:1.0:1713481296.851073:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851075:0:6932:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851078:0:6932:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:1.0:1713481296.851079:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.851080:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.851081:0:6932:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134fa5d40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.851082:0:6932:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851085:0:6932:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851089:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000004:00080000:1.0:1713481296.851089:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1713481296.851089:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.851091:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.851092:0:6932:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851095:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3bcb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.851096:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.851104:0:6932:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851107:0:6932:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.851108:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.851110:0:6932:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851112:0:6932:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af21c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.851114:0:6932:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.851114:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.851134:0:6932:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6932 initiator: MDT0 00000004:00200000:2.0:1713481296.851136:0:15577:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c3b:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.851138:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3931 (ffff88009d34a500) 00010000:00010000:0.0:1713481296.851140:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.851141:0:6932:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:0.0:1713481296.851144:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079af21c0/0xdfc0fb148a3bcc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6932 initiator: MDT0 00010000:00010000:3.0:1713481296.851144:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.851145:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.851148:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.851152:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.851154:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801302b06c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.851156:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.851159:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.851163:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c3b:0x0].0x0 (ffff880130556b00) 00010000:00010000:2.0:1713481296.851164:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.851166:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.851168:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3bcc0 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:0.0:1713481296.851172:0:6932:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800986cd680/0xdfc0fb148a3bc9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2171 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851182:0:6932:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2170 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.851183:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097da1200/0xdfc0fb148a3bcea lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.851185:0:6932:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880096f1ac00) 00010000:00010000:0.0:1713481296.851187:0:6932:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.851188:0:6932:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079af1200, rc 0) 00010000:00010000:3.0:1713481296.851190:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097da1200/0xdfc0fb148a3bcea lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.851196:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097da1200/0xdfc0fb148a3bcea lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.851199:0:6932:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2170:18948:x1796714882516800:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 256us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.851203:0:6932:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485908 00010000:00010000:1.0:1713481296.851207:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.851210:0:15577:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:1.0:1713481296.851211:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.851215:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.851215:0:15577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00000004:00200000:3.0:1713481296.851215:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c39:0x0]: returning size 4096 00010000:00010000:2.0:1713481296.851218:0:15577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15577 initiator: MDT1 00000004:00200000:3.0:1713481296.851218:0:15642:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713481296.851221:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547072:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.851221:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00010000:00010000:2.0:1713481296.851223:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801360898c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.851224:0:15577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.851226:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547008 00000100:00100000:0.0:1713481296.851227:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547008 00010000:00010000:2.0:1713481296.851227:0:15577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15577 initiator: MDT1 00000004:00010000:3.0:1713481296.851227:0:15642:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880097da1200/0xdfc0fb148a3bcea lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.851230:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88008ad2f200) 00010000:00010000:2.0:1713481296.851232:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.851233:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.851233:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.851234:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.851235:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801360898c0/0xdfc0fb148a3bca4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15577 initiator: MDT1 00000100:00100000:0.0:1713481296.851238:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563484 00010000:00010000:3.0:1713481296.851239:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.851240:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2863:3490:x1796714784547008:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.851241:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00000004:00010000:2.0:1713481296.851241:0:15577:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800798cb800 reply state ffff88007c1ae000 transno 4295107626 ns: mdt-lustre-MDT0001_UUID lock: ffff880099264fc0/0xdfc0fb148a3bcab lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15577 initiator: MDT1 00010000:00010000:3.0:1713481296.851244:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.851245:0:15577:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099264fc0/0xdfc0fb148a3bcab lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2c36:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15577 initiator: MDT1 00002000:00080000:0.0:1713481296.851248:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43535 count 1 00010000:00010000:2.0:1713481296.851248:0:15577:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x3231 (ffff880134a58300) 00010000:00010000:3.0:1713481296.851249:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.851250:0:8640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547072 00010000:00010000:2.0:1713481296.851250:0:15577:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.851251:0:15577:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713481296.851252:0:8640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547072 00010000:00010000:0.0:1713481296.851254:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.851254:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121dbe640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.851256:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.851261:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013464f840/0xdfc0fb14868954a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31c3 expref: 26806 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.851262:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.851263:0:8640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82952 00010000:00010000:0.0:1713481296.851265:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.851265:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.851265:0:8640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:15514:x1796714784547072:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.851267:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.851267:0:15577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_025:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18678:x1796714882516352:12345-192.168.202.24@tcp:36:rm.0 Request processed in 383us (642us total) trans 4295107626 rc 0/0 00010000:00010000:3.0:1713481296.851269:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.851270:0:8640:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.851272:0:15577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485906 00010000:00010000:3.0:1713481296.851272:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.851274:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:1.0:1713481296.851275:0:8640:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2173c0/0xdfc0fb148a3bcff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3bcf1 expref: -99 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851277:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013464f840/0xdfc0fb14868954a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31c3 expref: 26806 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.851279:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bcdc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.851282:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013464f840/0xdfc0fb14868954a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31c3 expref: 26806 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.851286:0:8640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2173c0/0xdfc0fb148a3bcff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3bcf1 expref: 11 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.851288:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784547136:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.851292:0:8640:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2173c0/0xdfc0fb148a3bcff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bcf1 expref: 11 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.851295:0:8640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.851296:0:8640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.851296:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.851298:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089015cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.851298:0:8640:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2173c0, rc 0) 00010000:00010000:3.0:1713481296.851302:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00010000:00010000:3.0:1713481296.851307:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.851311:0:8640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:15514:x1796714784547072:12345-0@lo:101:mdt_io00_009.0 Request processed in 45us (77us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.851311:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097da2d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:3.0:1713481296.851313:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.851314:0:8640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82952 00010000:00010000:3.0:1713481296.851318:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.851319:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.851325:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff8800842d0e00) 00010000:00010000:3.0:1713481296.851327:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713481296.851329:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.851330:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882516992 00000100:00100000:0.0:1713481296.851331:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882516992 00010000:00010000:3.0:1713481296.851334:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bce3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.851336:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547072:0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.851339:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942d2640/0xdfc0fb14891eff1 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb7a1 expref: 20720 pid: 16533 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.851342:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.851347:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.851349:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820610 00000100:00100000:0.0:1713481296.851351:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:1958:x1796714882516992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.851354:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713481296.851355:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.851358:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942d2640/0xdfc0fb14891eff1 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb7a1 expref: 20720 pid: 16533 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.851363:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942d2640/0xdfc0fb14891eff1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb7a1 expref: 20720 pid: 16533 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.851363:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.851366:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:3.0:1713481296.851368:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bcce lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bf3 expref: 2051 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.851370:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.851375:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.851376:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.851377:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547200:0@lo:101:mdt_io00_009.0 00010000:00010000:0.0:1713481296.851378:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800898a0b40/0xdfc0fb148a3bbb6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b9f expref: 16927 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851380:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb1489d0043 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2243a expref: 20720 pid: 16538 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.851382:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800898a0b40/0xdfc0fb148a3bbb6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b9f expref: 16927 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.851387:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097da1200/0xdfc0fb148a3bcea lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bf3 expref: 2050 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.851388:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.851389:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784544256:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.851393:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800898a0b40/0xdfc0fb148a3bbb6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b9f expref: 16927 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.851393:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff88009e45d600) 00000100:00100000:1.0:1713481296.851395:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.851395:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713481296.851397:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097da1200, rc 0) 00000100:00100000:0.0:1713481296.851398:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784547264:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.851404:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547200 00000100:00100000:1.0:1713481296.851405:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547200 00010000:00010000:2.0:1713481296.851407:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009053e880/0xdfc0fb148a3bb85 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b8a expref: 16927 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.851409:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096dbd000 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.851413:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009053e880, rc 0) 00000100:00100000:1.0:1713481296.851416:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82953 00000100:00100000:3.0:1713481296.851418:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18811:x1796714882516864:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 412us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.851419:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+11:15514:x1796714784547200:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.851423:0:15522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.851424:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16927:18817:x1796714882514944:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6525us (6620us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.851425:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485909 00000100:00100000:2.0:1713481296.851428:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563457 00010000:00010000:1.0:1713481296.851430:0:15522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0e86c0/0xdfc0fb148a3bd0d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3bd06 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.851438:0:15522:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0e86c0/0xdfc0fb148a3bd0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3bd06 expref: 12 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.851443:0:15522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0e86c0/0xdfc0fb148a3bd0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bd06 expref: 12 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.851445:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.851447:0:15522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3931 (ffff880121573000) 00010000:00010000:1.0:1713481296.851448:0:15522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.851449:0:15522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0e86c0, rc 0) 00010000:00010000:2.0:1713481296.851452:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942d2640/0xdfc0fb14891eff1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb7a1 expref: 20719 pid: 16533 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.851455:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.851460:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16528:1796714784544384:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.851463:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517056 00000100:00100000:0.0:1713481296.851465:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517056 00000100:00100000:1.0:1713481296.851468:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547200:12345-0@lo:101:mdt_io00_009.0 Request processed in 49us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.851471:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82953 00000100:00100000:3.0:1713481296.851473:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784544512:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.851474:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517120 00000100:00100000:0.0:1713481296.851476:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517120 00010000:00010000:2.0:1713481296.851478:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800898a0b40/0xdfc0fb148a3bbb6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8064:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b9f expref: 16926 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851482:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800898a0b40, rc 0) 00000100:00100000:0.0:1713481296.851483:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563485 00000100:00100000:0.0:1713481296.851485:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26807:17935:x1796714882517056:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.851490:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.851493:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16926:18836:x1796714882515136:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6304us (6348us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.851494:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784544448:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.851494:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800914c5b00/0xdfc0fb148a3bbd2 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bbb expref: 26807 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851496:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079af0000/0xdfc0fb148a3bd14 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb79b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49bfa expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.851496:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563459 00002000:00010000:0.0:1713481296.851505:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb79b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.851505:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c5b00, rc 0) 00010000:00010000:1.0:1713481296.851509:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008491db00/0xdfc0fb148a3bbbd lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bad expref: 26808 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.851509:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563486 00010000:00010000:0.0:1713481296.851511:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.851511:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20719:15045:x1796714882517120:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.851512:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.851515:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af0000/0xdfc0fb148a3bd14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bfa expref: 26808 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851516:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.851519:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008491db00, rc 0) 00010000:00010000:0.0:1713481296.851521:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880079af0000/0xdfc0fb148a3bd14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bfa expref: 26808 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.851521:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:11552:x1796714882515648:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4160us (4234us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.851522:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3bd1b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c01 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.851525:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079af0000, rc 0) 00000100:00100000:3.0:1713481296.851528:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563463 00000100:00100000:1.0:1713481296.851529:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:11388:x1796714882515520:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4356us (4420us total) trans 0 rc 0/0 00002000:00010000:2.0:1713481296.851529:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.851534:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563461 00000100:00100000:0.0:1713481296.851535:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:17935:x1796714882517056:12345-192.168.202.24@tcp:101:dd.0 Request processed in 48us (89us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.851536:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.851537:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.851538:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563485 00010000:00010000:2.0:1713481296.851539:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3bd1b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c01 expref: 20720 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851545:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084958d80/0xdfc0fb148a3bd1b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c01 expref: 20720 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851549:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084958d80, rc 0) 00000100:00100000:1.0:1713481296.851551:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547200:0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.851557:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.851557:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:15045:x1796714882517120:12345-192.168.202.24@tcp:101:dd.0 Request processed in 45us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.851560:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563486 00010000:00010000:1.0:1713481296.851562:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.851569:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:1.0:1713481296.851581:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547328:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713481296.851593:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.851600:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b96ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.851607:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.851609:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547328 00000100:00100000:1.0:1713481296.851611:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547328 00000100:00100000:1.0:1713481296.851620:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82954 00000100:00100000:2.0:1713481296.851621:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517184 00000100:00100000:1.0:1713481296.851623:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547328:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:2.0:1713481296.851624:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517184 00000100:00100000:0.0:1713481296.851626:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.851632:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099a4d680/0xdfc0fb148942427 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e2 expref: 24484 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.851642:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517248 00000100:00100000:2.0:1713481296.851644:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517248 00000100:00100000:0.0:1713481296.851647:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.851649:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547328:12345-0@lo:1000:mdt_io00_009.0 Request processed in 25us (55us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.851650:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e096880/0xdfc0fb14895a050 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeca9 expref: 26806 pid: 15510 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.851653:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82954 00000100:00100000:3.0:1713481296.851656:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820611 00000100:00100000:0.0:1713481296.851673:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.851677:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820612 00000100:00100000:3.0:1713481296.851679:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1959:x1796714882517184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.851680:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1959:x1796714882517248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.851682:0:15535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517376 00010000:00010000:2.0:1713481296.851684:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.851685:0:15535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517376 00000100:00100000:0.0:1713481296.851686:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517440 00000100:00100000:0.0:1713481296.851688:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517440 00010000:00010000:3.0:1713481296.851690:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.851692:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e096880/0xdfc0fb14895a050 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeca9 expref: 26806 pid: 15510 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.851696:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099a4d680/0xdfc0fb148942427 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e2 expref: 24484 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.851698:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e096880/0xdfc0fb14895a050 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeca9 expref: 26806 pid: 15510 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.851701:0:15535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125703 00000100:00100000:1.0:1713481296.851705:0:15535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2050:18991:x1796714882517376:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1713481296.851706:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125704 00010000:00010000:3.0:1713481296.851707:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099a4d680/0xdfc0fb148942427 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e2 expref: 24484 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.851709:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2170:18578:x1796714882517440:12345-192.168.202.24@tcp:37:rm.0 00010000:00010000:2.0:1713481296.851710:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e096880/0xdfc0fb14895a050 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eeca9 expref: 26806 pid: 15510 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.851717:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.851718:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.851721:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800914c5b00/0xdfc0fb148a3bbd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bbb expref: 26805 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851725:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800914c5b00/0xdfc0fb148a3bbd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bbb expref: 26805 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.851729:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a4d680/0xdfc0fb148942427 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e2 expref: 24484 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.851736:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800914c5b00/0xdfc0fb148a3bbd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bbb expref: 26805 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.851742:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15497:1796714784547392:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.851743:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.851744:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.851747:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008491db00/0xdfc0fb148a3bbbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bad expref: 26805 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.851754:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3d900 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.851761:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008491db00/0xdfc0fb148a3bbbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bad expref: 26805 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.851766:0:15535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18991:x1796714882517376:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 60us (117us total) trans 4295107627 rc 0/0 00000100:00100000:1.0:1713481296.851770:0:15535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125703 00000100:00100000:2.0:1713481296.851771:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784544640:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.851779:0:15529:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008491db00/0xdfc0fb148a3bbbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bad expref: 26805 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.851788:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.851789:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:15529:1796714784547456:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.851792:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547328:0@lo:1000:mdt_io00_009.0 00000100:00100000:3.0:1713481296.851807:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.851819:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547520:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713481296.851833:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.851840:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b96ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.851847:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547520 00000100:00100000:1.0:1713481296.851849:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547520 00000100:00100000:1.0:1713481296.851858:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82955 00000100:00100000:1.0:1713481296.851860:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547520:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713481296.851892:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547520:12345-0@lo:1000:mdt_io00_009.0 Request processed in 31us (59us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.851896:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82955 00000100:00100000:1.0:1713481296.851914:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547520:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713481296.851940:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801201a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547584:0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713481296.851951:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.851958:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a4e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.851964:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547584 00000100:00100000:1.0:1713481296.851966:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547584 00000100:00100000:1.0:1713481296.851983:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82956 00000100:00100000:1.0:1713481296.851985:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547584:12345-0@lo:1000:mdt_io00_009.0 00000100:00100000:1.0:1713481296.852017:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547584:12345-0@lo:1000:mdt_io00_009.0 Request processed in 30us (64us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.852020:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82956 00000100:00100000:1.0:1713481296.852039:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547584:0@lo:1000:mdt_io00_009.0 00010000:00010000:1.0:1713481296.852064:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.852068:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.852072:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:1.0:1713481296.852077:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547648:0@lo:101:mdt_io00_009.0 00000100:00100000:1.0:1713481296.852088:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.852094:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.852101:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547648 00000100:00100000:1.0:1713481296.852103:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547648 00000100:00100000:1.0:1713481296.852133:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82957 00000100:00100000:1.0:1713481296.852136:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801201a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15514:x1796714784547648:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.852140:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.852146:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3bd22 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.852155:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2171 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.852160:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 4/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.852169:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2171 pid: 6932 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.852174:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2171 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.852180:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784547712:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.852189:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091cedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.852210:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.852220:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517504 00000100:00100000:2.0:1713481296.852223:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517504 00010000:00010000:2.0:1713481296.852232:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084818480/0xdfc0fb148802f9a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963084 expref: 20720 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.852243:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820613 00000100:00100000:2.0:1713481296.852246:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:1958:x1796714882517504:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.852249:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.852252:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084818480/0xdfc0fb148802f9a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963084 expref: 20720 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.852257:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084818480/0xdfc0fb148802f9a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963084 expref: 20720 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.852270:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084818480/0xdfc0fb148802f9a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963084 expref: 20720 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.852278:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.852279:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.852281:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852288:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852298:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.852307:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20719:1958:x1796714882517504:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.852311:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820613 00010000:00010000:2.0:1713481296.852327:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852332:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852336:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852340:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852343:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852346:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fe04240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.852348:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852355:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852362:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852366:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fe04240/0xdfc0fb148a3bbe7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.852477:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+272:3490:x1796714784544576:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4497us (4694us total) trans 4296040935 rc 0/0 00000100:00100000:2.0:1713481296.852481:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563464 00000004:00080000:0.0:1713481296.852500:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801201a7480/2, rc 0, transno 1073639 00000100:00100000:0.0:1713481296.852505:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801201a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784544576:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.852530:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713481296.852534:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784547776:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.852547:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.852553:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547776 00000100:00100000:2.0:1713481296.852555:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547776 00000100:00100000:2.0:1713481296.852566:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563487 00000100:00100000:2.0:1713481296.852569:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+272:3490:x1796714784547776:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.852576:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10081 count 1 00010000:00010000:2.0:1713481296.852584:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852590:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c582ac0/0xdfc0fb148802b72 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963117 expref: 20718 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.852594:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.852594:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.852596:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.852606:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c582ac0/0xdfc0fb148802b72 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963117 expref: 20718 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.852612:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c582ac0/0xdfc0fb148802b72 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963117 expref: 20718 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.852617:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784547840:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.852633:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ef00 going to sleep for 11 seconds 00000001:00080000:3.0:1713481296.855422:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040926 00002000:00080000:3.0:1713481296.855513:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57554 00000100:00100000:2.0:1713481296.855564:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784545152:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.855595:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.855601:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784545216:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.855622:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784544960:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.855624:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.855640:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.855660:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16925:1959:x1796714882515200:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7217us (7305us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.855680:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.855680:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820597 00000100:00100000:1.0:1713481296.855744:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.855759:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517632 00000100:00100000:2.0:1713481296.855761:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517632 00010000:00010000:2.0:1713481296.855772:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c5833c0/0xdfc0fb148802b56 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630d1 expref: 20719 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.855783:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517568 00000100:00100000:2.0:1713481296.855785:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517568 00000100:00100000:3.0:1713481296.855788:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078c34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784545408:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.855789:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.855790:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800922b4d80/0xdfc0fb148802faf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630ae expref: 20720 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.855800:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820614 00000100:00100000:2.0:1713481296.855803:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20720:1960:x1796714882517632:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.855808:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.855811:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c5833c0/0xdfc0fb148802b56 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630d1 expref: 20720 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.855811:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.855816:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c5833c0/0xdfc0fb148802b56 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630d1 expref: 20720 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.855825:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784546112:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.855832:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c5833c0/0xdfc0fb148802b56 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x275d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630d1 expref: 20720 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.855839:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820615 00010000:00010000:1.0:1713481296.855841:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.855845:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20719:1960:x1796714882517568:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.855847:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.855848:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.855851:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.855854:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.855858:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.855859:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800922b4d80/0xdfc0fb148802faf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630ae expref: 20719 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.855868:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800922b4d80/0xdfc0fb148802faf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630ae expref: 20719 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.855869:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784545792:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.855876:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.855883:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800922b4d80/0xdfc0fb148802faf lrc: 0/0,0 mode: --/PR res: [0x280000408:0x275c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630ae expref: 20719 pid: 15499 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.855885:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.855896:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20718:1960:x1796714882517632:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.855897:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.855897:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.855899:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.855901:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.855901:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820614 00010000:00010000:3.0:1713481296.855902:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.855907:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.855909:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.855911:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.855915:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.855918:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096b45200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.855920:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.855924:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.855928:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.855933:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.855933:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784545536:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.855937:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3bc18 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x275d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.855951:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:1960:x1796714882517568:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 104us (205us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.855958:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.855958:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820615 00000100:00100000:2.0:1713481296.855978:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081eced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784545344:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.856001:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16462:1796714784545600:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.856007:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856028:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856046:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856053:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856061:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856067:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.856071:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+274:3490:x1796714784544896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7311us (7522us total) trans 4296040937 rc 0/0 00010000:00010000:3.0:1713481296.856075:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.856077:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563466 00010000:00010000:3.0:1713481296.856081:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fe073c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.856085:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856092:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.856096:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517696 00000100:00100000:1.0:1713481296.856098:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517696 00010000:00010000:3.0:1713481296.856110:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856116:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bc11 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x275c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.856135:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563488 00000100:00100000:1.0:1713481296.856139:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009090c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16925:8499:x1796714882517696:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.856145:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.856153:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800834ae880/0xdfc0fb148a3bd37 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c08 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.856165:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991def40/0xdfc0fb1488e7e6f lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b553a expref: 16926 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.856169:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.856170:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.856172:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800834ae880/0xdfc0fb148a3bd37 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c08 expref: 16926 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.856183:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991def40/0xdfc0fb1488e7e6f lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b553a expref: 16926 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.856188:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991def40/0xdfc0fb1488e7e6f lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b553a expref: 16926 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.856195:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784547904:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.856211:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086caed80 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.856232:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120253b80/2, rc 0, transno 1073641 00000100:00100000:1.0:1713481296.856238:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784544896:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.856272:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.856277:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784547968:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.856294:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.856296:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+274:3490:x1796714784544832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7569us (7786us total) trans 4296040938 rc 0/0 00000100:00100000:3.0:1713481296.856304:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563465 00000100:00100000:2.0:1713481296.856308:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784547968 00000100:00100000:2.0:1713481296.856312:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784547968 00000100:00100000:2.0:1713481296.856327:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563489 00000100:00100000:2.0:1713481296.856330:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+274:3493:x1796714784547968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.856340:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10082 count 1 00010000:00010000:2.0:1713481296.856349:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.856356:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077a83100/2, rc 0, transno 1073642 00010000:00010000:2.0:1713481296.856357:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c186c0/0xdfc0fb148802b79 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963125 expref: 20716 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.856361:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.856361:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.856363:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.856373:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085c186c0/0xdfc0fb148802b79 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963125 expref: 20716 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.856377:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784544832:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.856382:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085c186c0/0xdfc0fb148802b79 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963125 expref: 20716 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.856388:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784548032:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.856395:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784548096:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.856408:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0001_UUID:16488:1796714784545856:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.856412:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009af53480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.856414:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.856430:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.856435:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f935880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784546176:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.856450:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.856457:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784548096 00000100:00100000:2.0:1713481296.856460:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1959:x1796714882515456:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6343us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.856460:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784548096 00000100:00100000:2.0:1713481296.856465:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820608 00000100:00100000:3.0:1713481296.856481:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563490 00000100:00100000:3.0:1713481296.856486:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+275:3493:x1796714784548096:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.856499:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10083 count 1 00010000:00010000:3.0:1713481296.856511:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856522:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083114fc0/0xdfc0fb148802b80 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963133 expref: 20716 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.856527:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.856528:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784546624:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.856528:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.856529:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.856532:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856549:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083114fc0/0xdfc0fb148802b80 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963133 expref: 20716 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.856554:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.856558:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083114fc0/0xdfc0fb148802b80 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963133 expref: 20716 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.856564:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518080 00000100:00100000:1.0:1713481296.856566:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.856566:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518080 00000100:00100000:3.0:1713481296.856569:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784548160:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.856577:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518592 00000100:00100000:2.0:1713481296.856578:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518592 00000100:00100000:2.0:1713481296.856588:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563491 00000100:00100000:2.0:1713481296.856590:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16927:17009:x1796714882518080:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.856594:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a6503600 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.856595:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.856602:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3bd4c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c0f expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.856609:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784547712:192.168.202.24@tcp:104: 00002000:00010000:2.0:1713481296.856615:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713481296.856620:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563492 00010000:00010000:2.0:1713481296.856621:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.856622:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.856625:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3bd4c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c0f expref: 16928 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.856625:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:18792:x1796714882518592:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.856627:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 3/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.856631:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009708d440/0xdfc0fb148a3bd4c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c0f expref: 16928 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.856632:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880096f1ac00) 00010000:00010000:1.0:1713481296.856634:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713481296.856635:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.856636:0:15506:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 3/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.856636:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009708d440, rc 0) 00010000:00010000:1.0:1713481296.856640:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800834add40, rc 0) 00010000:00010000:3.0:1713481296.856646:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097da2880/0xdfc0fb148a3bd53 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc528:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c16 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.856649:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16928:17009:x1796714882518080:12345-192.168.202.24@tcp:101:dd.0 Request processed in 57us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.856653:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563491 00000100:00100000:1.0:1713481296.856657:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801201a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15514:x1796714784547648:12345-0@lo:101:mdt_io00_009.0 Request processed in 4520us (4568us total) trans 0 rc 0/0 00002000:00010000:3.0:1713481296.856660:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc528:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.856661:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82957 00010000:00010000:3.0:1713481296.856683:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.856684:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.856689:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097da2880/0xdfc0fb148a3bd53 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc528:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c16 expref: 20718 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.856694:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15497:1796714784547392:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.856701:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097da2880/0xdfc0fb148a3bd53 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc528:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c16 expref: 20718 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.856706:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784547648:0@lo:101:mdt_io00_009.0 00010000:00010000:2.0:1713481296.856708:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.856709:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097da2880, rc 0) 00010000:00010000:1.0:1713481296.856716:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.856720:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26805:1959:x1796714882517248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5039us (5093us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.856721:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.856725:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820612 00000100:00100000:3.0:1713481296.856731:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20718:18792:x1796714882518592:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 105us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.856737:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563492 00000100:00100000:2.0:1713481296.856747:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784546880:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.856767:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3bc96 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49be5 expref: 24482 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.856773:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.856774:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d8f9b00, rc 0) 00000100:00100000:3.0:1713481296.856778:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784546688:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.856783:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518912 00000100:00100000:2.0:1713481296.856784:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:17924:x1796714882516736:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6018us (6098us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.856785:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518912 00000100:00100000:2.0:1713481296.856789:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563483 00000100:00100000:1.0:1713481296.856800:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485910 00000100:00100000:1.0:1713481296.856803:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2051:18811:x1796714882518912:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.856805:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.856810:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784547840:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.856814:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.856815:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2170:18578:x1796714882517440:12345-192.168.202.24@tcp:37:rm.0 Request processed in 5102us (5148us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.856821:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121610480/0xdfc0fb148a3bd5a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c1d expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.856822:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125704 00010000:00010000:2.0:1713481296.856828:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.856837:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:15529:1796714784547456:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.856855:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.856870:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.856873:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1959:x1796714882517184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5211us (5265us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.856876:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856880:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.856881:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820611 00010000:00010000:1.0:1713481296.856886:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.856889:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856893:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.856926:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e368000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784545472:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.856931:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c581680/0xdfc0fb148a3bd6f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.856935:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c581680/0xdfc0fb148a3bd6f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cba:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856937:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c581680/0xdfc0fb148a3bd6f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cba:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.856944:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713481296.856958:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cba:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.856961:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713481296.856970:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784547264:192.168.202.24@tcp:105: 00000004:00010000:1.0:1713481296.856970:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c581680/0xdfc0fb148a3bd6f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cba:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856975:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856978:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856981:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856984:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856987:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121610240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.856989:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.856991:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.856992:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.856996:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x0 (ffff88009e45d600) 00010000:00010000:1.0:1713481296.856998:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.857000:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857003:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bd61 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.857006:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:1958:x1796714882516992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5653us (5686us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.857011:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820610 00010000:00010000:1.0:1713481296.857017:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857020:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857023:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857026:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121613840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.857027:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857030:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857033:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c39:0x0].0x35 (ffff88009c144f00) 00010000:00010000:1.0:1713481296.857034:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.857035:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857038:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bd68 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c39:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.857041:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e368700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784545984:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.857053:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.857059:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121610480/0xdfc0fb148a3bd5a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c39:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c1d expref: 2053 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857067:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c581680/0xdfc0fb148a3bd6f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cba:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c1d expref: 2052 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857071:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cba:0x0].0x0 (ffff88009c144600) 00010000:00010000:1.0:1713481296.857072:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1713481296.857073:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c581680, rc 0) 00000100:00100000:1.0:1713481296.857087:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2052:18811:x1796714882518912:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 283us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.857091:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485910 00000100:00100000:0.0:1713481296.857109:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1959:x1796714882515328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7052us (7213us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.857114:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820607 00000100:00100000:1.0:1713481296.857150:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.857164:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518976 00000100:00100000:1.0:1713481296.857166:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518976 00000100:00100000:1.0:1713481296.857177:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485911 00000100:00100000:1.0:1713481296.857180:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2170:18678:x1796714882518976:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:1.0:1713481296.857185:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.857192:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c583840/0xdfc0fb148a3bd76 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c24 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857233:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857238:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857242:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857248:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x230:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857252:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857255:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857273:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5821c0/0xdfc0fb148a3bd8b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857277:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5821c0/0xdfc0fb148a3bd8b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857281:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5821c0/0xdfc0fb148a3bd8b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000004:00010000:1.0:1713481296.857288:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5821c0/0xdfc0fb148a3bd8b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857293:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857296:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857299:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857302:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857304:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c580d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.857306:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857309:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857313:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88012ba3a500) 00010000:00010000:1.0:1713481296.857314:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.857316:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857318:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c580d80/0xdfc0fb148a3bd7d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857331:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857334:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857337:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857340:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c581440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.857341:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857344:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857347:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x35 (ffff8800982b2000) 00010000:00010000:1.0:1713481296.857348:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.857349:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857351:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c581440/0xdfc0fb148a3bd84 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713481296.857378:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007710b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784546368:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.857378:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c583840/0xdfc0fb148a3bd76 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c24 expref: 2172 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857386:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5821c0/0xdfc0fb148a3bd8b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c24 expref: 2171 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857390:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88009c4f1100) 00010000:00010000:1.0:1713481296.857391:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.857392:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c5821c0, rc 0) 00010000:00010000:0.0:1713481296.857401:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.857405:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:18678:x1796714882518976:12345-192.168.202.24@tcp:101:rm.0 Request processed in 225us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.857409:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485911 00000100:00100000:0.0:1713481296.857423:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077109f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784546496:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.857437:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.857448:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.857451:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784546944:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.857462:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.857466:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.857476:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20716:1958:x1796714882516928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6611us (6647us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.857480:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820609 00000100:00100000:2.0:1713481296.857481:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519040 00000100:00100000:2.0:1713481296.857484:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519040 00000100:00100000:1.0:1713481296.857486:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.857501:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519104 00000100:00100000:2.0:1713481296.857503:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519104 00000100:00100000:1.0:1713481296.857504:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.857510:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519168 00000100:00100000:2.0:1713481296.857512:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563493 00000100:00100000:3.0:1713481296.857514:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519168 00000100:00100000:2.0:1713481296.857515:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26805:18817:x1796714882519040:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.857520:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.857523:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.857526:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518464 00010000:00010000:2.0:1713481296.857526:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3bd92 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c2b expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.857528:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518464 00000100:00100000:1.0:1713481296.857535:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.857537:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563494 00010000:00010000:2.0:1713481296.857538:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120906640/0xdfc0fb1489d012a lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22480 expref: 24479 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.857542:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1713481296.857542:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16929:17935:x1796714882519104:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.857543:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb14868953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31a7 expref: 26807 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.857543:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.857545:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3bd92 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c2b expref: 26807 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.857550:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.857555:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518848 00000100:00100000:0.0:1713481296.857557:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518848 00010000:00010000:2.0:1713481296.857558:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120906640/0xdfc0fb1489d012a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22480 expref: 24479 pid: 16460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.857562:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c582ac0/0xdfc0fb148802b72 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963117 expref: 20716 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.857563:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097da06c0/0xdfc0fb148a3bd99 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c32 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.857567:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.857570:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518336 00000100:00100000:0.0:1713481296.857571:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518336 00010000:00010000:2.0:1713481296.857571:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120906640/0xdfc0fb1489d012a lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22480 expref: 24479 pid: 16460 timeout: 815 lvb_type: 0 00002000:00010000:3.0:1713481296.857576:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.857577:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013464f840/0xdfc0fb14868954a lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31c3 expref: 26808 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.857580:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.857580:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784548224:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.857585:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518656 00000100:00100000:0.0:1713481296.857586:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518656 00010000:00010000:3.0:1713481296.857586:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.857587:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519232 00010000:00010000:3.0:1713481296.857588:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.857589:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519232 00010000:00010000:0.0:1713481296.857591:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097dc58c0/0xdfc0fb148a13f26 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0xc17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38026 expref: 20717 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.857593:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097da06c0/0xdfc0fb148a3bd99 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c32 expref: 16930 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.857599:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.857600:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485912 00000100:00100000:1.0:1713481296.857602:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2052:18948:x1796714882519232:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:0.0:1713481296.857603:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820616 00010000:00010000:3.0:1713481296.857604:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097da06c0/0xdfc0fb148a3bd99 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c32 expref: 16930 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.857606:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26808:1958:x1796714882518464:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.857608:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.857610:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.857612:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097da06c0, rc 0) 00010000:00010000:0.0:1713481296.857613:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb14868953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31a7 expref: 26808 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.857613:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c582f40/0xdfc0fb148a3bda0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c40 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.857617:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563495 00010000:00010000:0.0:1713481296.857619:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb14868953c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31a7 expref: 26808 pid: 16491 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.857620:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16930:18844:x1796714882519168:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.857626:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.857633:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb14868953c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31a7 expref: 26808 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.857633:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bda7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c39 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.857633:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16930:17935:x1796714882519104:12345-192.168.202.24@tcp:101:dd.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.857641:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563494 00002000:00010000:2.0:1713481296.857642:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.857644:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.857645:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.857647:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857650:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583cc0/0xdfc0fb148a3bdae lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.857650:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.857650:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.857651:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.857653:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bda7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c39 expref: 16931 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857654:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583cc0/0xdfc0fb148a3bdae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.857658:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583cc0/0xdfc0fb148a3bdae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.857659:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007da38b40/0xdfc0fb148a3bda7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c39 expref: 16930 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.857660:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.857681:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007da38b40, rc 0) 00000100:00100000:3.0:1713481296.857689:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820617 00000100:00100000:0.0:1713481296.857690:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26807:1958:x1796714882518464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.857695:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820616 00000100:00100000:3.0:1713481296.857695:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:1958:x1796714882518848:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.857698:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16930:18844:x1796714882519168:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.857704:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563495 00010000:00010000:3.0:1713481296.857704:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.857708:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820618 00010000:00010000:3.0:1713481296.857710:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c582ac0/0xdfc0fb148802b72 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963117 expref: 20717 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.857711:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1958:x1796714882518336:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.857716:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.857719:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013464f840/0xdfc0fb14868954a lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31c3 expref: 26806 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.857724:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c582ac0/0xdfc0fb148802b72 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963117 expref: 20717 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.857725:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013464f840/0xdfc0fb14868954a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31c3 expref: 26806 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.857733:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820619 00010000:00010000:0.0:1713481296.857736:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.857737:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:1.0:1713481296.857738:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2aaf:0x0]: returning size 4096 00000100:00100000:2.0:1713481296.857738:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:1958:x1796714882518656:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.857739:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713481296.857740:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713481296.857743:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.857744:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.857746:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c582ac0/0xdfc0fb148802b72 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963117 expref: 20717 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.857749:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.857755:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097dc58c0/0xdfc0fb148a13f26 lrc: 5/0,0 mode: PR/PR res: [0x280000407:0xc17a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38026 expref: 20716 pid: 15507 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.857758:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1958:x1796714882518336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 46us (222us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.857758:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c582f40/0xdfc0fb148a3bda0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c40 expref: 2054 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.857762:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820618 00010000:00010000:2.0:1713481296.857764:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097dc58c0/0xdfc0fb148a13f26 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc17a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38026 expref: 20716 pid: 15507 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.857764:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.857766:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.857769:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857771:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583cc0/0xdfc0fb148a3bdae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c40 expref: 2053 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857775:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880084aad100) 00010000:00010000:0.0:1713481296.857776:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857776:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713481296.857776:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857778:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c583cc0, rc 0) 00010000:00010000:0.0:1713481296.857781:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.857783:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.857785:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.857785:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.857789:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3bc81 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc17a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bd0 expref: 20716 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.857790:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.857792:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2053:18948:x1796714882519232:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 189us (211us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.857794:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.857795:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485912 00010000:00010000:0.0:1713481296.857797:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa15d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.857797:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.857798:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3bc81 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xc17a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bd0 expref: 20716 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.857799:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.857802:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.857809:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.857812:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3bc6c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.857816:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20716:1958:x1796714882518848:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 121us (292us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.857817:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3bc81 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xc17a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bd0 expref: 20716 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.857823:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820617 00000100:00100000:1.0:1713481296.857826:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.857826:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784548288:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.857838:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.857844:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3d900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.857845:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519296 00000100:00100000:1.0:1713481296.857847:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519296 00000100:00100000:3.0:1713481296.857858:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519360 00000100:00100000:1.0:1713481296.857859:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485913 00000100:00100000:3.0:1713481296.857861:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519360 00000100:00100000:1.0:1713481296.857862:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2053:18805:x1796714882519296:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.857862:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857867:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.857870:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857872:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c582640/0xdfc0fb148a3bdb5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c4e expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.857879:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563496 00010000:00010000:2.0:1713481296.857882:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.857882:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16930:18836:x1796714882519360:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713481296.857888:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.857889:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.857895:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.857896:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097da0fc0/0xdfc0fb148a3bdbc lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c47 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.857900:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708e400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.857903:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857910:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.857910:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.857910:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d45200/0xdfc0fb14891f26e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb922 expref: 20715 pid: 9201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857915:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.857915:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.857916:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.857918:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097da0fc0/0xdfc0fb148a3bdbc lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c47 expref: 16931 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857919:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.857925:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857926:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713481296.857928:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d45200/0xdfc0fb14891f26e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb922 expref: 20715 pid: 9201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857930:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.857931:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009708e400/0xdfc0fb148a3bd30 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.857933:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2864:3491:x1796714784546240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7508us (7577us total) trans 4295960807 rc 0/0 00010000:00010000:1.0:1713481296.857933:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.857934:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d45200/0xdfc0fb14891f26e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb922 expref: 20715 pid: 9201 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.857938:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563478 00000100:00100000:3.0:1713481296.857940:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784548352:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.857954:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f126c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.857958:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c774b40/0xdfc0fb148a3bdd1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.857962:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c774b40/0xdfc0fb148a3bdd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.857965:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c774b40/0xdfc0fb148a3bdd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.857971:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013464f840/0xdfc0fb14868954a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31c3 expref: 26805 pid: 16509 timeout: 815 lvb_type: 1 00000004:00200000:1.0:1713481296.857975:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cbb:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.857977:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713481296.857981:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784547136:192.168.202.24@tcp:104: 00000004:00010000:1.0:1713481296.857981:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c774b40/0xdfc0fb148a3bdd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.857985:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.857988:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.857991:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.857994:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.857995:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.857999:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c580fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.858000:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858001:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.858003:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858004:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.858007:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858008:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.858009:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.858010:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.858011:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858013:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c580fc0/0xdfc0fb148a3bdc3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.858014:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858017:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af3cc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.858019:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858021:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.858023:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858024:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.858027:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.858029:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c583180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.858030:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858030:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.858033:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.858037:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bcf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858037:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff8801314b4900) 00010000:00010000:1.0:1713481296.858038:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.858039:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.858042:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583180/0xdfc0fb148a3bdca lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.858060:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c582640/0xdfc0fb148a3bdb5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c4e expref: 2055 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858068:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c774b40/0xdfc0fb148a3bdd1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c4e expref: 2054 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858071:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbb:0x0].0x0 (ffff88008ad2f600) 00010000:00010000:1.0:1713481296.858073:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1713481296.858074:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c774b40, rc 0) 00000100:00100000:2.0:1713481296.858077:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+276:3490:x1796714784547776:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5506us (5527us total) trans 4296040939 rc 0/0 00000100:00100000:2.0:1713481296.858082:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563487 00000100:00100000:1.0:1713481296.858088:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2054:18805:x1796714882519296:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 225us (249us total) trans 0 rc 0/0 00000004:00080000:3.0:1713481296.858090:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013620f480/2, rc 0, transno 1073643 00000100:00100000:1.0:1713481296.858091:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485913 00000100:00100000:3.0:1713481296.858098:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784547776:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713481296.858112:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120505180/2, rc 0, transno 993511 00000100:00100000:2.0:1713481296.858135:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784546240:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.858138:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.858161:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784548416:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.858165:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519488 00000100:00100000:1.0:1713481296.858167:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519488 00000100:00100000:0.0:1713481296.858169:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+2864:3490:x1796714784547008:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6926us (7208us total) trans 4295960808 rc 0/0 00000100:00100000:0.0:1713481296.858175:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563484 00000100:00100000:1.0:1713481296.858176:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485914 00000100:00100000:2.0:1713481296.858176:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.858180:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:18996:x1796714882519488:12345-192.168.202.24@tcp:36:lfs.0 00000004:00080000:2.0:1713481296.858193:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e36d880/2, rc 0, transno 993512 00000100:00100000:0.0:1713481296.858196:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784548416 00000100:00100000:2.0:1713481296.858197:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784547008:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.858198:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784548416 00000100:00100000:2.0:1713481296.858203:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.858206:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784548480:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.858210:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563497 00000100:00100000:0.0:1713481296.858213:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+276:3490:x1796714784548416:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.858215:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.858220:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:18996:x1796714882519488:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 39us (100us total) trans 0 rc -17/-17 00002000:00080000:0.0:1713481296.858222:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10084 count 1 00000100:00100000:1.0:1713481296.858224:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485914 00010000:00010000:0.0:1713481296.858230:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.858234:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784548480 00000100:00100000:3.0:1713481296.858237:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784548480 00010000:00010000:0.0:1713481296.858238:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800868b0000/0xdfc0fb148802b87 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963141 expref: 20715 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.858242:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858243:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858245:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.858250:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.858251:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784548544:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.858252:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563498 00010000:00010000:0.0:1713481296.858255:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800868b0000/0xdfc0fb148802b87 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963141 expref: 20715 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.858256:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2864:3490:x1796714784548480:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.858260:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800868b0000/0xdfc0fb148802b87 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963141 expref: 20715 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.858262:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713481296.858265:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43537 count 1 00000100:00100000:0.0:1713481296.858268:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784548608:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.858269:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.858273:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.858279:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.858280:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784548544 00000100:00100000:0.0:1713481296.858281:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089015cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.858282:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784548544 00010000:00010000:3.0:1713481296.858285:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350b9d40/0xdfc0fb148689551 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31d1 expref: 26804 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.858289:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.858290:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.858291:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.858292:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517760 00000100:00100000:2.0:1713481296.858292:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519552 00000100:00100000:2.0:1713481296.858293:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519552 00010000:00010000:3.0:1713481296.858293:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.858294:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517760 00000100:00100000:1.0:1713481296.858298:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.858302:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097643180/0xdfc0fb148802fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963092 expref: 20716 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.858304:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350b9d40/0xdfc0fb148689551 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31d1 expref: 26804 pid: 16491 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.858306:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563499 00000100:00100000:2.0:1713481296.858309:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2865:3492:x1796714784548544:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.858310:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563500 00010000:00010000:3.0:1713481296.858310:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350b9d40/0xdfc0fb148689551 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31d1 expref: 26804 pid: 16491 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.858312:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517888 00000100:00100000:1.0:1713481296.858313:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16932:11552:x1796714882519552:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.858314:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517888 00000100:00100000:3.0:1713481296.858316:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784548672:192.168.202.24@tcp:104: 00002000:00080000:2.0:1713481296.858317:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43538 count 1 00010000:00010000:1.0:1713481296.858318:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.858319:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083b76880/0xdfc0fb1486893c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d316f expref: 26805 pid: 16532 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.858324:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c777180/0xdfc0fb148a3bde6 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c55 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.858326:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518016 00010000:00010000:2.0:1713481296.858326:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.858327:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518016 00000100:00100000:3.0:1713481296.858329:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e06b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.858332:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085c18000/0xdfc0fb148802b5d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630df expref: 20717 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.858334:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121e321c0/0xdfc0fb1486893ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31df expref: 26805 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.858335:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084321f80/0xdfc0fb14895a161 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecc5 expref: 16933 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.858337:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.858338:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518208 00000100:00100000:0.0:1713481296.858339:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518208 00010000:00010000:1.0:1713481296.858339:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.858339:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.858340:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.858340:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858342:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c777180/0xdfc0fb148a3bde6 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c55 expref: 16933 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858344:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121e32f40/0xdfc0fb1486893b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d317d expref: 26806 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.858350:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820620 00010000:00010000:1.0:1713481296.858352:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084321f80/0xdfc0fb14895a161 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecc5 expref: 16933 pid: 16461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.858354:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121e321c0/0xdfc0fb1486893ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31df expref: 26806 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.858354:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20717:1959:x1796714882517760:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.858358:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084321f80/0xdfc0fb14895a161 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecc5 expref: 16933 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.858359:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.858360:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121e321c0/0xdfc0fb1486893ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31df expref: 26806 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.858362:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820621 00000100:00100000:1.0:1713481296.858364:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009676a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784548736:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.858364:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097643180/0xdfc0fb148802fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963092 expref: 20717 pid: 16489 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.858365:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26806:1959:x1796714882517888:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.858366:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784548800:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.858370:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.858370:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097643180/0xdfc0fb148802fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963092 expref: 20717 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858373:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083b76880/0xdfc0fb1486893c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d316f expref: 26806 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.858377:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c7d3900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.858379:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083b76880/0xdfc0fb1486893c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d316f expref: 26806 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.858380:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801356843c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.858385:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097643180/0xdfc0fb148802fa1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x275a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963092 expref: 20717 pid: 16489 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858391:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083b76880/0xdfc0fb1486893c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d316f expref: 26806 pid: 16532 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.858393:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820622 00000100:00100000:2.0:1713481296.858396:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20716:1959:x1796714882518016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.858398:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858399:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.858399:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.858400:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858401:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858401:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.858402:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858404:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085c18000/0xdfc0fb148802b5d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630df expref: 20716 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858405:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858407:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858409:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085c18000/0xdfc0fb148802b5d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630df expref: 20716 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858413:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.858415:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.858417:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.858422:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26805:1959:x1796714882517888:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.858423:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c18000/0xdfc0fb148802b5d lrc: 0/0,0 mode: --/PR res: [0x280000408:0x275e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630df expref: 20716 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.858426:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820621 00000100:00100000:3.0:1713481296.858427:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20716:1959:x1796714882517760:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.858431:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820620 00010000:00010000:2.0:1713481296.858433:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.858434:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.858437:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518400 00010000:00010000:2.0:1713481296.858437:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.858438:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518400 00000100:00100000:1.0:1713481296.858439:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.858444:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083115b00/0xdfc0fb148802b64 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630fb expref: 20716 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.858444:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.858452:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820623 00010000:00010000:2.0:1713481296.858455:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.858456:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820624 00000100:00100000:3.0:1713481296.858456:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26804:1959:x1796714882518208:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.858457:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.858459:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20715:1959:x1796714882518400:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.858461:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.858462:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.858463:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20715:1959:x1796714882518016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.858465:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083115b00/0xdfc0fb148802b64 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630fb expref: 20715 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.858465:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121e32f40/0xdfc0fb1486893b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d317d expref: 26804 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.858467:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820622 00010000:00010000:3.0:1713481296.858471:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121e32f40/0xdfc0fb1486893b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d317d expref: 26804 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858472:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083115b00/0xdfc0fb148802b64 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630fb expref: 20715 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.858479:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518720 00000100:00100000:1.0:1713481296.858480:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.858480:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518720 00010000:00010000:0.0:1713481296.858482:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083115b00/0xdfc0fb148802b64 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x275f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630fb expref: 20714 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.858484:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121e32f40/0xdfc0fb1486893b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d317d expref: 26804 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.858488:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800868b1b00/0xdfc0fb148802b6b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963109 expref: 20714 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858490:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858491:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858492:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.858495:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.858495:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.858496:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858497:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.858498:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517824 00010000:00010000:3.0:1713481296.858498:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.858500:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517824 00010000:00010000:3.0:1713481296.858502:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858504:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.858505:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095c04480/0xdfc0fb1486893ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3161 expref: 26804 pid: 16504 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.858507:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882517952 00000100:00100000:1.0:1713481296.858510:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882517952 00000100:00100000:0.0:1713481296.858512:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20714:1959:x1796714882518400:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.858512:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820625 00010000:00010000:3.0:1713481296.858512:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.858515:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820624 00000100:00100000:2.0:1713481296.858515:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20715:1959:x1796714882518720:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.858519:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.858520:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012432ef40/0xdfc0fb148802fa8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630a0 expref: 20715 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.858521:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800868b1b00/0xdfc0fb148802b6b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2760:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963109 expref: 20715 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.858521:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26804:1959:x1796714882518208:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.858525:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820623 00010000:00010000:2.0:1713481296.858527:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800868b1b00/0xdfc0fb148802b6b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2760:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963109 expref: 20714 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.858529:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820626 00000100:00100000:0.0:1713481296.858532:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26804:1959:x1796714882517824:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.858532:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820627 00000100:00100000:1.0:1713481296.858535:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20714:1959:x1796714882517952:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.858536:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.858539:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095c04480/0xdfc0fb1486893ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3161 expref: 26803 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.858539:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.858542:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012432ef40/0xdfc0fb148802fa8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x275b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630a0 expref: 20714 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.858543:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800868b1b00/0xdfc0fb148802b6b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2760:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963109 expref: 20714 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.858543:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858547:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012432ef40/0xdfc0fb148802fa8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x275b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630a0 expref: 20713 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858548:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095c04480/0xdfc0fb1486893ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3161 expref: 26803 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.858548:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858552:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.858553:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.858553:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858555:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858556:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095c04480/0xdfc0fb1486893ad lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3161 expref: 26803 pid: 16504 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.858557:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012432ef40/0xdfc0fb148802fa8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x275b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9630a0 expref: 20713 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.858557:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858559:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858560:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858564:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858565:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858565:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.858565:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858567:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858567:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858567:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801216f9440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.858568:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.858569:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858571:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858571:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858573:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.858576:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20712:1959:x1796714882518720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (118us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.858578:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.858580:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820625 00010000:00010000:3.0:1713481296.858580:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858583:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.858583:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801216f9440/0xdfc0fb148a3bc26 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x275a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.858584:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26802:1959:x1796714882517824:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.858587:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820626 00000100:00100000:1.0:1713481296.858592:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20711:1959:x1796714882517952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.858596:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820627 00000100:00100000:2.0:1713481296.858604:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519616 00000100:00100000:2.0:1713481296.858606:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519616 00010000:00010000:1.0:1713481296.858612:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858616:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.858616:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563501 00000100:00100000:2.0:1713481296.858619:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009676b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16934:11388:x1796714882519616:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.858621:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858623:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.858625:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858627:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858629:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858629:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bdf4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c5c expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858631:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858632:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e70240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.858634:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858635:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858637:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858639:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b9c0d80/0xdfc0fb148942195 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e9 expref: 20710 pid: 15559 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.858643:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858646:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.858646:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.858647:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858647:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858648:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bdf4 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c5c expref: 16935 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858650:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fdeba80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.858651:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.858654:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3bc42 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858655:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858656:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b9c0d80/0xdfc0fb148942195 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e9 expref: 20710 pid: 15559 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.858661:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b9c0d80/0xdfc0fb148942195 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e9 expref: 20710 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.858662:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858678:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bc2d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.858682:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784548864:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.858694:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800993f0480 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.858705:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858709:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858714:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858718:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.858718:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+277:3493:x1796714784544704:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9862us (10106us total) trans 4296040940 rc 0/0 00010000:00010000:2.0:1713481296.858721:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.858723:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563468 00010000:00010000:2.0:1713481296.858725:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832a9200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.858727:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858731:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858740:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858744:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.858744:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bc34 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858747:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858748:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858752:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858753:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858756:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858757:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858760:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858761:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858763:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa158c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.858765:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858765:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858769:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858769:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092f861c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.858771:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858774:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858780:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.858783:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3bc65 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x275f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.858785:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2868:3490:x1796714784545664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9021us (9100us total) trans 4295960809 rc 0/0 00010000:00010000:3.0:1713481296.858785:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.858789:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f861c0/0xdfc0fb148a3bc3b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x275e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.858790:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563472 00000004:00080000:1.0:1713481296.858824:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880077af0380/2, rc 0, transno 1073644 00000100:00100000:1.0:1713481296.858830:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784544704:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.858843:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0b9180/2, rc 0, transno 993513 00000100:00100000:1.0:1713481296.858847:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784545664:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.858849:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2867:3493:x1796714784545088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9884us (10194us total) trans 4295960811 rc 0/0 00000100:00100000:2.0:1713481296.858853:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563470 00000004:00080000:1.0:1713481296.858857:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e36bb80/2, rc 0, transno 993515 00000100:00100000:1.0:1713481296.858859:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784545088:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.858879:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713481296.858880:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+278:3490:x1796714784546048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8569us (8625us total) trans 4296040941 rc 0/0 00000100:00100000:0.0:1713481296.858884:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563477 00000100:00100000:2.0:1713481296.858884:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784548928:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.858887:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784548992:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.858899:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.858899:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+277:3490:x1796714784545280:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9904us (10016us total) trans 4296040942 rc 0/0 00000100:00100000:3.0:1713481296.858905:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563471 00010000:00010000:0.0:1713481296.858914:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097dc58c0/0xdfc0fb148a13f26 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc17a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38026 expref: 20710 pid: 15507 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.858921:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.858923:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784546752:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.858925:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784548928 00000100:00100000:3.0:1713481296.858928:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784548928 00000004:00080000:2.0:1713481296.858936:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e368380/2, rc 0, transno 1073645 00010000:00010000:0.0:1713481296.858939:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007aa16880/0xdfc0fb148a3bc81 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xc17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bd0 expref: 20709 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.858939:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784546048:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.858946:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784548992 00010000:00010000:0.0:1713481296.858947:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007aa16880, rc 0) 00000004:00080000:2.0:1713481296.858949:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e368a80/2, rc 0, transno 1073646 00000100:00100000:3.0:1713481296.858949:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784548992 00000100:00100000:1.0:1713481296.858951:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2868:3493:x1796714784545024:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10032us (10325us total) trans 4295960810 rc 0/0 00000100:00100000:2.0:1713481296.858951:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784545280:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.858956:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563469 00000100:00100000:0.0:1713481296.858961:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:14753:x1796714882516224:12345-192.168.202.24@tcp:101:dd.0 Request processed in 8433us (8457us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.858967:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563481 00000100:00100000:3.0:1713481296.858972:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563502 00000100:00100000:2.0:1713481296.858976:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563503 00000100:00100000:3.0:1713481296.858977:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2867:3492:x1796714784548928:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.858980:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2867:3490:x1796714784548992:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.858989:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43541 count 1 00000004:00080000:1.0:1713481296.858990:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120251c00/2, rc 0, transno 993514 00002000:00080000:2.0:1713481296.858990:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43543 count 1 00000100:00100000:1.0:1713481296.858993:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784545024:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.858998:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.859001:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.859005:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801216ffa80/0xdfc0fb148689401 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31fb expref: 26801 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.859009:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.859010:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.859011:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.859011:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.859011:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bd70480/0xdfc0fb1486893fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31ed expref: 26801 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.859013:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859017:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.859017:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859018:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.859020:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801216ffa80/0xdfc0fb148689401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31fb expref: 26801 pid: 16509 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859021:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.859024:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518144 00010000:00010000:2.0:1713481296.859025:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801216ffa80/0xdfc0fb148689401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31fb expref: 26801 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.859026:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518144 00010000:00010000:1.0:1713481296.859026:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859030:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.859030:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784549120:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.859033:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121e32400/0xdfc0fb1486893c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3199 expref: 26802 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859033:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859036:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832a8d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.859036:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bd70480/0xdfc0fb1486893fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31ed expref: 26802 pid: 16462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.859038:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.859041:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008178ea80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.859042:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.859043:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820628 00010000:00010000:3.0:1713481296.859044:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bd70480/0xdfc0fb1486893fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31ed expref: 26802 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.859046:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26802:1959:x1796714882518144:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.859049:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784549056:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.859050:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.859050:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859053:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121e32400/0xdfc0fb1486893c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3199 expref: 26802 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859053:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3bc1f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x275b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.859054:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784549184:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.859059:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121e32400/0xdfc0fb1486893c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3199 expref: 26802 pid: 16509 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.859060:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.859072:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231be180 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.859073:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121e32400/0xdfc0fb1486893c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3199 expref: 26802 pid: 16509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.859086:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859086:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859088:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.859089:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784549056 00010000:00010000:0.0:1713481296.859091:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.859092:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784549056 00010000:00010000:3.0:1713481296.859092:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859098:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.859099:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.859101:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563504 00000100:00100000:2.0:1713481296.859104:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2868:3491:x1796714784549056:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.859110:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43545 count 1 00010000:00010000:3.0:1713481296.859110:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859114:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.859115:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.859138:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.859145:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26801:1959:x1796714882518144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 97us (133us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.859146:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121dbf840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.859148:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083b76d00/0xdfc0fb148689408 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3209 expref: 26801 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859149:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.859151:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820628 00010000:00010000:2.0:1713481296.859154:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859155:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.859156:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.859158:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.859167:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859170:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+277:3493:x1796714784544768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10321us (10590us total) trans 4296040943 rc 0/0 00010000:00010000:3.0:1713481296.859173:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121dbf840/0xdfc0fb148a3bc7a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859174:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563467 00010000:00010000:2.0:1713481296.859174:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083b76d00/0xdfc0fb148689408 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3209 expref: 26800 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.859180:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083b76d00/0xdfc0fb148689408 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3209 expref: 26800 pid: 16479 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.859183:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.859186:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784549248:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.859196:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.859197:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518272 00000100:00100000:2.0:1713481296.859197:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801224d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.859199:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518272 00010000:00010000:1.0:1713481296.859201:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859205:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859208:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bd72880/0xdfc0fb1486893bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d318b expref: 26801 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859209:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859213:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859216:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e721c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.859217:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.859218:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820629 00000100:00100000:0.0:1713481296.859220:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26801:1959:x1796714882518272:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.859221:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859224:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.859227:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bd72880/0xdfc0fb1486893bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d318b expref: 26801 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.859232:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bd72880/0xdfc0fb1486893bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d318b expref: 26801 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859232:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859236:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3bc57 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859243:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bd72880/0xdfc0fb1486893bb lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d318b expref: 26801 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.859256:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.859257:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.859259:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859263:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859273:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.859281:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26800:1959:x1796714882518272:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.859284:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820629 00000100:00100000:3.0:1713481296.859307:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+277:3492:x1796714784546432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8816us (8869us total) trans 4296040944 rc 0/0 00000100:00100000:3.0:1713481296.859312:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563480 00000100:00100000:1.0:1713481296.859319:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2869:3492:x1796714784545920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9213us (9259us total) trans 4295960812 rc 0/0 00000100:00100000:1.0:1713481296.859324:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563475 00000004:00080000:1.0:1713481296.859352:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084ae0380/2, rc 0, transno 1073647 00000100:00100000:1.0:1713481296.859356:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784544768:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.859362:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784549376:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.859375:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.859383:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784549504:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.859393:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859394:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.859395:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784549376 00010000:00010000:0.0:1713481296.859398:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859398:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784549312:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.859398:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784549376 00010000:00010000:0.0:1713481296.859402:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859405:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.859405:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.859409:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859416:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092f87600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.859417:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.859419:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784549504 00010000:00010000:0.0:1713481296.859421:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.859421:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784549504 00000100:00100000:1.0:1713481296.859427:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563505 00010000:00010000:0.0:1713481296.859430:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859431:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+278:3493:x1796714784549376:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.859433:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f87600/0xdfc0fb148a3bc49 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.859434:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563506 00000100:00100000:2.0:1713481296.859437:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.859437:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+278:3491:x1796714784549504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.859440:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10086 count 1 00000100:00100000:2.0:1713481296.859443:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784549440:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.859446:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10088 count 1 00010000:00010000:1.0:1713481296.859448:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859455:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c582d00/0xdfc0fb148802b95 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96315d expref: 20708 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859456:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859459:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.859460:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.859460:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.859461:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.859464:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800868b0fc0/0xdfc0fb148802ba3 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963179 expref: 20708 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859468:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859469:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859471:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859473:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c582d00/0xdfc0fb148802b95 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96315d expref: 20708 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.859478:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c582d00/0xdfc0fb148802b95 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96315d expref: 20708 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.859482:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800868b0fc0/0xdfc0fb148802ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963179 expref: 20708 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.859488:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784549568:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.859488:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800868b0fc0/0xdfc0fb148802ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963179 expref: 20708 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.859491:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007710b100/2, rc 0, transno 1073648 00000100:00100000:3.0:1713481296.859495:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784549632:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.859498:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.859499:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007710b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784546432:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.859507:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c980840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.859510:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713481296.859511:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ee5d880/2, rc 0, transno 993516 00000100:00100000:2.0:1713481296.859518:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784545920:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.859524:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784549440 00000100:00100000:3.0:1713481296.859526:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784549440 00000004:00080000:2.0:1713481296.859527:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084b8d500/2, rc 0, transno 993517 00000100:00100000:0.0:1713481296.859529:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+2869:3492:x1796714784545728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9695us (9806us total) trans 4295960813 rc 0/0 00000100:00100000:2.0:1713481296.859530:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784545728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.859534:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563473 00000100:00100000:3.0:1713481296.859537:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784549312 00000100:00100000:3.0:1713481296.859538:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784549312 00000100:00100000:1.0:1713481296.859539:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784549760:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.859540:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784549696:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.859549:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563507 00000100:00100000:1.0:1713481296.859551:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.859552:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+280:3491:x1796714784549440:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.859559:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10087 count 1 00010000:00010000:3.0:1713481296.859568:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859571:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784549760 00000100:00100000:2.0:1713481296.859571:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.859573:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784549760 00010000:00010000:3.0:1713481296.859575:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800831158c0/0xdfc0fb148802b9c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96316b expref: 20708 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859579:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859580:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859581:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859585:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784549696 00000100:00100000:1.0:1713481296.859586:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784549696 00010000:00010000:3.0:1713481296.859591:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800831158c0/0xdfc0fb148802b9c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96316b expref: 20708 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.859593:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563508 00000100:00100000:1.0:1713481296.859596:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+280:3493:x1796714784549312:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.859597:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800831158c0/0xdfc0fb148802b9c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96316b expref: 20708 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.859603:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784549824:192.168.202.24@tcp:104: 00002000:00080000:1.0:1713481296.859604:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10085 count 1 00000100:00100000:2.0:1713481296.859605:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563509 00000100:00100000:2.0:1713481296.859610:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2870:3493:x1796714784549760:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.859611:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.859612:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b263c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.859618:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c19200/0xdfc0fb148802b8e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96314f expref: 20708 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.859622:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713481296.859622:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43549 count 1 00010000:00010000:1.0:1713481296.859623:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.859625:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.859627:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563510 00000100:00100000:3.0:1713481296.859630:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2870:3492:x1796714784549696:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.859633:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859635:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085c19200/0xdfc0fb148802b8e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96314f expref: 20708 pid: 16538 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713481296.859637:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43547 count 1 00010000:00010000:1.0:1713481296.859643:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085c19200/0xdfc0fb148802b8e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96314f expref: 20708 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.859644:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133df2400/0xdfc0fb148689822 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3225 expref: 26799 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859645:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859649:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784549888:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.859650:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859651:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801216fcb40/0xdfc0fb14868940f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3217 expref: 26799 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.859652:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.859654:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859659:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e063c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.859659:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859660:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859675:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.859685:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133df2400/0xdfc0fb148689822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3225 expref: 26799 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859687:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801216fcb40/0xdfc0fb14868940f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3217 expref: 26799 pid: 15509 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.859693:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801216fcb40/0xdfc0fb14868940f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3217 expref: 26799 pid: 15509 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.859694:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.859695:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133df2400/0xdfc0fb148689822 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3225 expref: 26799 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.859700:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784550016:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.859707:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.859709:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077a80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784549952:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.859710:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.859718:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.859723:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518528 00000100:00100000:1.0:1713481296.859725:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519680 00000100:00100000:3.0:1713481296.859725:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518528 00000100:00100000:2.0:1713481296.859726:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098ec1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.859727:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519680 00010000:00010000:3.0:1713481296.859734:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800831ba640/0xdfc0fb148689543 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31b5 expref: 26800 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.859738:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563511 00000100:00100000:1.0:1713481296.859741:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:10479:x1796714882519680:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.859746:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.859746:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882518784 00000100:00100000:3.0:1713481296.859747:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882518784 00010000:00010000:1.0:1713481296.859752:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9b00/0xdfc0fb148a3be3a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c63 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.859754:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b224d80/0xdfc0fb148a16273 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39859 expref: 24480 pid: 16469 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859761:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148916dc2 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65ae expref: 20710 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.859762:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.859764:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820630 00010000:00010000:1.0:1713481296.859765:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.859766:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.859767:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26800:1959:x1796714882518528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.859768:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9b00/0xdfc0fb148a3be3a lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c63 expref: 20710 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.859768:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784550080:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.859774:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.859777:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800831ba640/0xdfc0fb148689543 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31b5 expref: 26800 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859778:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148916dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65ae expref: 20710 pid: 15547 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.859782:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820631 00010000:00010000:3.0:1713481296.859783:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800831ba640/0xdfc0fb148689543 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31b5 expref: 26800 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859784:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148916dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65ae expref: 20710 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.859786:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.859788:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1959:x1796714882518784:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.859789:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784550144:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.859795:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.859795:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800831ba640/0xdfc0fb148689543 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31b5 expref: 26800 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.859800:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b224d80/0xdfc0fb148a16273 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39859 expref: 24480 pid: 16469 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.859800:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012168e180 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.859803:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859804:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.859806:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859809:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b224d80/0xdfc0fb148a16273 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39859 expref: 24480 pid: 16469 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.859811:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859812:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784550080 00000100:00100000:1.0:1713481296.859813:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784550080 00010000:00010000:0.0:1713481296.859828:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b224d80/0xdfc0fb148a16273 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39859 expref: 24480 pid: 16469 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.859828:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563512 00000100:00100000:1.0:1713481296.859830:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+281:3491:x1796714784550080:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.859830:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1713481296.859837:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10089 count 1 00010000:00010000:2.0:1713481296.859837:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859839:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.859840:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:1959:x1796714882518528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.859841:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.859842:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859844:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3bc96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49be5 expref: 24479 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859844:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.859844:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820630 00010000:00010000:2.0:1713481296.859846:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859850:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c19b00/0xdfc0fb148802baa lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963187 expref: 20710 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.859850:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859852:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3bc96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49be5 expref: 24479 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859853:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.859854:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.859854:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859855:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.859857:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d8f8fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.859858:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.859862:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859864:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085c19b00/0xdfc0fb148802baa lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963187 expref: 20710 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.859868:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011d8f9b00/0xdfc0fb148a3bc96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49be5 expref: 24479 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.859869:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085c19b00/0xdfc0fb148802baa lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963187 expref: 20710 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.859872:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.859874:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784550272:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.859876:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3bc73 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.859878:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a86b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784550208:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.859887:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b240 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.859889:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012168e540 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.859905:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.859915:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.859919:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519744 00000100:00100000:0.0:1713481296.859921:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519744 00000100:00100000:1.0:1713481296.859923:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519808 00000100:00100000:1.0:1713481296.859925:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519808 00000100:00100000:1.0:1713481296.859936:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485915 00000100:00100000:1.0:1713481296.859938:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18955:x1796714882519808:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:0.0:1713481296.859941:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563513 00010000:00010000:1.0:1713481296.859943:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.859944:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:10409:x1796714882519744:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.859949:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.859949:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3be48 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c71 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859956:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3be4f lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c6a expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.859966:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880081d68fc0/0xdfc0fb14891d453 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca72b expref: 24481 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.859972:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097647a80/0xdfc0fb14893abc2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f8 expref: 26798 pid: 16458 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.859975:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.859975:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2871:3492:x1796714784546304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9503us (9586us total) trans 4295960814 rc 0/0 00010000:00010000:0.0:1713481296.859976:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.859978:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3be4f lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c6a expref: 24481 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.859980:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563479 00010000:00010000:0.0:1713481296.859987:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097647a80/0xdfc0fb14893abc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f8 expref: 26798 pid: 16458 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.859987:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713481296.859991:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097647a80/0xdfc0fb14893abc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f8 expref: 26798 pid: 16458 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.859993:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713481296.859996:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784550336:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.859997:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860004:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000004:00080000:2.0:1713481296.860004:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e36fb80/2, rc 0, transno 993518 00010000:00010000:1.0:1713481296.860007:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.860008:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880081d68fc0/0xdfc0fb14891d453 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca72b expref: 24481 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.860008:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784546304:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.860010:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.860013:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880081d68fc0/0xdfc0fb14891d453 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca72b expref: 24481 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.860017:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784550400:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.860023:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba3da80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.860027:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.860031:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784550464:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.860037:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cf3c0/0xdfc0fb148a3be64 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.860040:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cf3c0/0xdfc0fb148a3be64 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.860042:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.860044:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cf3c0/0xdfc0fb148a3be64 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000004:00200000:1.0:1713481296.860055:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c7b:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.860057:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713481296.860060:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784550464 00000004:00010000:1.0:1713481296.860062:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cf3c0/0xdfc0fb148a3be64 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.860062:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784550464 00010000:00010000:1.0:1713481296.860066:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860069:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860072:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860074:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860077:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d8900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.860078:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.860080:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563514 00010000:00010000:1.0:1713481296.860081:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.860083:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2871:3490:x1796714784550464:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.860085:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.860087:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.860089:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00002000:00080000:2.0:1713481296.860090:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43551 count 1 00010000:00010000:1.0:1713481296.860092:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3be56 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.860098:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.860099:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860102:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860105:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.860105:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9f80/0xdfc0fb148689829 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3233 expref: 26798 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.860108:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121cd8480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.860109:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.860109:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860111:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.860112:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.860112:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.860115:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88011d251600) 00010000:00010000:1.0:1713481296.860116:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.860134:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.860138:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121cd8480/0xdfc0fb148a3be5d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.860143:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e9f80/0xdfc0fb148689829 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3233 expref: 26798 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.860149:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e9f80/0xdfc0fb148689829 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3233 expref: 26798 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.860154:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784550528:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.860161:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3be48 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c71 expref: 2394 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.860164:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012cf53840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.860168:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cf3c0/0xdfc0fb148a3be64 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c71 expref: 2393 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.860172:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88007aad9100) 00010000:00010000:1.0:1713481296.860174:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.860175:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f9cf3c0, rc 0) 00000100:00100000:1.0:1713481296.860186:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2393:18955:x1796714882519808:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 246us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.860190:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485915 00000100:00100000:1.0:1713481296.860216:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.860229:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519872 00000100:00100000:2.0:1713481296.860230:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519872 00000100:00100000:2.0:1713481296.860246:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563515 00000100:00100000:0.0:1713481296.860247:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ee5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784547904:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.860249:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:15045:x1796714882519872:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.860254:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.860262:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084818480/0xdfc0fb148a3be72 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9beb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c78 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.860266:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800834ae880/0xdfc0fb148a3bd37 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c08 expref: 16935 pid: 16481 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.860270:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9beb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.860273:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800834ae880, rc 0) 00010000:00010000:2.0:1713481296.860276:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860277:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860280:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084818480/0xdfc0fb148a3be72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9beb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c78 expref: 24483 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.860283:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009090c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16935:8499:x1796714882517696:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4144us (4494us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.860286:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084818480/0xdfc0fb148a3be72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9beb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c78 expref: 24483 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.860287:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563488 00010000:00010000:2.0:1713481296.860294:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084818480, rc 0) 00000100:00100000:1.0:1713481296.860298:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.860304:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:15045:x1796714882519872:12345-192.168.202.24@tcp:101:dd.0 Request processed in 54us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.860308:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563515 00000100:00100000:0.0:1713481296.860309:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520000 00000100:00100000:0.0:1713481296.860311:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520000 00000100:00100000:1.0:1713481296.860316:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.860317:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085c186c0/0xdfc0fb148802b79 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963125 expref: 20711 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.860332:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882519936 00000100:00100000:0.0:1713481296.860334:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882519936 00000100:00100000:2.0:1713481296.860335:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784548032:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.860339:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991def40/0xdfc0fb1488e7e6f lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b553a expref: 16935 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.860343:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.860343:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820632 00000100:00100000:3.0:1713481296.860348:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20711:1959:x1796714882520000:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.860350:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520064 00000100:00100000:0.0:1713481296.860351:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520064 00010000:00010000:2.0:1713481296.860351:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860354:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.860356:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083114fc0/0xdfc0fb148802b80 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963133 expref: 20712 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.860359:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085c186c0/0xdfc0fb148802b79 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2762:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963125 expref: 20712 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.860364:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820633 00010000:00010000:3.0:1713481296.860366:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085c186c0/0xdfc0fb148802b79 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2762:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963125 expref: 20712 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.860367:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820634 00000100:00100000:2.0:1713481296.860367:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4019c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16935:1957:x1796714882519936:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.860369:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20712:1958:x1796714882520064:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.860372:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.860373:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.860376:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083114fc0/0xdfc0fb148802b80 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x2763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963133 expref: 20712 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.860376:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991def40/0xdfc0fb1488e7e6f lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8e9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b553a expref: 16935 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.860381:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991def40/0xdfc0fb1488e7e6f lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8e9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b553a expref: 16935 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.860382:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c186c0/0xdfc0fb148802b79 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2762:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963125 expref: 20712 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.860385:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083114fc0/0xdfc0fb148802b80 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963133 expref: 20712 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.860391:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991def40/0xdfc0fb1488e7e6f lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8e9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b553a expref: 16935 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.860392:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.860393:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.860395:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.860395:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.860396:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.860398:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860399:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860400:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.860400:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.860402:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860402:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800834ae880/0xdfc0fb148a3bd37 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c08 expref: 16934 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.860410:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.860411:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800834ae880/0xdfc0fb148a3bd37 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c08 expref: 16934 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860414:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.860419:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20711:1958:x1796714882520064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 48us (75us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.860420:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800834ae880/0xdfc0fb148a3bd37 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8e9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c08 expref: 16934 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.860423:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820634 00000100:00100000:2.0:1713481296.860425:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784550592:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.860425:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20711:1959:x1796714882520000:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.860429:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820632 00000100:00100000:1.0:1713481296.860431:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.860436:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800976a9780 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.860450:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860454:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860458:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860459:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083114fc0/0xdfc0fb148802b80 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963133 expref: 20709 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.860462:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860466:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860469:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708d8c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.860470:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.860470:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784548160:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.860475:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860482:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860485:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860486:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3bd3e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860490:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860495:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860500:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860503:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860507:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860510:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097da33c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.860512:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860516:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860524:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860527:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097da33c0/0xdfc0fb148a3bd45 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.860595:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+283:3493:x1796714784547968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4264us (4300us total) trans 4296040945 rc 0/0 00000100:00100000:2.0:1713481296.860600:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563489 00000004:00080000:0.0:1713481296.860613:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120507100/2, rc 0, transno 1073649 00000100:00100000:2.0:1713481296.860613:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520128 00000100:00100000:2.0:1713481296.860615:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520128 00000100:00100000:0.0:1713481296.860619:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784547968:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713481296.860628:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012062ce00/2, rc 0, transno 1073650 00000100:00100000:2.0:1713481296.860628:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563516 00000100:00100000:0.0:1713481296.860630:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784548096:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.860632:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16935:17009:x1796714882520128:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.860633:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+282:3493:x1796714784548096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4146us (4218us total) trans 4296040946 rc 0/0 00010000:00010000:2.0:1713481296.860638:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.860639:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563490 00010000:00010000:2.0:1713481296.860647:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e096880/0xdfc0fb148a3be79 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c7f expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.860657:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007712b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784550720:0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1713481296.860659:0:16487:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.860680:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860681:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860684:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e096880/0xdfc0fb148a3be79 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c7f expref: 16936 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.860686:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.860696:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e096880/0xdfc0fb148a3be79 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c7f expref: 16936 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.860702:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784550720 00010000:00010000:2.0:1713481296.860703:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e096880, rc 0) 00000100:00100000:3.0:1713481296.860705:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784550720 00000100:00100000:0.0:1713481296.860707:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713481296.860712:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784550656:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.860717:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563517 00000100:00100000:2.0:1713481296.860720:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16936:17009:x1796714882520128:12345-192.168.202.24@tcp:101:dd.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.860720:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+282:3493:x1796714784550720:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.860726:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563516 00000100:00100000:0.0:1713481296.860730:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713481296.860731:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10091 count 1 00010000:00010000:3.0:1713481296.860742:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.860744:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784550656 00000100:00100000:2.0:1713481296.860747:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784550656 00010000:00010000:3.0:1713481296.860753:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c5806c0/0xdfc0fb148802bb8 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631a3 expref: 20708 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.860759:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.860760:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.860763:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.860764:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563518 00000100:00100000:2.0:1713481296.860768:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+283:3493:x1796714784550656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.860778:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10090 count 1 00010000:00010000:3.0:1713481296.860779:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c5806c0/0xdfc0fb148802bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631a3 expref: 20708 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.860788:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.860788:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c5806c0/0xdfc0fb148802bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631a3 expref: 20708 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.860798:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083114480/0xdfc0fb148802bb1 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963195 expref: 20708 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.860798:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784550784:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.860804:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860805:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.860808:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.860825:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083114480/0xdfc0fb148802bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963195 expref: 20708 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.860825:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94e40 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.860838:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083114480/0xdfc0fb148802bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963195 expref: 20708 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.860847:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784550848:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.860868:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082042900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.861167:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.861197:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520192 00000100:00100000:2.0:1713481296.861200:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520192 00000100:00100000:2.0:1713481296.861219:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563519 00000100:00100000:2.0:1713481296.861222:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:18792:x1796714882520192:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.861226:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.861233:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801360898c0/0xdfc0fb148a3be8e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc529:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c86 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.861242:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc529:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.861248:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.861249:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.861251:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801360898c0/0xdfc0fb148a3be8e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc529:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c86 expref: 20710 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.861257:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801360898c0/0xdfc0fb148a3be8e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc529:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c86 expref: 20710 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.861262:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360898c0, rc 0) 00000100:00100000:2.0:1713481296.861278:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20710:18792:x1796714882520192:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.861284:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563519 00000100:00100000:0.0:1713481296.861289:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.861303:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520320 00000100:00100000:1.0:1713481296.861308:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520320 00000100:00100000:1.0:1713481296.861325:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485916 00000100:00100000:1.0:1713481296.861328:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2054:18811:x1796714882520320:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.861339:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.861346:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cc900/0xdfc0fb148a3be95 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c8d expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.861404:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.861411:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.861415:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.861423:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cc240/0xdfc0fb148a3bea3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cba:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.861427:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cc240/0xdfc0fb148a3bea3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cba:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.861429:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cc240/0xdfc0fb148a3bea3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cba:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713481296.861490:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880089a91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784550912:0@lo:1000:mdt00_012.0 00000100:00100000:1.0:1713481296.861548:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.861559:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091cedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.861573:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784550912 00000100:00100000:1.0:1713481296.861575:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784550912 00000100:00100000:0.0:1713481296.861584:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.861589:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82958 00000100:00100000:1.0:1713481296.861591:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15476:x1796714784550912:12345-0@lo:1000:mdt00_012.0 00000100:00100000:2.0:1713481296.861617:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520384 00000100:00100000:0.0:1713481296.861618:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.861621:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520384 00000100:00100000:0.0:1713481296.861633:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520512 00000100:00100000:2.0:1713481296.861636:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485917 00000100:00100000:0.0:1713481296.861637:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520512 00000100:00100000:2.0:1713481296.861639:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2056:18678:x1796714882520384:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1713481296.861645:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.861651:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3beaa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c94 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.861654:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125705 00000100:00100000:0.0:1713481296.861658:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:18578:x1796714882520512:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:1.0:1713481296.861697:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15476:x1796714784550912:12345-0@lo:1000:mdt00_012.0 Request processed in 104us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.861702:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82958 00010000:00010000:2.0:1713481296.861706:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3beb1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:2.0:1713481296.861711:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3beb1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.861716:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3beb1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000100:00100000:1.0:1713481296.861726:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880089a91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784550912:0@lo:1000:mdt00_012.0 00000004:00200000:2.0:1713481296.861731:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c36:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.861733:0:15642:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713481296.861752:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801302b06c0/0xdfc0fb148a3beaa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c94 expref: 2058 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.861760:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3beb1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c94 expref: 2057 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.861764:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88008ad2f200) 00010000:00010000:2.0:1713481296.861766:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713481296.861767:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084b95200, rc 0) 00000100:00100000:2.0:1713481296.861784:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2057:18678:x1796714882520384:12345-192.168.202.24@tcp:101:rm.0 Request processed in 144us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.861788:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485917 00000100:00100000:2.0:1713481296.861817:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.861827:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520576 00000100:00100000:2.0:1713481296.861829:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520576 00000100:00100000:2.0:1713481296.861838:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563520 00000100:00100000:2.0:1713481296.861840:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:17935:x1796714882520576:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.861845:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.861853:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3beb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb79c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49c9b expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.861861:0:16538:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb79c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.861867:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.861868:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.861871:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3beb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c9b expref: 26800 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.861877:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800784b4d80/0xdfc0fb148a3beb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c9b expref: 26800 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.861881:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800784b4d80, rc 0) 00000100:00100000:0.0:1713481296.861886:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2172:18578:x1796714882520512:12345-192.168.202.24@tcp:35:rm.0 Request processed in 196us (238us total) trans 4295105926 rc 0/0 00000100:00100000:0.0:1713481296.861891:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125705 00000100:00100000:2.0:1713481296.861892:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26800:17935:x1796714882520576:12345-192.168.202.24@tcp:101:dd.0 Request processed in 50us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.861896:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563520 00000100:00100000:2.0:1713481296.861994:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784548224:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.862016:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3bd92 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c2b expref: 26799 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.862023:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009708fcc0, rc 0) 00000100:00100000:3.0:1713481296.862041:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784548352:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.862042:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784548608:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.862045:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:18817:x1796714882519040:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4529us (4597us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.862050:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563493 00010000:00010000:3.0:1713481296.862066:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097da0fc0/0xdfc0fb148a3bdbc lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c47 expref: 16935 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.862076:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784548864:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.862076:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097da0fc0, rc 0) 00010000:00010000:0.0:1713481296.862091:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.862093:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bdf4 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c5c expref: 16935 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.862097:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16935:18836:x1796714882519360:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 4213us (4270us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.862098:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800914c46c0, rc 0) 00000100:00100000:3.0:1713481296.862105:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563496 00000100:00100000:2.0:1713481296.862110:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009676b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16935:11388:x1796714882519616:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3491us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.862115:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563501 00000100:00100000:2.0:1713481296.862159:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784548288:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.862170:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.862180:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784548672:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.862183:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:1958:x1796714882518656:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4444us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.862187:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820619 00010000:00010000:3.0:1713481296.862198:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.862249:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077a80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784549952:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.862269:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.862282:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784548800:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.862296:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.862306:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784549120:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.862320:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.862428:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.862439:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520640 00000100:00100000:2.0:1713481296.862441:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520640 00000100:00100000:2.0:1713481296.862454:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98387 00000100:00100000:2.0:1713481296.862457:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2172:1960:x1796714882520640:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.862461:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.862465:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784549184:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.862469:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5821c0/0xdfc0fb148a3bd8b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c24 expref: 2172 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.862485:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88009c4f1100) 00010000:00010000:3.0:1713481296.862485:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.862488:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.862508:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:1960:x1796714882520640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 49us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.862511:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784549632:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.862514:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98387 00010000:00010000:3.0:1713481296.862532:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.862546:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784549248:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.862554:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0000_UUID:16502:1796714784549824:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.862570:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.862572:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.862830:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784550272:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.862840:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.862840:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784550016:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.862852:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882518784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3065us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.862857:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820631 00010000:00010000:2.0:1713481296.862864:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.862937:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784550336:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.862951:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.862963:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521024 00000100:00100000:0.0:1713481296.862965:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784550400:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.862965:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521024 00010000:00010000:0.0:1713481296.862982:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3be4f lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c6a expref: 24482 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.862983:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563521 00000100:00100000:2.0:1713481296.862986:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882521024:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.862991:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.862994:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880079af21c0, rc 0) 00010000:00010000:2.0:1713481296.862997:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120bae880/0xdfc0fb148a3bebf lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ca2 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.863007:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800908c3180/0xdfc0fb148a13f2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3802d expref: 24483 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.863010:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.863012:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.863013:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:10409:x1796714882519744:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3067us (3107us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.863013:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120bae880/0xdfc0fb148a3bebf lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ca2 expref: 24483 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.863019:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563513 00010000:00010000:2.0:1713481296.863023:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800908c3180/0xdfc0fb148a13f2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3802d expref: 24483 pid: 16512 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.863028:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800908c3180/0xdfc0fb148a13f2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3802d expref: 24483 pid: 16512 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.863034:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784550976:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.863048:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009713f300 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.863063:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16533:1796714784550528:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.863081:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.863109:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784550784:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.863146:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.863160:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784549568:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.863178:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.863192:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784549888:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.863210:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.863224:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a86b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784550208:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.863243:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.863263:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784550144:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.863280:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9b00/0xdfc0fb148a3be3a lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c63 expref: 20708 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.863286:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c0d9b00, rc 0) 00000100:00100000:2.0:1713481296.863300:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20708:10479:x1796714882519680:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3558us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.863304:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563511 00000100:00100000:2.0:1713481296.863406:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007866f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784550592:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.863419:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.863431:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4019c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16933:1957:x1796714882519936:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3063us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.863435:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820633 00000100:00100000:2.0:1713481296.863508:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784550848:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.863536:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.863898:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba53:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863902:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa108:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863904:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba54:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863907:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa109:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863909:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba55:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863911:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa10a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863913:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba56:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863916:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa10b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863918:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba57:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863920:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa10c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863922:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba58:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863924:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa10d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863926:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba59:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863928:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa10e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863930:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba5a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863932:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa10f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863934:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba5b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863936:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa110:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863938:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba5c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863940:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa111:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863942:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba5d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863944:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa112:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863946:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba5e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863948:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa113:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863950:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba5f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863952:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa114:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863954:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba60:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863956:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa115:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863958:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba61:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863960:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa116:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863962:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba62:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863964:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa117:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863967:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba63:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863969:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa118:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863971:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba64:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863973:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa119:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863975:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba65:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863976:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa11a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863978:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba66:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863980:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa11b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863982:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba67:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863984:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa11c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863985:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba68:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863987:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa11d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863989:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba69:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863991:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa11e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863993:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba6a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863995:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa11f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.863997:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba6b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.863999:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa120:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864000:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba6c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864002:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa121:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864004:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba6d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864006:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa122:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864008:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba6e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864010:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa123:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864012:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba6f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864014:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa124:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864016:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba70:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864018:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa125:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864020:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba71:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864022:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa126:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864024:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba72:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864026:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa127:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864028:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba73:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864030:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa128:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864032:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba74:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864034:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa129:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864036:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba75:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864038:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa12a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864040:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba76:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864042:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa12b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864044:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba77:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864046:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa12c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864047:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba78:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864049:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa12d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864051:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba79:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864053:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa12e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864055:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba7a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864057:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa12f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864059:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba7b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864061:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa130:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864063:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba7c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864065:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa131:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864067:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba7d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864069:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa132:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864071:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba7e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864073:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa133:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864075:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba7f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864077:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa134:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864079:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba80:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864081:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa135:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864083:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba81:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864085:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa136:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864087:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba82:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864089:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa137:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864091:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba83:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864093:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa138:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864095:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba84:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864096:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa139:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864098:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba85:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864100:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa13a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864102:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba86:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864104:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa13b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864107:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba87:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864109:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa13c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864111:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba88:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864113:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa13d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864115:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba89:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864137:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa13e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864141:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba8a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864143:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa13f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864145:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba8b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864147:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa140:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864150:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba8c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864151:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa141:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864153:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba8d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864155:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa142:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864157:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba8e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864159:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa143:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864161:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba8f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864162:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa144:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864165:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba90:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864167:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa145:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864169:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba91:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864171:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa146:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864172:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba92:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864175:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa147:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864176:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba93:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864178:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa148:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864180:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba94:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864182:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa149:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864185:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba95:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864187:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa14a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864190:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba96:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864192:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa14b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864193:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba97:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864196:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa14c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864198:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba98:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864200:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa14d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864202:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba99:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864204:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa14e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864206:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba9a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864208:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa14f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864210:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba9b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864211:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa150:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864214:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba9c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864215:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa151:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864217:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba9d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864219:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa152:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864221:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba9e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864223:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa153:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864225:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xba9f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864228:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa154:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864230:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864232:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa155:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864233:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864236:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa156:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864238:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864240:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa157:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864242:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864243:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa158:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864246:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864247:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa159:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864249:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864251:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa15a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864253:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864255:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa15b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864257:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864259:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa15c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864261:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864263:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa15d:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864265:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009676a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784548736:192.168.202.24@tcp:104: 00000004:00080000:1.0:1713481296.864265:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaa9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864267:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa15e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864269:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaaa:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864271:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa15f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864273:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaab:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864275:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa160:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864277:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaac:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864278:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa161:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864280:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaad:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864282:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa162:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864284:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaae:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864287:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa163:0x0], index 0: 0 00010000:00010000:0.0:1713481296.864289:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c777180/0xdfc0fb148a3bde6 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c55 expref: 16932 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.864289:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaaf:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864291:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa164:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864293:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864295:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa165:0x0], index 0: 0 00010000:00010000:0.0:1713481296.864297:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c777180, rc 0) 00000004:00080000:1.0:1713481296.864297:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864299:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa166:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864301:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864303:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa167:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864304:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864307:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa168:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864309:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864311:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa169:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864313:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16932:11552:x1796714882519552:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5999us (6033us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.864313:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864315:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa16a:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864316:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563500 00000004:00080000:1.0:1713481296.864317:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864319:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa16b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864321:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864322:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa16c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864324:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864326:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa16d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864328:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbab9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864330:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa16e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864332:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaba:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864334:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa16f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864337:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbabb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864339:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa170:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864340:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbabc:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864342:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.864342:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa171:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864345:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbabd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864347:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa172:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864349:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbabe:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864351:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521984 00000004:00080000:1.0:1713481296.864351:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa173:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864353:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521984 00000004:00080000:1.0:1713481296.864353:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbabf:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864355:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa174:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864357:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864358:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa175:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864360:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864362:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa176:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864364:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864366:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa177:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864368:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac3:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864370:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563522 00000004:00080000:1.0:1713481296.864370:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa178:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864372:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac4:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864373:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16932:18844:x1796714882521984:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000004:00080000:1.0:1713481296.864374:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa179:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864376:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac5:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864378:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713481296.864378:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa17a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864380:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864382:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa17b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864384:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac7:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864385:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986cd680/0xdfc0fb148a3bec6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ca9 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.864387:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa17c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864389:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864391:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa17d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864393:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbac9:0x0], index 1: 0 00002000:00010000:0.0:1713481296.864394:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1713481296.864395:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa17e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864396:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaca:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864398:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa17f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864400:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbacb:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864401:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.864402:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.864402:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa180:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864404:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbacc:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864405:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986cd680/0xdfc0fb148a3bec6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ca9 expref: 16933 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.864406:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa181:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864409:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbacd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864410:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa182:0x0], index 0: 0 00010000:00010000:0.0:1713481296.864411:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800986cd680/0xdfc0fb148a3bec6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ca9 expref: 16933 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.864412:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbace:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864414:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa183:0x0], index 0: 0 00010000:00010000:0.0:1713481296.864416:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986cd680, rc 0) 00000004:00080000:1.0:1713481296.864416:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbacf:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864418:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa184:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864420:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864422:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa185:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864424:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad1:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864426:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16933:18844:x1796714882521984:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 53us (84us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.864426:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa186:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864428:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad2:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864429:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563522 00000004:00080000:1.0:1713481296.864430:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa187:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864432:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864435:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa188:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864437:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864439:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa189:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864441:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864443:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa18a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864445:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864447:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa18b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864449:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864451:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa18c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864453:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864455:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa18d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864457:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbad9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864459:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa18e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864461:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbada:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864462:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa18f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864464:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbadb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864466:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa190:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864468:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbadc:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864470:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa191:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864472:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbadd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864473:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa192:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864475:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbade:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864477:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa193:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864479:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbadf:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864481:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa194:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864482:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.864484:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864486:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa195:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864488:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864490:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa196:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864492:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864494:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa197:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864495:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864497:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa198:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864499:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864501:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa199:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864503:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864505:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa19a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864507:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864509:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa19b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864510:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864513:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa19c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864515:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864516:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa19d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864518:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbae9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864520:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa19e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864522:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaea:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864524:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa19f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864526:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaeb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864528:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864529:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaec:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864532:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864534:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaed:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864536:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864539:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaee:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864541:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864543:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaef:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864545:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864547:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864549:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864551:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864552:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864554:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864556:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a7:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864559:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522496 00000004:00080000:1.0:1713481296.864559:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864561:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864562:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864564:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1a9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864566:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864568:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1aa:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864570:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864572:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ab:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864574:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864576:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ac:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864578:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864580:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ad:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864583:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaf9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864585:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ae:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864587:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbafa:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864589:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1af:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864591:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbafb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864593:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864595:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbafc:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864597:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864599:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbafd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864601:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864603:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbafe:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864604:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864606:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbaff:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864608:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864610:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb00:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864612:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864614:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb01:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864615:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864617:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb02:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864620:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b7:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864622:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522496 00000004:00080000:1.0:1713481296.864622:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb03:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864624:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864626:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb04:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864628:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1b9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864630:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb05:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864632:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ba:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864635:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb06:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864637:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1bb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864639:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb07:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864641:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563523 00000004:00080000:1.0:1713481296.864642:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1bc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864644:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb08:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864645:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20708:15045:x1796714882522496:12345-192.168.202.24@tcp:101:dd.0 00000004:00080000:1.0:1713481296.864646:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1bd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864648:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb09:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864650:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713481296.864650:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1be:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864652:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb0a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864654:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1bf:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864655:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb0b:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864656:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3becd lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cb0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.864657:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864659:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb0c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864661:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864676:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb0d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864678:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c2:0x0], index 0: 0 00002000:00010000:0.0:1713481296.864679:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1713481296.864680:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb0e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864682:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864684:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb0f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864686:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c4:0x0], index 0: 0 00010000:00010000:0.0:1713481296.864688:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.864688:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb10:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864689:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.864689:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864691:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb11:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864692:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3becd lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cb0 expref: 20709 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.864693:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864696:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb12:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864698:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864701:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb13:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864702:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737ae1c0/0xdfc0fb148a3becd lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cb0 expref: 20709 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.864703:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864705:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb14:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864707:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1c9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864709:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb15:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864711:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ca:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864713:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb16:0x0], index 1: 0 00010000:00010000:0.0:1713481296.864714:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737ae1c0, rc 0) 00000004:00080000:1.0:1713481296.864715:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1cb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864716:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb17:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864718:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1cc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864720:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb18:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864722:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1cd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864724:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb19:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864726:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ce:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864729:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb1a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864731:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1cf:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864732:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:15045:x1796714882522496:12345-192.168.202.24@tcp:101:dd.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.864733:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb1b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864735:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864736:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb1c:0x0], index 1: 0 00000100:00100000:0.0:1713481296.864737:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563523 00000004:00080000:1.0:1713481296.864738:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864740:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb1d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864742:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864744:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb1e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864747:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864749:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb1f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864751:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864754:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb20:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864756:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864758:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb21:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864759:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864761:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb22:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864763:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864765:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb23:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864767:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864769:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb24:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864771:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1d9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864774:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb25:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864775:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1da:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864777:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb26:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864780:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1db:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864781:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb27:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864783:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1dc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864785:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb28:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864787:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1dd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864790:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb29:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864792:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1de:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864794:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb2a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864796:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1df:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864798:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb2b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864800:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864802:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb2c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864804:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864806:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb2d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864809:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864811:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb2e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864813:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864815:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb2f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864816:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864818:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb30:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864820:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e5:0x0], index 0: 0 00000100:00100000:0.0:1713481296.864822:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.864822:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb31:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864824:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.864826:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb32:0x0], index 1: 0 00000004:00080000:1.0:1713481296.864828:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e7:0x0], index 0: 0 00000100:00100000:1.0:1713481296.864844:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522560 00000100:00100000:1.0:1713481296.864846:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522560 00000100:00100000:0.0:1713481296.864861:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.864864:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26114 00000100:00100000:1.0:1713481296.864868:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2057:18948:x1796714882522560:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:0.0:1713481296.864873:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.864881:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522624 00000100:00100000:2.0:1713481296.864881:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523072 00000100:00100000:0.0:1713481296.864883:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522624 00010000:00010000:1.0:1713481296.864883:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.864885:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523072 00000100:00100000:0.0:1713481296.864894:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563524 00010000:00010000:1.0:1713481296.864894:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c583cc0/0xdfc0fb148a3bdae lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c40 expref: 2057 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.864896:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16933:8499:x1796714882522624:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.864901:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.864903:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485918 00000100:00100000:2.0:1713481296.864907:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:18578:x1796714882523072:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:0.0:1713481296.864908:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f84d80/0xdfc0fb148a3bed4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cb7 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.864909:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880084aad100) 00010000:00010000:1.0:1713481296.864911:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.864918:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124a446c0/0xdfc0fb1488e7ec3 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5541 expref: 16934 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.864921:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.864922:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.864923:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.864925:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f84d80/0xdfc0fb148a3bed4 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cb7 expref: 16934 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.864930:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120baf180/0xdfc0fb148a3bedb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x37c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ce1 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.864931:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.864935:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124a446c0/0xdfc0fb1488e7ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5541 expref: 16934 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.864935:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.864940:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.864944:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124a446c0/0xdfc0fb1488e7ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5541 expref: 16934 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.864948:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880089a91f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784551040:0@lo:101:mdt_io00_014.0 00000100:00100000:0.0:1713481296.864949:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784551104:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.864964:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089015cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.864969:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.864977:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800929adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.864989:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784551040 00010000:00010000:2.0:1713481296.864990:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bee9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.864991:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784551040 00010000:00010000:2.0:1713481296.864996:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bee9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.865000:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bee9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.865003:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.865003:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82959 00000100:00100000:1.0:1713481296.865006:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15793:x1796714784551040:12345-0@lo:101:mdt_io00_014.0 00000004:00200000:2.0:1713481296.865006:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x37c5:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.865011:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.865012:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522688 00000100:00100000:0.0:1713481296.865014:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522688 00010000:00010000:1.0:1713481296.865017:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3bee2 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.865026:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e215d40/0xdfc0fb148a3bcb9 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bc8f expref: 14 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.865030:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 4/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.865033:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563525 00000100:00100000:0.0:1713481296.865036:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:17924:x1796714882522688:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.865041:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.865044:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e215d40/0xdfc0fb148a3bcb9 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdfc0fb148a3bc8f expref: 14 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.865047:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3befe lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cbe expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.865048:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078078000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784551168:0@lo:104: 00010000:00010000:2.0:1713481296.865054:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880120baf180/0xdfc0fb148a3bedb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37c4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ce1 expref: 2174 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.865057:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350abcc0/0xdfc0fb148a15fef lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39860 expref: 20710 pid: 16517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.865061:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.865062:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.865062:0:15506:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.865064:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3befe lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cbe expref: 20710 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.865071:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59480 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.865073:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350abcc0/0xdfc0fb148a15fef lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39860 expref: 20710 pid: 16517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.865074:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bee9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ce1 expref: 2173 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.865078:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x0 (ffff8800919f3500) 00010000:00010000:2.0:1713481296.865080:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1713481296.865081:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350abcc0/0xdfc0fb148a15fef lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39860 expref: 20710 pid: 16517 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.865081:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120bae640, rc 0) 00000004:00080000:1.0:1713481296.865085:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb33:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865086:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092b99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784551232:192.168.202.24@tcp:104: 00000004:00080000:1.0:1713481296.865090:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865093:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb34:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865095:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1e9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865097:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb35:0x0], index 1: 0 00000100:00100000:2.0:1713481296.865097:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2173:18578:x1796714882523072:12345-192.168.202.24@tcp:101:rm.0 Request processed in 189us (236us total) trans 4295105927 rc 0/0 00000100:00100000:0.0:1713481296.865099:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a46c0 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.865099:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ea:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865100:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb36:0x0], index 1: 0 00000100:00100000:2.0:1713481296.865101:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485918 00000004:00080000:1.0:1713481296.865102:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1eb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865104:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb37:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865106:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ec:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865108:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb38:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865110:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ed:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865112:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb39:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865113:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784551168 00000100:00100000:0.0:1713481296.865114:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784551168 00000004:00080000:1.0:1713481296.865114:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ee:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865116:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb3a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865133:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ef:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865135:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb3b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865137:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865139:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb3c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865141:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865143:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb3d:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865144:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20401 00000004:00080000:1.0:1713481296.865145:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f2:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865147:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007807bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15506:x1796714784551168:12345-0@lo:104: 00000004:00080000:1.0:1713481296.865147:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb3e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865149:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865151:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb3f:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865153:0:6916:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865154:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865156:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb40:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865158:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865160:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb41:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865162:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865164:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb42:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865166:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865168:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb43:0x0], index 1: 0 00000100:00100000:1.0:1713481296.865186:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078078000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784551168:0@lo:104: 00010000:00010000:0.0:1713481296.865191:0:6916:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1713481296.865194:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007807bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15506:x1796714784551168:12345-0@lo:104: Request processed in 46us (132us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.865194:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1713481296.865198:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20401 00010000:00010000:2.0:1713481296.865198:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.865202:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.865203:0:6921:0:(ldlm_lockd.c:1968:ldlm_handle_bl_callback()) Lock ffff880096e72640 is referenced, will be cancelled later 00010000:00010000:2.0:1713481296.865205:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.865206:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880122555500) 00010000:00010000:1.0:1713481296.865208:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.865210:0:15506:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 3/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.865214:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f9cdb00, rc 0) 00010000:00010000:2.0:1713481296.865214:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.865215:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.865216:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.865232:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:15793:x1796714784551040:12345-0@lo:101:mdt_io00_014.0 Request processed in 226us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.865234:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.865237:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82959 00000100:00100000:2.0:1713481296.865242:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522752 00000100:00100000:2.0:1713481296.865244:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522752 00000100:00100000:0.0:1713481296.865250:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.865259:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880089a91f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784551040:0@lo:101:mdt_io00_014.0 00000100:00100000:2.0:1713481296.865263:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563526 00010000:00010000:1.0:1713481296.865267:0:15793:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.865267:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16935:17009:x1796714882522752:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.865271:0:15793:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.865272:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.865279:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121610480/0xdfc0fb148a3bf05 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cc5 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865283:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865287:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb44:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865290:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1f9:0x0], index 0: 0 00002000:00010000:2.0:1713481296.865291:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1713481296.865292:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb45:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865294:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.865294:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1fa:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865296:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb46:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865298:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1fb:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865298:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.865299:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.865300:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb47:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865302:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1fc:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865302:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121610480/0xdfc0fb148a3bf05 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cc5 expref: 16936 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.865304:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.865304:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb48:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865305:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1fd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865307:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb49:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865308:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121610480/0xdfc0fb148a3bf05 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cc5 expref: 16936 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865309:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1fe:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865311:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb4a:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865312:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.865313:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121610480, rc 0) 00000004:00080000:1.0:1713481296.865314:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa1ff:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865316:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb4b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865318:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa200:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865320:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb4c:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865321:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520768 00000004:00080000:1.0:1713481296.865322:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa201:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865323:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520768 00000004:00080000:1.0:1713481296.865324:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb4d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865326:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa202:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865326:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16936:17009:x1796714882522752:12345-192.168.202.24@tcp:101:dd.0 Request processed in 58us (92us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.865328:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb4e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865329:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa203:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865330:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563526 00000004:00080000:1.0:1713481296.865332:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb4f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865334:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa204:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865336:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb50:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865339:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa205:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865340:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121e321c0/0xdfc0fb1486893ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31df expref: 26799 pid: 16485 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865341:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb51:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865343:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa206:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865345:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb52:0x0], index 1: 0 00000100:00100000:2.0:1713481296.865346:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522880 00000004:00080000:1.0:1713481296.865347:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa207:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865347:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522880 00000004:00080000:1.0:1713481296.865349:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb53:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865351:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa208:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865353:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb54:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865355:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa209:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865356:0:15642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522816 00000004:00080000:1.0:1713481296.865357:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb55:0x0], index 1: 0 00000100:00100000:2.0:1713481296.865357:0:15642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522816 00000004:00080000:1.0:1713481296.865359:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa20a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865361:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb56:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865363:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa20b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865364:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb57:0x0], index 1: 0 00000100:00100000:2.0:1713481296.865365:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485919 00000004:00080000:1.0:1713481296.865366:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa20c:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865367:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2058:18965:x1796714882522880:12345-192.168.202.24@tcp:101:lfs.0 00000004:00080000:1.0:1713481296.865369:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb58:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865370:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520896 00000004:00080000:1.0:1713481296.865371:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa20d:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865372:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520896 00010000:00010000:2.0:1713481296.865372:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713481296.865373:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb59:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865375:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa20e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865377:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb5a:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865377:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bf0c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cd3 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.865379:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d45200/0xdfc0fb14891f26e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb922 expref: 20711 pid: 9201 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.865379:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa20f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865381:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb5b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865383:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa210:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865385:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb5c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865387:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa211:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865389:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820635 00000004:00080000:1.0:1713481296.865389:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb5d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865391:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa212:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865392:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26799:1960:x1796714882520768:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.865393:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb5e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865396:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa213:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865397:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.865397:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb5f:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865399:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121e321c0/0xdfc0fb1486893ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31df expref: 26799 pid: 16485 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865399:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa214:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865401:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb60:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865403:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa215:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865405:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121e321c0/0xdfc0fb1486893ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31df expref: 26799 pid: 16485 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865405:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb61:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865407:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa216:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865409:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb62:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865411:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa217:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865413:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb63:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865415:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa218:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865417:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb64:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865417:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.865418:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121e321c0/0xdfc0fb1486893ec lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31df expref: 26799 pid: 16485 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865419:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa219:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865421:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb65:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865422:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865423:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa21a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865425:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb66:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865427:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa21b:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865427:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.865428:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.865429:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.865429:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb67:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865431:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865431:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa21c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865433:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb68:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865434:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00010000:00010000:0.0:1713481296.865435:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865436:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa21d:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865437:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865438:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb69:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865440:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa21e:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865440:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865442:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb6a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865444:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa21f:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865446:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.865446:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb6b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865448:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa220:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865450:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb6c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865452:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa221:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865453:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb6d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865455:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa222:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865457:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26798:1960:x1796714882520768:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (152us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.865457:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb6e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865459:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa223:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865461:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820635 00000004:00080000:1.0:1713481296.865461:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb6f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865463:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa224:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865465:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb70:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865467:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa225:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865469:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb71:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865471:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa226:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865473:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820636 00000004:00080000:1.0:1713481296.865473:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb72:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865475:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa227:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865476:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20711:1960:x1796714882520896:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.865476:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000004:00080000:1.0:1713481296.865477:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb73:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865479:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa228:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865480:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.865481:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb74:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865482:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d45200/0xdfc0fb14891f26e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb922 expref: 20711 pid: 9201 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.865483:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa229:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865483:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865486:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb75:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865487:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d45200/0xdfc0fb14891f26e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb922 expref: 20711 pid: 9201 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.865488:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa22a:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865488:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865490:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb76:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865492:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa22b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865494:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb77:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865496:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa22c:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865497:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d45200/0xdfc0fb14891f26e lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cb922 expref: 20711 pid: 9201 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.865498:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb78:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865500:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa22d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865502:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb79:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865504:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa22e:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865506:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.865506:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb7a:0x0], index 1: 0 00000004:00200000:2.0:1713481296.865506:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c6f:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.865507:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.865508:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa22f:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865509:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097da0fc0/0xdfc0fb148a3bdbc lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c47 expref: 16935 pid: 16532 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713481296.865509:0:15642:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00080000:1.0:1713481296.865510:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb7b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865512:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa230:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865514:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097da0fc0/0xdfc0fb148a3bdbc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c47 expref: 16935 pid: 16532 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865514:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb7c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865516:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa231:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865518:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb7d:0x0], index 1: 0 00000004:00010000:2.0:1713481296.865518:0:15642:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865520:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa232:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865522:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb7e:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865523:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097da0fc0/0xdfc0fb148a3bdbc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8065:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c47 expref: 16935 pid: 16532 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865524:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa233:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865526:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb7f:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865527:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865528:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa234:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865530:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb80:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865532:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa235:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865532:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865534:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb81:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865537:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa236:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865537:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865539:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb82:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865541:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa237:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865542:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092b9aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784551296:192.168.202.24@tcp:105: 00000004:00080000:1.0:1713481296.865543:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb83:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865545:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa238:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865546:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb84:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865546:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865548:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa239:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865550:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121610240 already unused, calling callback (ffffffffa0efc730) 00000004:00080000:1.0:1713481296.865551:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb85:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865553:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa23a:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865553:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.865554:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff880092ff6540 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.865555:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb86:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865557:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa23b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865559:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb87:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865559:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865561:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa23c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865562:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb88:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865564:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa23d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865566:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb89:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865567:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000004:00080000:1.0:1713481296.865569:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa23e:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865569:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:1.0:1713481296.865571:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb8a:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865572:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865573:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa23f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865574:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb8b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865576:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa240:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865576:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121610240/0xdfc0fb148a3bf13 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865578:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb8c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865580:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa241:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865582:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb8d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865584:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa242:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865586:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb8e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865588:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa243:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865590:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865591:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb8f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865592:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa244:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865594:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb90:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865595:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865597:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa245:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865599:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb91:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865600:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa246:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865600:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865602:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb92:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865604:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa247:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865604:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096b45200 already unused, calling callback (ffffffffa0efc730) 00000004:00080000:1.0:1713481296.865606:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb93:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865607:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865608:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa248:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865610:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb94:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865612:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa249:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865612:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865614:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb95:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865616:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa24a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865618:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb96:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865619:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa24b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865621:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb97:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865622:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff880091b3c000) 00000004:00080000:1.0:1713481296.865623:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa24c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865625:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb98:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865625:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:1.0:1713481296.865627:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa24d:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865627:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865629:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb99:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865630:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.865630:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096b45200/0xdfc0fb148a3bf1a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865631:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa24e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865633:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb9a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865635:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa24f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865637:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb9b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865639:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa250:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865642:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb9c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865643:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa251:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865646:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb9d:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865647:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521088 00000004:00080000:1.0:1713481296.865648:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa252:0x0], index 0: 0 00000100:00100000:0.0:1713481296.865650:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521088 00000004:00080000:1.0:1713481296.865650:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb9e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865652:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa253:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865653:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbb9f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865655:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa254:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865657:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba0:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865658:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121613840/0xdfc0fb148a3bf0c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2060 pid: 15642 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865659:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa255:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865661:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865678:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa256:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865680:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba2:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865682:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2059 pid: 15642 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865683:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa257:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865685:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865686:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa258:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865686:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff880084b4fd00) 00010000:00010000:0.0:1713481296.865687:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801216ffa80/0xdfc0fb148689401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31fb expref: 26798 pid: 16509 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865688:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba4:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865688:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713481296.865689:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffa0240, rc 0) 00000004:00080000:1.0:1713481296.865690:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa259:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865692:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865695:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa25a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865698:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865700:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa25b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865702:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865704:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa25c:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865704:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2059:18965:x1796714882522880:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 335us (453us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.865706:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba8:0x0], index 1: 0 00000100:00100000:2.0:1713481296.865707:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485919 00000004:00080000:1.0:1713481296.865708:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa25d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865710:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbba9:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865712:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820637 00000004:00080000:1.0:1713481296.865712:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa25e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865714:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbaa:0x0], index 1: 0 00000100:00100000:0.0:1713481296.865716:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26798:1960:x1796714882521088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.865716:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa25f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865718:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbab:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865720:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa260:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865721:0:15642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485920 00000004:00080000:1.0:1713481296.865722:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbac:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865723:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.865723:0:15642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2058:18805:x1796714882522816:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000004:00080000:1.0:1713481296.865724:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa261:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865726:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbad:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865727:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801216ffa80/0xdfc0fb148689401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31fb expref: 26798 pid: 16509 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865728:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa262:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865728:0:15642:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713481296.865730:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbae:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865732:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa263:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865734:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801216ffa80/0xdfc0fb148689401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31fb expref: 26798 pid: 16509 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865734:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbaf:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865734:0:15642:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bf28 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ccc expref: -99 pid: 15642 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865736:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa264:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865738:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865739:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa265:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865742:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865744:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa266:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865746:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb2:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865747:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801216ffa80/0xdfc0fb148689401 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31fb expref: 26798 pid: 16509 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.865747:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa267:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865749:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865752:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa268:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865754:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865756:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa269:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865758:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.865758:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb5:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865759:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.865760:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865760:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa26a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865762:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865764:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa26b:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865765:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865766:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865768:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa26c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865770:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865772:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa26d:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865773:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000004:00080000:1.0:1713481296.865774:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbb9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865776:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa26e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865778:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbba:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865779:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.865779:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa26f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865781:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbbb:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865781:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865783:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa270:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865785:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbbc:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865785:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865787:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa271:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865789:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbbd:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865789:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000100:00100000:0.0:1713481296.865791:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26797:1960:x1796714882521088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.865791:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa272:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865793:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbbe:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865793:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000100:00100000:0.0:1713481296.865795:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820637 00000004:00080000:1.0:1713481296.865795:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa273:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865796:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865797:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbbf:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865799:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa274:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865801:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865803:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa275:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865805:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865807:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa276:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865809:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865811:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa277:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865813:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865815:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa278:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865817:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865819:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa279:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865821:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc5:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865821:0:15642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bf3d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15642 initiator: MDT0 00000004:00080000:1.0:1713481296.865822:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa27a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865824:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc6:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865825:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.865825:0:15642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bf3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865826:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa27b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865828:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc7:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865828:0:15642:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bf3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865830:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa27c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865831:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865834:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa27d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865836:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbc9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865837:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa27e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865839:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbca:0x0], index 1: 0 00000004:00200000:2.0:1713481296.865839:0:15642:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2cbd:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.865840:0:15642:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00080000:1.0:1713481296.865841:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa27f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865843:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbcb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865845:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa280:0x0], index 0: 0 00000004:00010000:2.0:1713481296.865846:0:15642:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bf3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865847:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbcc:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865849:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa281:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865851:0:15642:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865852:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbcd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865854:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa282:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865854:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865856:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbce:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865858:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa283:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865859:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbcf:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865859:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865862:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa284:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865862:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865863:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd0:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865864:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097da2d00 already unused, calling callback (ffffffffa0efc730) 00000004:00080000:1.0:1713481296.865866:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa285:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865866:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865868:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865869:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa286:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865869:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865871:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd2:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865872:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbb:0x0].0x0 (ffff88008ad2f600) 00000004:00080000:1.0:1713481296.865873:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa287:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865873:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:1.0:1713481296.865875:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd3:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865875:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:2.0:1713481296.865877:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097da2d00/0xdfc0fb148a3bf2f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865878:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa288:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865880:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865882:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa289:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865884:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd5:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865885:0:15642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865886:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa28a:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865887:0:15642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865888:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865890:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa28b:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865890:0:15642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865892:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd7:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865893:0:15642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121dbd440 already unused, calling callback (ffffffffa0efc730) 00000004:00080000:1.0:1713481296.865894:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa28c:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865894:0:15642:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.865896:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865896:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865898:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa28d:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865899:0:15642:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865900:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbd9:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865902:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865902:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa28e:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865902:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbb:0x0].0x31 (ffff88009759f800) 00000004:00080000:1.0:1713481296.865904:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbda:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865904:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.865905:0:15642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00010000:00010000:0.0:1713481296.865906:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865906:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa28f:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865907:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbd440/0xdfc0fb148a3bf36 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2cbb:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15642 initiator: MDT1 00000004:00080000:1.0:1713481296.865908:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbdb:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865910:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865910:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa290:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865912:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbdc:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865913:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880120bafcc0 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:1.0:1713481296.865914:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa291:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865915:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865915:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbdd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865918:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa292:0x0], index 0: 0 00010000:00010000:0.0:1713481296.865919:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865920:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbde:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865922:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa293:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865924:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbdf:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865925:0:15642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fe073c0/0xdfc0fb148a3bf28 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2cbb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ccc expref: 2060 pid: 15642 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865926:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa294:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865928:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe0:0x0], index 1: 0 00010000:00010000:0.0:1713481296.865929:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865930:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa295:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865932:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe1:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865932:0:15642:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880121dbe640/0xdfc0fb148a3bf3d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cbd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ccc expref: 2059 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.865933:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3bdfb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865934:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa296:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865935:0:15642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbd:0x0].0x0 (ffff8800941bb000) 00000004:00080000:1.0:1713481296.865936:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe2:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865936:0:15642:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00000004:00080000:1.0:1713481296.865938:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa297:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865938:0:15642:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121dbe640, rc 0) 00000004:00080000:1.0:1713481296.865940:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865942:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa298:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865944:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865946:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa299:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865948:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865950:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa29a:0x0], index 0: 0 00000100:00100000:2.0:1713481296.865951:0:15642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_029:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2059:18805:x1796714882522816:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 227us (657us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.865953:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe6:0x0], index 1: 0 00000100:00100000:2.0:1713481296.865954:0:15642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485920 00000004:00080000:1.0:1713481296.865955:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa29b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865957:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865959:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa29c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865961:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865963:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa29d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865965:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbe9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865967:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa29e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865969:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbea:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865970:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa29f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865972:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbeb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865975:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865976:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbec:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865976:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865978:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865980:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbed:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865980:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865982:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865984:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbee:0x0], index 1: 0 00000004:00080000:1.0:1713481296.865986:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865988:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbef:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865988:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865990:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.865992:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf0:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865992:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865994:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a5:0x0], index 0: 0 00010000:00010000:2.0:1713481296.865995:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.865996:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf1:0x0], index 1: 0 00010000:00010000:2.0:1713481296.865998:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800737af600 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:1.0:1713481296.865999:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a6:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866000:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866001:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866003:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a7:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866004:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866005:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866007:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866009:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866012:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2a9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866013:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf5:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866014:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866015:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2aa:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866017:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf6:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866018:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3bded lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866019:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ab:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866021:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866023:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ac:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866025:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866027:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ad:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866029:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbf9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866030:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ae:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866033:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbfa:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866035:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2af:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866037:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbfb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866039:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866041:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbfc:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866043:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866044:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbfd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866046:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866048:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbfe:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866050:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866052:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbbff:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866054:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866057:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc00:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866059:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866061:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc01:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866062:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866064:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc02:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866067:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866069:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc03:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866071:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866073:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc04:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866074:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2b9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866076:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc05:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866078:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ba:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866080:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc06:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866082:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2bb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866084:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc07:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866086:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2bc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866088:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc08:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866090:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2bd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866092:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc09:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866093:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2be:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866095:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc0a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866097:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2bf:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866100:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc0b:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866101:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2873:3490:x1796714784548992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7120us (7178us total) trans 4295960815 rc 0/0 00000004:00080000:1.0:1713481296.866102:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866104:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc0c:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866106:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563503 00000004:00080000:1.0:1713481296.866107:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866109:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc0d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866111:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866113:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc0e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866115:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866116:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc0f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866133:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866135:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc10:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866137:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866139:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc11:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866141:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866143:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc12:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866145:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866147:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc13:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866149:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866151:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc14:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866154:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2c9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866156:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc15:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866158:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ca:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866158:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2872:3492:x1796714784548544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7848us (7894us total) trans 4295960816 rc 0/0 00000004:00080000:1.0:1713481296.866159:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc16:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866161:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2cb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866163:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc17:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866163:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563499 00000004:00080000:0.0:1713481296.866164:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097b4ce00/2, rc 0, transno 993520 00000004:00080000:1.0:1713481296.866165:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2cc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866168:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc18:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866169:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784548544:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866170:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2cd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866172:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc19:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866174:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ce:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866176:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc1a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866177:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2cf:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866180:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc1b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866181:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866183:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc1c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866185:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d1:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866186:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.866187:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc1d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866189:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866192:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc1e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866193:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866195:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc1f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866197:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866199:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc20:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866201:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866203:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc21:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866204:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866206:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc22:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866207:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.866208:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866210:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc23:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866212:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866214:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc24:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866216:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2d9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866219:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc25:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866221:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2da:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866223:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc26:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866225:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2db:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866226:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc27:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866228:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2dc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866230:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc28:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866232:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2dd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866234:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc29:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866236:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2de:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866238:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc2a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866240:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2df:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866242:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc2b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866244:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866246:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc2c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866248:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866250:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc2d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866252:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866254:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc2e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866256:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866257:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc2f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866260:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866262:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc30:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866264:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866266:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc31:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866267:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784551360:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866268:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866270:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc32:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866272:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866274:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc33:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866276:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866278:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc34:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866281:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2e9:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866282:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1713481296.866283:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc35:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866285:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ea:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866287:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc36:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866289:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2eb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866291:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc37:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866293:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ec:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866295:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc38:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866297:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ed:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866299:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc39:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866300:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521216 00000004:00080000:1.0:1713481296.866301:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ee:0x0], index 0: 0 00000004:00080000:2.0:1713481296.866301:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081690000/2, rc 0, transno 993519 00000100:00100000:0.0:1713481296.866302:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521216 00000004:00080000:1.0:1713481296.866303:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc3a:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866304:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784548992:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866305:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ef:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866307:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc3b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866309:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f0:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866311:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133df2400/0xdfc0fb148689822 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3225 expref: 26797 pid: 15542 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866312:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc3c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866313:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866316:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc3d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866318:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f2:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866320:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521344 00000004:00080000:1.0:1713481296.866320:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc3e:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866321:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521344 00000004:00080000:1.0:1713481296.866322:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866324:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc3f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866326:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f4:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866327:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148916dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65ae expref: 20711 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.866327:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784551424:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866328:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc40:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866330:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866332:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc41:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866334:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866336:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc42:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866337:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1713481296.866338:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866340:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc43:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866342:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f8:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866343:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820638 00000004:00080000:1.0:1713481296.866344:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc44:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866346:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26797:1960:x1796714882521216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.866346:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2f9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866348:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc45:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866350:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2fa:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866352:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc46:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866353:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.866354:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2fb:0x0], index 0: 0 00000100:00100000:3.0:1713481296.866354:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820639 00010000:00010000:0.0:1713481296.866355:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133df2400/0xdfc0fb148689822 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3225 expref: 26797 pid: 15542 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866356:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc47:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866358:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2fc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866360:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc48:0x0], index 1: 0 00000100:00100000:3.0:1713481296.866360:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20711:1960:x1796714882521344:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.866361:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133df2400/0xdfc0fb148689822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3225 expref: 26797 pid: 15542 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866362:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2fd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866364:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc49:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866365:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784551360 00000004:00080000:1.0:1713481296.866367:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2fe:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866367:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784551360 00010000:00010000:3.0:1713481296.866367:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.866369:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc4a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866371:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa2ff:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866372:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133df2400/0xdfc0fb148689822 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3225 expref: 26797 pid: 15542 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866373:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc4b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866375:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa300:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866376:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784551424 00000004:00080000:1.0:1713481296.866377:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc4c:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866377:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784551424 00010000:00010000:3.0:1713481296.866378:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148916dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65ae expref: 20711 pid: 15547 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866379:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa301:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866381:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc4d:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866382:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.866383:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866383:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa302:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866385:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866385:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc4e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866386:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa303:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866386:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563527 00010000:00010000:3.0:1713481296.866386:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148916dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65ae expref: 20711 pid: 15547 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.866388:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2873:3490:x1796714784551360:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.866389:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866389:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc4f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866391:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa304:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866393:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc50:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866395:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa305:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866397:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc51:0x0], index 1: 0 00002000:00080000:2.0:1713481296.866397:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43553 count 1 00010000:00010000:0.0:1713481296.866398:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.866399:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa306:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866401:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc52:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866403:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa307:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866405:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc53:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866405:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.866405:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148916dc2 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65ae expref: 20711 pid: 15547 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866407:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa308:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866409:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc54:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866410:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26796:1960:x1796714882521216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 62us (223us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.866411:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa309:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866413:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc55:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866413:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800733d8480/0xdfc0fb148689830 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3241 expref: 26796 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.866414:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820638 00010000:00010000:3.0:1713481296.866414:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.866415:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866416:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa30a:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866417:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866418:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc56:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866418:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.866418:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9b00/0xdfc0fb148a3be3a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c63 expref: 20710 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866420:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa30b:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866420:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866423:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc57:0x0], index 1: 0 00010000:00010000:3.0:1713481296.866423:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9b00/0xdfc0fb148a3be3a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c63 expref: 20710 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866425:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa30c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866427:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc58:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866429:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa30d:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866430:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800733d8480/0xdfc0fb148689830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3241 expref: 26795 pid: 16527 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.866431:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc59:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866432:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563528 00000004:00080000:1.0:1713481296.866434:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa30e:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866435:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2873:3491:x1796714784551424:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866435:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc5a:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866435:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800733d8480/0xdfc0fb148689830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3241 expref: 26795 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.866436:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9b00/0xdfc0fb148a3be3a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c63 expref: 20710 pid: 16493 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866437:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa30f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866439:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc5b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866441:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa310:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866443:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc5c:0x0], index 1: 0 00002000:00080000:0.0:1713481296.866444:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43555 count 1 00000100:00100000:2.0:1713481296.866444:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784551488:192.168.202.24@tcp:104: 00000004:00080000:1.0:1713481296.866445:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa311:0x0], index 0: 0 00000100:00100000:3.0:1713481296.866446:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784551552:192.168.202.24@tcp:105: 00000004:00080000:1.0:1713481296.866447:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc5d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866449:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa312:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866451:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866451:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc5e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866453:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa313:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866455:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc5f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866457:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa314:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866458:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012168e540 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.866460:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc60:0x0], index 1: 0 00000100:00100000:3.0:1713481296.866460:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.866461:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9d40/0xdfc0fb14868984c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d324f expref: 26795 pid: 16485 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.866462:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa315:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866464:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866464:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc61:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866465:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866466:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa316:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866467:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866468:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc62:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866470:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa317:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866470:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866472:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc63:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866474:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866475:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa318:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866477:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e9d40/0xdfc0fb14868984c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d324f expref: 26795 pid: 16485 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.866477:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc64:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866478:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866480:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa319:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866482:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e9d40/0xdfc0fb14868984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d324f expref: 26795 pid: 16485 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866482:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc65:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866482:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866484:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa31a:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866485:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866486:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc66:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866488:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784551616:192.168.202.24@tcp:104: 00000004:00080000:1.0:1713481296.866488:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa31b:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866488:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aab2d00 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:1.0:1713481296.866489:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc67:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866490:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866491:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa31c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866493:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc68:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866494:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866495:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa31d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866497:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc69:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866499:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa31e:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866500:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098098300 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.866501:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc6a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866503:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa31f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866505:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc6b:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866505:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866507:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa320:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866509:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc6c:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866509:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007aab2d00/0xdfc0fb148a3be2c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866511:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa321:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866513:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc6d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866515:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa322:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866517:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc6e:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866518:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.866519:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa323:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866521:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc6f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866523:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa324:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866525:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc70:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866527:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521472 00000004:00080000:1.0:1713481296.866527:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa325:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866529:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521472 00000004:00080000:1.0:1713481296.866529:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc71:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866531:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa326:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866532:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc72:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866534:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa327:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866536:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083b76d00/0xdfc0fb148689408 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3209 expref: 26796 pid: 16479 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866536:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc73:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866538:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa328:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866540:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc74:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866542:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa329:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866544:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc75:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866545:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820640 00000004:00080000:1.0:1713481296.866546:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa32a:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866547:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26796:1960:x1796714882521472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.866548:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc76:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866550:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa32b:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866551:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.866552:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc77:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866554:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083b76d00/0xdfc0fb148689408 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3209 expref: 26796 pid: 16479 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866554:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa32c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866555:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc78:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866558:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa32d:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866559:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083b76d00/0xdfc0fb148689408 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3209 expref: 26796 pid: 16479 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866560:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc79:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866562:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa32e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866564:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc7a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866566:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa32f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866568:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc7b:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866570:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083b76d00/0xdfc0fb148689408 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3209 expref: 26796 pid: 16479 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866570:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa330:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866572:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc7c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866574:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa331:0x0], index 0: 0 00000001:00080000:3.0:1713481296.866575:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040936 00010000:00010000:0.0:1713481296.866577:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866577:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc7d:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866578:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.866579:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866579:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa332:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866581:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc7e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866583:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa333:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866584:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866585:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc7f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866587:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa334:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866588:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc80:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866590:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa335:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866592:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc81:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866594:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa336:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866596:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc82:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866598:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa337:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866600:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc83:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866602:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa338:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866604:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc84:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866606:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa339:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866608:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc85:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866610:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa33a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866612:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc86:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866613:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa33b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866615:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc87:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866617:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa33c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866619:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc88:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866621:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa33d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866624:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc89:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866626:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa33e:0x0], index 0: 0 00002000:00080000:3.0:1713481296.866626:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57682 00000004:00080000:1.0:1713481296.866628:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc8a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866630:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa33f:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866631:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2874:3493:x1796714784549760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7019us (7076us total) trans 4295960817 rc 0/0 00000004:00080000:1.0:1713481296.866632:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc8b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866634:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa340:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866636:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc8c:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866637:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563509 00000004:00080000:1.0:1713481296.866638:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa341:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866640:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc8d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866641:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa342:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866643:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc8e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866645:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa343:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866647:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc8f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866649:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa344:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866651:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc90:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866653:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.866653:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa345:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866655:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc91:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866657:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa346:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866659:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc92:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866661:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa347:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866678:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc93:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866680:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26795:1960:x1796714882521472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 130us (160us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.866680:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa348:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866682:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc94:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866684:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820640 00000004:00080000:1.0:1713481296.866685:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa349:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866687:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc95:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866689:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa34a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866691:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc96:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866693:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa34b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866696:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc97:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866698:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa34c:0x0], index 0: 0 00000004:00080000:2.0:1713481296.866698:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bd8a300/2, rc 0, transno 993521 00000004:00080000:1.0:1713481296.866700:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc98:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866701:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa34d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866703:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc99:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866705:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa34e:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866707:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784549760:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866708:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc9a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866710:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa34f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866712:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc9b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866713:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa350:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866714:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.866715:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc9c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866717:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa351:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866719:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc9d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866722:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa352:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866724:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc9e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866725:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa353:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866726:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.866727:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbc9f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866729:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa354:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866731:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca0:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866733:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521600 00000004:00080000:1.0:1713481296.866733:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa355:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866735:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521600 00000004:00080000:1.0:1713481296.866736:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866738:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa356:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866739:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1713481296.866740:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca2:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866742:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800868b0fc0/0xdfc0fb148802ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963179 expref: 20711 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866742:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa357:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866745:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca3:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866746:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784551680:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866747:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa358:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866749:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca4:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866751:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820641 00000004:00080000:1.0:1713481296.866751:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa359:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866753:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca5:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866754:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20711:1960:x1796714882521600:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.866755:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa35a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866757:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca6:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866758:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.866759:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa35b:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866760:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800868b0fc0/0xdfc0fb148802ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963179 expref: 20711 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866760:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866762:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa35c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866764:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca8:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866766:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800868b0fc0/0xdfc0fb148802ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963179 expref: 20711 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866766:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa35d:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866767:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1713481296.866768:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbca9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866770:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa35e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866773:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcaa:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866775:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa35f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866777:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcab:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866779:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa360:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866781:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcac:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866782:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa361:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866783:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800868b0fc0/0xdfc0fb148802ba3 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963179 expref: 20711 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866784:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcad:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866787:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa362:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866789:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcae:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866790:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784551680 00000004:00080000:1.0:1713481296.866791:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa363:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866793:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcaf:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866793:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784551680 00000004:00080000:1.0:1713481296.866795:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa364:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866796:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.866797:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866797:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866799:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa365:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866800:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866801:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866803:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa366:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866804:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866806:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa367:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866807:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866808:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866810:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa368:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866812:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866814:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa369:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866816:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb5:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866816:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563529 00000004:00080000:1.0:1713481296.866818:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa36a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866819:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb6:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866820:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2874:3493:x1796714784551680:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713481296.866821:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa36b:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866824:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.866824:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866826:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa36c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866827:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb8:0x0], index 1: 0 00002000:00080000:2.0:1713481296.866828:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43557 count 1 00000004:00080000:1.0:1713481296.866830:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa36d:0x0], index 0: 0 00010000:00010000:3.0:1713481296.866830:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866831:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcb9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866833:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa36e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866835:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcba:0x0], index 1: 0 00010000:00010000:3.0:1713481296.866835:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.866836:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.866837:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20710:1960:x1796714882521600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (109us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.866837:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa36f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866840:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcbb:0x0], index 1: 0 00010000:00010000:3.0:1713481296.866840:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866842:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa370:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866844:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820641 00000004:00080000:1.0:1713481296.866844:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcbc:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866844:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9b00/0xdfc0fb148689853 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d325d expref: 26794 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.866844:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866845:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa371:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866847:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcbd:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866848:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.866848:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.866849:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866850:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa372:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866850:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866852:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcbe:0x0], index 1: 0 00010000:00010000:3.0:1713481296.866852:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124311f80 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:1.0:1713481296.866854:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa373:0x0], index 0: 0 00010000:00010000:3.0:1713481296.866854:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866855:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcbf:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866857:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa374:0x0], index 0: 0 00010000:00010000:3.0:1713481296.866858:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866859:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866861:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa375:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866863:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc1:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866863:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e9b00/0xdfc0fb148689853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d325d expref: 26794 pid: 16454 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.866865:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa376:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866867:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866869:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa377:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866869:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e9b00/0xdfc0fb148689853 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d325d expref: 26794 pid: 16454 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866871:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866873:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa378:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866874:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc4:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866874:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784551744:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.866875:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866877:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa379:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866878:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc5:0x0], index 1: 0 00010000:00010000:3.0:1713481296.866879:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124311f80/0xdfc0fb148a3be17 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.866880:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.866880:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa37a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866883:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc6:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866885:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa37b:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866885:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009eb9b840 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.866887:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866889:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa37c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866891:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc8:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866892:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521728 00000004:00080000:1.0:1713481296.866893:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa37d:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866894:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521728 00000004:00080000:1.0:1713481296.866895:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcc9:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866897:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa37e:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866897:0:15475:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522944 00000004:00080000:1.0:1713481296.866899:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcca:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866899:0:15475:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522944 00000004:00080000:1.0:1713481296.866901:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa37f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866903:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbccb:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866904:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085c19200/0xdfc0fb148802b8e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96314f expref: 20710 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866905:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa380:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866907:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbccc:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866908:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa381:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866911:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbccd:0x0], index 1: 0 00000100:00100000:2.0:1713481296.866911:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485921 00000004:00080000:1.0:1713481296.866913:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa382:0x0], index 0: 0 00000100:00100000:2.0:1713481296.866913:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2393:18955:x1796714882522944:12345-192.168.202.24@tcp:101:mrename.0 00000004:00080000:1.0:1713481296.866914:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcce:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866916:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa383:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866918:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbccf:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866918:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713481296.866920:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa384:0x0], index 0: 0 00000100:00100000:0.0:1713481296.866921:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820642 00000004:00080000:1.0:1713481296.866922:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd0:0x0], index 1: 0 00000100:00100000:0.0:1713481296.866924:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20710:1960:x1796714882521728:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.866924:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa385:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866924:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c5833c0/0xdfc0fb148a3bf59 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cda expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866926:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd1:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866928:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.866928:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa386:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866930:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085c19200/0xdfc0fb148802b8e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2765:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96314f expref: 20710 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866930:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866932:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa387:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866935:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd3:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866936:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085c19200/0xdfc0fb148802b8e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2765:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96314f expref: 20710 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866937:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa388:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866939:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866941:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa389:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866943:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866945:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa38a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866947:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd6:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866948:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c19200/0xdfc0fb148802b8e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2765:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96314f expref: 20710 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.866949:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa38b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866951:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866953:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa38c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866955:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866956:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa38d:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866959:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.866959:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcd9:0x0], index 1: 0 00010000:00010000:0.0:1713481296.866960:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.866961:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866961:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa38e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866962:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcda:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866963:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000004:00080000:1.0:1713481296.866964:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa38f:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866966:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.866966:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcdb:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866968:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.866969:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa390:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866971:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcdc:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866972:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.866973:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa391:0x0], index 0: 0 00010000:00010000:0.0:1713481296.866975:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.866975:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcdd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866977:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa392:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866978:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000004:00080000:1.0:1713481296.866980:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcde:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866981:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa393:0x0], index 0: 0 00000004:00080000:1.0:1713481296.866984:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcdf:0x0], index 1: 0 00010000:00010000:2.0:1713481296.866984:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.866986:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa394:0x0], index 0: 0 00010000:00010000:2.0:1713481296.866987:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.866988:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:1960:x1796714882521728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (108us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.866988:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866990:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa395:0x0], index 0: 0 00000100:00100000:3.0:1713481296.866990:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+285:3491:x1796714784549504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7551us (7584us total) trans 4296040948 rc 0/0 00000100:00100000:0.0:1713481296.866991:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820642 00000004:00080000:1.0:1713481296.866992:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce1:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866994:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa396:0x0], index 0: 0 00000100:00100000:3.0:1713481296.866995:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563506 00000004:00080000:1.0:1713481296.866996:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce2:0x0], index 1: 0 00000004:00080000:1.0:1713481296.866998:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa397:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867000:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867002:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa398:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867004:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce4:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867006:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa399:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867008:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce5:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867008:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bf6e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000004:00080000:1.0:1713481296.867010:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa39a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867012:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce6:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867012:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bf6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.867013:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.867014:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa39b:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867015:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bf6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867016:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce7:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867017:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa39c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867019:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce8:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867021:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa39d:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867022:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521856 00000004:00080000:3.0:1713481296.867022:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299a680/2, rc 0, transno 1073652 00000004:00080000:1.0:1713481296.867023:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbce9:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867024:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521856 00000004:00200000:2.0:1713481296.867024:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c6f:0x0]: returning size 4096 00000004:00080000:1.0:1713481296.867025:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa39e:0x0], index 0: 0 00000004:00200000:2.0:1713481296.867026:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00080000:1.0:1713481296.867027:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcea:0x0], index 1: 0 00000100:00100000:3.0:1713481296.867027:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784549504:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.867029:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085c19b00/0xdfc0fb148802baa lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963187 expref: 20709 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867029:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa39f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867031:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbceb:0x0], index 1: 0 00000004:00010000:2.0:1713481296.867031:0:15475:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bf6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867033:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867035:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcec:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867035:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.867038:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820643 00000004:00080000:1.0:1713481296.867038:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a1:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867039:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867040:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbced:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867041:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20709:1960:x1796714882521856:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.867041:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867042:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a2:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867044:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.867044:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcee:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867044:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.867046:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085c19b00/0xdfc0fb148802baa lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963187 expref: 20709 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867046:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a3:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867047:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124310000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.867048:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867049:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcef:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867051:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085c19b00/0xdfc0fb148802baa lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963187 expref: 20709 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867051:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a4:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867052:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867053:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf0:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867055:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867057:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf1:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867057:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:2.0:1713481296.867058:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.867058:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713481296.867059:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c19b00/0xdfc0fb148802baa lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963187 expref: 20709 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867059:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a6:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867060:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867061:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf2:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867062:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124310000/0xdfc0fb148a3bf60 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867063:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a7:0x0], index 0: 0 00000100:00100000:3.0:1713481296.867064:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784551808:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.867065:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf3:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867067:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a8:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867068:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.867069:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.867069:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf4:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867069:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00010000:00010000:0.0:1713481296.867071:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867071:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3a9:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867071:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867073:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf5:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867074:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3aa:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867074:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867077:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf6:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867077:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e72d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.867078:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.867078:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.867079:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867079:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ab:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867081:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf7:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867081:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867083:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ac:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867084:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff880097b2bf00) 00000004:00080000:1.0:1713481296.867085:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf8:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867085:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.867086:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867088:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ad:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867089:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3bf67 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT1 00000004:00080000:1.0:1713481296.867090:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcf9:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867091:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.867092:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ae:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867094:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcfa:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867096:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3af:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867098:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcfb:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867100:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b0:0x0], index 0: 0 00000100:00100000:3.0:1713481296.867101:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784551808 00000004:00080000:1.0:1713481296.867102:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcfc:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867103:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20708:1960:x1796714882521856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (88us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.867104:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b1:0x0], index 0: 0 00000100:00100000:3.0:1713481296.867104:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784551808 00000004:00080000:1.0:1713481296.867106:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcfd:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867108:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867110:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcfe:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867111:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b3:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867112:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820643 00000004:00080000:1.0:1713481296.867113:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbcff:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867115:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b4:0x0], index 0: 0 00000100:00100000:3.0:1713481296.867115:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563530 00000004:00080000:1.0:1713481296.867117:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd00:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867133:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b5:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867134:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c5833c0/0xdfc0fb148a3bf59 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cda expref: 2395 pid: 15475 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867135:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd01:0x0], index 1: 0 00000100:00100000:3.0:1713481296.867136:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+285:3492:x1796714784551808:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.867137:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867139:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd02:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867141:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867144:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd03:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867145:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bf6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cda expref: 2394 pid: 15475 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867146:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b8:0x0], index 0: 0 00002000:00080000:3.0:1713481296.867146:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10092 count 1 00000004:00080000:1.0:1713481296.867148:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd04:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867148:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff880084b4fd00) 00010000:00010000:2.0:1713481296.867149:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00080000:1.0:1713481296.867150:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3b9:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867151:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e71f80, rc 0) 00000004:00080000:1.0:1713481296.867152:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd05:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867154:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ba:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867156:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd06:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867156:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867159:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3bb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867161:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd07:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867163:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3bc:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867163:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2394:18955:x1796714882522944:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 248us (448us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.867164:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd08:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867164:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cddd40/0xdfc0fb148802bbf lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631b1 expref: 20707 pid: 9201 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.867167:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3bd:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867167:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485921 00000100:00100000:0.0:1713481296.867168:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.867169:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd09:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867169:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.867170:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3be:0x0], index 0: 0 00010000:00010000:3.0:1713481296.867171:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.867172:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd0a:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867172:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867174:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3bf:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867176:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd0b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867178:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c0:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867179:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522048 00000100:00100000:0.0:1713481296.867181:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522048 00000004:00080000:1.0:1713481296.867181:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd0c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867183:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867184:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd0d:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867184:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cddd40/0xdfc0fb148802bbf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631b1 expref: 20707 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.867185:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867186:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867188:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd0e:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867189:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081d68fc0/0xdfc0fb14891d453 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca72b expref: 24483 pid: 16533 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867190:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c3:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867190:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.867190:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cddd40/0xdfc0fb148802bbf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631b1 expref: 20707 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867192:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd0f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867194:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c4:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867194:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867196:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd10:0x0], index 1: 0 00000100:00100000:3.0:1713481296.867196:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784551872:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.867198:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820644 00010000:00010000:2.0:1713481296.867198:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867199:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c5:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867201:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1960:x1796714882522048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.867201:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd11:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867202:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867203:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c6:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867204:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.867205:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd12:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867206:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880081d68fc0/0xdfc0fb14891d453 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca72b expref: 24483 pid: 16533 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867207:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c7:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867208:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d98c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.867208:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.867209:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd13:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867210:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867211:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c8:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867212:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880081d68fc0/0xdfc0fb14891d453 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca72b expref: 24483 pid: 16533 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867213:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd14:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867213:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867215:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3c9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867217:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd15:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867219:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ca:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867220:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081d68fc0/0xdfc0fb14891d453 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca72b expref: 24483 pid: 16533 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867221:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd16:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867221:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867223:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3cb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867225:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd17:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867225:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3be41 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867227:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3cc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867229:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd18:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867230:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.867231:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3cd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867232:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd19:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867234:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ce:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867237:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd1a:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867238:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882522048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 37us (71us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.867239:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3cf:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867241:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd1b:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867242:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820644 00000004:00080000:1.0:1713481296.867243:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867244:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd1c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867247:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867251:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd1d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867254:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867257:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd1e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867261:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d3:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867263:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.867264:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd1f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867268:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d4:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867271:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522176 00000004:00080000:1.0:1713481296.867271:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd20:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867273:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522176 00000004:00080000:1.0:1713481296.867274:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d5:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867277:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd21:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867278:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c5806c0/0xdfc0fb148802bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631a3 expref: 20708 pid: 16497 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867281:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867284:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd22:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867287:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820645 00000004:00080000:1.0:1713481296.867287:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d7:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867289:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20708:1960:x1796714882522176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.867290:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd23:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867293:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.867293:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d8:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867295:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c5806c0/0xdfc0fb148802bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631a3 expref: 20708 pid: 16497 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867296:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd24:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867300:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3d9:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867301:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c5806c0/0xdfc0fb148802bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631a3 expref: 20708 pid: 16497 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867303:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd25:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867306:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3da:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867309:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd26:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867313:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3db:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867316:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd27:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867318:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c5806c0/0xdfc0fb148802bb8 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x276b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631a3 expref: 20708 pid: 16497 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.867320:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3dc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867323:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd28:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867326:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3dd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867329:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd29:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867333:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3de:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867334:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.867336:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.867336:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd2a:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867338:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867338:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3df:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867340:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd2b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867342:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e0:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867345:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867345:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd2c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867347:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e1:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867347:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+286:3491:x1796714784550080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7515us (7560us total) trans 4296040949 rc 0/0 00000004:00080000:1.0:1713481296.867349:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd2d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867351:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e2:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867352:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563512 00000004:00080000:1.0:1713481296.867353:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd2e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867355:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e3:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867357:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd2f:0x0], index 1: 0 00000004:00080000:3.0:1713481296.867358:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d35f80/2, rc 0, transno 1073653 00000004:00080000:1.0:1713481296.867359:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e4:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867361:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.867361:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd30:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867364:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e5:0x0], index 0: 0 00000100:00100000:3.0:1713481296.867364:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784550080:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.867365:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd31:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867367:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867369:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd32:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867371:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20707:1960:x1796714882522176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 80us (107us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.867371:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e7:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867373:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd33:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867375:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820645 00010000:00010000:3.0:1713481296.867375:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867376:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e8:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867376:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867378:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd34:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867380:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3e9:0x0], index 0: 0 00010000:00010000:3.0:1713481296.867380:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.867381:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867382:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd35:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867384:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ea:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867385:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.867385:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867386:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd36:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867388:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3eb:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867389:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.867389:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867391:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd37:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867392:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ec:0x0], index 0: 0 00010000:00010000:3.0:1713481296.867393:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.867394:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867395:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd38:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867396:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ed:0x0], index 0: 0 00010000:00010000:3.0:1713481296.867397:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b090000 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:1.0:1713481296.867398:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd39:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867399:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d9f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.867399:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867400:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ee:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867402:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867403:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd3a:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867403:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867405:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ef:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867407:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.867407:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd3b:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867408:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867409:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f0:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867411:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd3c:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867412:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867413:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f1:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867415:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd3d:0x0], index 1: 0 00010000:00010000:3.0:1713481296.867415:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3be80 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x276b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.867416:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522304 00000100:00100000:0.0:1713481296.867417:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522304 00000004:00080000:1.0:1713481296.867417:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f2:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867419:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd3e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867421:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f3:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867423:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2173 pid: 6932 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867423:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd3f:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867423:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867425:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f4:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867427:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd40:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867429:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f5:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867429:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3be25 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.867431:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820646 00000004:00080000:1.0:1713481296.867431:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd41:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867433:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2173:1957:x1796714882522304:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.867433:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f6:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867436:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd42:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867438:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.867438:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f7:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867440:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2173 pid: 6932 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867440:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd43:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867442:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f8:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867444:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd44:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867445:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2173 pid: 6932 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867447:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3f9:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867449:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd45:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867451:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3fa:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867453:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880079af1200/0xdfc0fb148a3bcd5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49bec expref: 2173 pid: 6932 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867453:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd46:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867454:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3fb:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867456:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd47:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867458:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3fc:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867460:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd48:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867462:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3fd:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867464:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd49:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867465:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880096f1ac00) 00000004:00080000:1.0:1713481296.867466:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3fe:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867468:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd4a:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867469:0:16552:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867470:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa3ff:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867472:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd4b:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867474:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867474:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa400:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867476:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd4c:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867477:0:16552:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867478:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa401:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867480:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd4d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867482:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa402:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867484:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd4e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867485:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa403:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867487:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867488:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd4f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867490:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa404:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867492:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd50:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867493:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bf0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000_UUID:16552:1796714784551936:0@lo:105: 00000004:00080000:1.0:1713481296.867494:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa405:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867496:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd51:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867499:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa406:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867501:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd52:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867502:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa407:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867505:0:16552:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1713481296.867505:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd53:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867507:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa408:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867509:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd54:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867511:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa409:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867513:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd55:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867515:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa40a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867517:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd56:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867519:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa40b:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867520:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941da80 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.867521:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd57:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867524:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa40c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867526:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd58:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867528:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa40d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867530:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd59:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867532:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa40e:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867534:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784551936 00000004:00080000:1.0:1713481296.867534:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd5a:0x0], index 1: 0 00000100:00100000:3.0:1713481296.867534:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+287:3493:x1796714784550720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6812us (6846us total) trans 4296040950 rc 0/0 00000100:00100000:0.0:1713481296.867535:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784551936 00000004:00080000:1.0:1713481296.867536:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa40f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867538:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd5b:0x0], index 1: 0 00000100:00100000:3.0:1713481296.867539:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563517 00000004:00080000:1.0:1713481296.867540:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa410:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867543:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd5c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867545:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa411:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867547:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd5d:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867548:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20402 00000004:00080000:1.0:1713481296.867549:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa412:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867551:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd5e:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867552:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:16552:x1796714784551936:12345-0@lo:105: 00000004:00080000:1.0:1713481296.867554:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa413:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867556:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd5f:0x0], index 1: 0 00000100:00100000:2.0:1713481296.867556:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+286:3493:x1796714784549312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7957us (8043us total) trans 4296040951 rc 0/0 00000004:00080000:1.0:1713481296.867558:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa414:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867559:0:6917:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 5/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867560:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd60:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867562:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa415:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867563:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563508 00000004:00080000:1.0:1713481296.867564:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd61:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867566:0:6917:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 5/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867566:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa416:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867569:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd62:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867571:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa417:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867573:0:6917:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 5/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867573:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd63:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867575:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa418:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867577:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd64:0x0], index 1: 0 00000004:00080000:3.0:1713481296.867577:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007712b480/2, rc 0, transno 1073654 00010000:00010000:0.0:1713481296.867579:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 5/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867579:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa419:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867581:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd65:0x0], index 1: 0 00000100:00100000:3.0:1713481296.867581:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007712b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784550720:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.867583:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa41a:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867585:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 6/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867585:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd66:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867588:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa41b:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867590:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd67:0x0], index 1: 0 00000004:00080000:3.0:1713481296.867591:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092998e00/2, rc 0, transno 1073655 00010000:00010000:0.0:1713481296.867592:0:6917:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 6/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867592:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa41c:0x0], index 0: 0 00000100:00100000:3.0:1713481296.867593:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784549312:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.867594:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd68:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867597:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa41d:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867598:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784552000:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.867599:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd69:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867602:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa41e:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867614:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.867615:0:6917:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012f0ead00) 00000100:00100000:3.0:1713481296.867617:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009299aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784552128:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.867618:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.867624:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.867625:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.867629:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784552064:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.867637:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.867646:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.867651:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.867653:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.867654:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:16552:x1796714784551936:12345-0@lo:105: Request processed in 100us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.867655:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.867659:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20402 00010000:00010000:1.0:1713481296.867682:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.867682:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784552128 00000100:00100000:3.0:1713481296.867682:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784552000 00000100:00100000:3.0:1713481296.867684:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784552000 00010000:00010000:1.0:1713481296.867685:0:15514:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.867685:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784552128 00010000:00010000:1.0:1713481296.867689:0:15514:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.867694:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784552064 00000100:00100000:1.0:1713481296.867696:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078078000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784552192:0@lo:101:mdt_io00_009.0 00000100:00100000:3.0:1713481296.867696:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784552064 00000100:00100000:0.0:1713481296.867699:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bf0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000_UUID:16552:1796714784551936:0@lo:105: 00000100:00100000:2.0:1713481296.867699:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563531 00000100:00100000:2.0:1713481296.867702:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+288:3490:x1796714784552000:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.867708:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563532 00002000:00080000:2.0:1713481296.867711:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10093 count 1 00000100:00100000:3.0:1713481296.867713:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+288:3492:x1796714784552128:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.867714:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.867714:0:15514:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.867719:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.867722:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10095 count 1 00000100:00100000:0.0:1713481296.867723:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2172:1957:x1796714882522304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 289us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.867723:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59480 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.867727:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c1b600/0xdfc0fb148802bc6 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631bf expref: 20706 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.867728:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820646 00010000:00010000:2.0:1713481296.867730:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.867731:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.867731:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.867733:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784552192 00010000:00010000:2.0:1713481296.867733:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.867735:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784552192 00010000:00010000:3.0:1713481296.867738:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c583a80/0xdfc0fb148802bd4 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631db expref: 20706 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.867743:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.867744:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085c1b600/0xdfc0fb148802bc6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631bf expref: 20706 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.867744:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.867746:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.867747:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82960 00010000:00010000:2.0:1713481296.867749:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085c1b600/0xdfc0fb148802bc6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631bf expref: 20706 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.867750:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:15514:x1796714784552192:12345-0@lo:101:mdt_io00_009.0 00010000:00010000:1.0:1713481296.867756:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.867756:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784552256:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.867756:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c583a80/0xdfc0fb148802bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631db expref: 20706 pid: 16497 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.867762:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.867762:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3bf83 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.867762:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c583a80/0xdfc0fb148802bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631db expref: 20706 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.867767:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b1d300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.867769:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784552320:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.867771:0:15506:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095c9d200/0xdfc0fb148a385df lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cff expref: 2171 pid: 6932 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.867774:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522368 00000100:00100000:0.0:1713481296.867776:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522368 00010000:00010000:1.0:1713481296.867776:0:15506:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 4/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 15 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.867781:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.867785:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98388 00000100:00100000:2.0:1713481296.867785:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563533 00010000:00010000:1.0:1713481296.867787:0:15506:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095c9d200/0xdfc0fb148a385df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cff expref: 2172 pid: 6932 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.867789:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2172:1957:x1796714882522368:12345-192.168.202.24@tcp:103:mrename.0 00000100:00100000:2.0:1713481296.867789:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+288:3490:x1796714784552064:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.867792:0:15506:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095c9d200/0xdfc0fb148a385df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cff expref: 2172 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.867793:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:2.0:1713481296.867796:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10094 count 1 00000100:00100000:1.0:1713481296.867798:0:15506:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078079880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784552384:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.867800:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800970a4240/0xdfc0fb148a3bb69 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49b2f expref: 2172 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.867803:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.867809:0:15506:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800929adcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.867810:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800869a4000/0xdfc0fb148802bcd lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631cd expref: 20706 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.867812:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d7:0x0].0x0 (ffff880097b2b700) 00010000:00010000:2.0:1713481296.867814:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.867815:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.867816:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 4/0,1 mode: --/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867820:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd6a:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867822:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.867825:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800869a4000/0xdfc0fb148802bcd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631cd expref: 20706 pid: 9202 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713481296.867826:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa41f:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867828:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd6b:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867829:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:1957:x1796714882522368:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 40us (67us total) trans 0 rc 0/0 00000004:00080000:1.0:1713481296.867830:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa420:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867830:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800869a4000/0xdfc0fb148802bcd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631cd expref: 20706 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.867832:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98388 00000004:00080000:1.0:1713481296.867832:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd6c:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867834:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa421:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867835:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784552448:192.168.202.24@tcp:104: 00000004:00080000:1.0:1713481296.867837:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd6d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867838:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa422:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867841:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd6e:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867843:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa423:0x0], index 0: 0 00000100:00100000:2.0:1713481296.867844:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b1df00 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.867845:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd6f:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867847:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa424:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867849:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd70:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867851:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.867851:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa425:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867853:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd71:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867855:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa426:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867856:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867857:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd72:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867859:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520704 00000004:00080000:1.0:1713481296.867859:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa427:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867860:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.867861:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520704 00000004:00080000:1.0:1713481296.867861:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd73:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867863:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa428:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867865:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd74:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867865:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.867866:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120906640/0xdfc0fb1489d012a lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22480 expref: 24482 pid: 16460 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867867:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa429:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867868:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867869:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd75:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867871:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa42a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867873:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd76:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867873:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867875:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa42b:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867876:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aab0fc0 already unused, calling callback (ffffffffa084eb20) 00000004:00080000:1.0:1713481296.867877:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd77:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867878:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820647 00010000:00010000:2.0:1713481296.867878:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.867880:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882520704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1713481296.867880:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa42c:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867881:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867882:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd78:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867884:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713481296.867884:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa42d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867885:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd79:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867886:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120906640/0xdfc0fb1489d012a lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22480 expref: 24482 pid: 16460 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867887:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa42e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867890:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd7a:0x0], index 1: 0 00010000:00010000:2.0:1713481296.867890:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.867891:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120906640/0xdfc0fb1489d012a lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22480 expref: 24482 pid: 16460 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867892:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa42f:0x0], index 0: 0 00010000:00010000:2.0:1713481296.867893:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007aab0fc0/0xdfc0fb148a3be09 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867894:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd7b:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867896:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa430:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867899:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd7c:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867900:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120906640/0xdfc0fb1489d012a lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22480 expref: 24482 pid: 16460 timeout: 815 lvb_type: 0 00000004:00080000:1.0:1713481296.867901:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa431:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867903:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd7d:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867905:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa432:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867907:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd7e:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867909:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.867909:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713481296.867909:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa433:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867911:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd7f:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867912:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3bd92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c2b expref: 26794 pid: 10554 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867913:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa434:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867915:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd80:0x0], index 1: 0 00010000:00010000:0.0:1713481296.867917:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3bd92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c2b expref: 26794 pid: 10554 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867917:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa435:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867919:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd81:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867921:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa436:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867923:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd82:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867925:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa437:0x0], index 0: 0 00010000:00010000:0.0:1713481296.867926:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009708fcc0/0xdfc0fb148a3bd92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c2b expref: 26794 pid: 10554 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.867927:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd83:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867929:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa438:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867931:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd84:0x0], index 1: 0 00000100:00100000:0.0:1713481296.867932:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784552512:192.168.202.24@tcp:105: 00000004:00080000:1.0:1713481296.867933:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa439:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867935:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd85:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867938:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa43a:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867940:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd86:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867942:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa43b:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867943:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007941da80 going to sleep for 11 seconds 00000004:00080000:1.0:1713481296.867944:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd87:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867947:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa43c:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867949:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd88:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867951:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa43d:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867954:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd89:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867956:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa43e:0x0], index 0: 0 00000004:00080000:1.0:1713481296.867958:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd8a:0x0], index 1: 0 00000004:00080000:1.0:1713481296.867960:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000408:0xa43f:0x0], index 0: 0 00000100:00100000:0.0:1713481296.867973:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.867981:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520832 00000100:00100000:0.0:1713481296.867982:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520832 00010000:00010000:0.0:1713481296.867989:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b9c0d80/0xdfc0fb148942195 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e9 expref: 20707 pid: 15559 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.867999:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820648 00000100:00100000:0.0:1713481296.868001:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20707:1960:x1796714882520832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.868003:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2875:3491:x1796714784549056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8897us (8941us total) trans 4295960818 rc 0/0 00010000:00010000:0.0:1713481296.868005:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.868007:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b9c0d80/0xdfc0fb148942195 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6978:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e9 expref: 20707 pid: 15559 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.868007:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563504 00010000:00010000:0.0:1713481296.868013:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b9c0d80/0xdfc0fb148942195 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6978:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e9 expref: 20707 pid: 15559 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.868013:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081691c00/2, rc 0, transno 993522 00000100:00100000:3.0:1713481296.868020:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784549056:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.868023:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b9c0d80/0xdfc0fb148942195 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6978:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03e9 expref: 20707 pid: 15559 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868032:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868033:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868035:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bdf4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c5c expref: 16935 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868040:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bdf4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c5c expref: 16935 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.868049:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784552576:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.868054:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800914c46c0/0xdfc0fb148a3bdf4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6978:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c5c expref: 16935 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868060:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bf3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784552640:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.868066:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.868070:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099faf300 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.868080:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784552576 00000100:00100000:2.0:1713481296.868082:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784552576 00000100:00100000:0.0:1713481296.868087:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.868095:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563534 00000100:00100000:2.0:1713481296.868098:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2875:3493:x1796714784552576:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.868099:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00080000:2.0:1713481296.868105:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43559 count 1 00000100:00100000:0.0:1713481296.868106:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.868112:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868133:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882520960 00000100:00100000:0.0:1713481296.868135:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882520960 00010000:00010000:2.0:1713481296.868137:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9440/0xdfc0fb14868985a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d326b expref: 26794 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.868141:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.868142:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868143:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800868b0000/0xdfc0fb148802b87 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963141 expref: 20707 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.868143:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868153:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521152 00010000:00010000:2.0:1713481296.868153:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e9440/0xdfc0fb14868985a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d326b expref: 26794 pid: 16485 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.868154:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521152 00010000:00010000:2.0:1713481296.868158:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e9440/0xdfc0fb14868985a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d326b expref: 26795 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868161:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350b9d40/0xdfc0fb148689551 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31d1 expref: 26795 pid: 16491 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.868164:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784552704:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.868168:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521280 00000100:00100000:0.0:1713481296.868169:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521280 00010000:00010000:0.0:1713481296.868174:0:15529:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084321f80/0xdfc0fb14895a161 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecc5 expref: 16936 pid: 16461 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.868175:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091b6b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.868181:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820649 00000100:00100000:0.0:1713481296.868184:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20707:1960:x1796714882520960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.868188:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820650 00010000:00010000:0.0:1713481296.868190:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.868191:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26795:1960:x1796714882521152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.868192:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800868b0000/0xdfc0fb148802b87 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2764:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963141 expref: 20707 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.868196:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.868197:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800868b0000/0xdfc0fb148802b87 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2764:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963141 expref: 20707 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.868199:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350b9d40/0xdfc0fb148689551 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31d1 expref: 26795 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.868205:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350b9d40/0xdfc0fb148689551 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31d1 expref: 26795 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868207:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800868b0000/0xdfc0fb148802b87 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2764:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963141 expref: 20707 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868214:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868215:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868217:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868221:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.868221:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350b9d40/0xdfc0fb148689551 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31d1 expref: 26795 pid: 16491 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.868230:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.868231:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.868233:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868235:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.868237:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868243:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20706:1960:x1796714882520960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.868247:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820649 00010000:00010000:2.0:1713481296.868251:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.868259:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26794:1960:x1796714882521152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.868260:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820651 00000100:00100000:0.0:1713481296.868262:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880082020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16936:1960:x1796714882521280:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.868262:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820650 00010000:00010000:0.0:1713481296.868266:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.868274:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084321f80/0xdfc0fb14895a161 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecc5 expref: 16936 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868279:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084321f80/0xdfc0fb14895a161 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecc5 expref: 16936 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868288:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084321f80/0xdfc0fb14895a161 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecc5 expref: 16936 pid: 16461 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868296:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868297:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868299:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c777180/0xdfc0fb148a3bde6 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c55 expref: 16935 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868304:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c777180/0xdfc0fb148a3bde6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c55 expref: 16935 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868312:0:15529:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c777180/0xdfc0fb148a3bde6 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c55 expref: 16935 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868317:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082021180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784552768:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.868327:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096dbd000 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.868340:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868342:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868346:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868347:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868351:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868354:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868355:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868359:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868359:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868363:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868363:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097da2f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.868364:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868366:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af1f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.868368:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868368:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868371:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868376:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868379:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868380:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097da2f40/0xdfc0fb148a3bddf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868383:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880079af1f80/0xdfc0fb148a3bdd8 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868486:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+289:3490:x1796714784548416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10271us (10309us total) trans 4296040952 rc 0/0 00000100:00100000:0.0:1713481296.868490:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563497 00000004:00080000:2.0:1713481296.868493:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076a4b480/2, rc 0, transno 1073656 00000100:00100000:2.0:1713481296.868498:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784548416:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.868502:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2876:3490:x1796714784548480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10245us (10285us total) trans 4295960819 rc 0/0 00000004:00080000:2.0:1713481296.868507:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088367480/2, rc 0, transno 993523 00000100:00100000:3.0:1713481296.868507:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563498 00000100:00100000:2.0:1713481296.868511:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880088367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784548480:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.868532:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.868543:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.868544:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521408 00000100:00100000:0.0:1713481296.868546:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521408 00000100:00100000:3.0:1713481296.868550:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784552896:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.868554:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bd70480/0xdfc0fb1486893fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31ed expref: 26794 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.868564:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820652 00000100:00100000:3.0:1713481296.868564:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.868567:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4019850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26794:1960:x1796714882521408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.868571:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.868573:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bd70480/0xdfc0fb1486893fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31ed expref: 26794 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.868577:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784552832:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.868578:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bd70480/0xdfc0fb1486893fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31ed expref: 26794 pid: 16462 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.868582:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784552896 00000100:00100000:2.0:1713481296.868584:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784552896 00010000:00010000:1.0:1713481296.868586:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cb600/0xdfc0fb148a3bfad lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:3.0:1713481296.868587:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.868591:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cb600/0xdfc0fb148a3bfad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.868592:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bd70480/0xdfc0fb1486893fa lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d31ed expref: 26794 pid: 16462 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.868595:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cb600/0xdfc0fb148a3bfad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.868597:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784552832 00000100:00100000:2.0:1713481296.868598:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784552832 00010000:00010000:0.0:1713481296.868601:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868602:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868604:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.868606:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563535 00010000:00010000:0.0:1713481296.868608:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.868608:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2876:3491:x1796714784552896:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.868613:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00002000:00080000:2.0:1713481296.868616:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43561 count 1 00010000:00010000:1.0:1713481296.868617:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.868619:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.868622:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.868625:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011f9cfcc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.868625:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868627:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.868630:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.868630:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868631:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.868632:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e98c0/0xdfc0fb148689861 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3279 expref: 26793 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.868635:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cba:0x0].0x0 (ffff88009c144600) 00010000:00010000:1.0:1713481296.868636:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.868636:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.868636:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.868637:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.868638:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.868638:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868640:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4019850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26793:1960:x1796714882521408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (107us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.868640:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868641:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cfcc0/0xdfc0fb148a3be9c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.868644:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868646:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820652 00010000:00010000:2.0:1713481296.868648:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e98c0/0xdfc0fb148689861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3279 expref: 26793 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.868648:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868651:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa15680 already unused, calling callback (ffffffffa084eb20) 00000004:00010000:1.0:1713481296.868652:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880072ab5500 reply state ffff88011ec70000 transno 4295107628 ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cc240/0xdfc0fb148a3bea3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cba:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.868652:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e98c0/0xdfc0fb148689861 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3279 expref: 26793 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.868652:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868656:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cc240/0xdfc0fb148a3bea3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cba:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.868657:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.868658:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784552960:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.868659:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cba:0x0].0x35 (ffff880098c57400) 00010000:00010000:1.0:1713481296.868661:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.868677:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713481296.868680:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868682:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563536 00000100:00100000:2.0:1713481296.868684:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800978619c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.868684:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3be02 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868685:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+289:3491:x1796714784552832:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.868694:0:15562:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10096 count 1 00010000:00010000:0.0:1713481296.868702:0:15562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868706:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cc900/0xdfc0fb148a3be95 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cba:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c8d expref: 2060 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868708:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cded00/0xdfc0fb148802bdb lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631e9 expref: 20705 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.868712:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868713:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868715:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868717:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801207cb600/0xdfc0fb148a3bfad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c8d expref: 2059 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868721:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbf:0x0].0x0 (ffff88009a8c3700) 00010000:00010000:1.0:1713481296.868723:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713481296.868724:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cded00/0xdfc0fb148802bdb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631e9 expref: 20705 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.868724:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207cb600, rc 0) 00010000:00010000:0.0:1713481296.868729:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cded00/0xdfc0fb148802bdb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631e9 expref: 20705 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.868735:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880082020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784553024:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.868738:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2060:18811:x1796714882520320:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 7409us (7449us total) trans 4295107628 rc 0/0 00000100:00100000:1.0:1713481296.868742:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485916 00000100:00100000:0.0:1713481296.868745:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.868794:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.868794:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2877:3492:x1796714784548928:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9816us (9892us total) trans 4295960820 rc 0/0 00000100:00100000:3.0:1713481296.868799:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563502 00000004:00080000:2.0:1713481296.868807:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081692d80/2, rc 0, transno 993524 00000100:00100000:2.0:1713481296.868814:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784548928:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.868815:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521536 00000100:00100000:0.0:1713481296.868818:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521536 00000100:00100000:1.0:1713481296.868824:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.868830:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c582d00/0xdfc0fb148802b95 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96315d expref: 20706 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.868844:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521664 00000100:00100000:0.0:1713481296.868846:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521664 00000100:00100000:1.0:1713481296.868847:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.868852:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800831158c0/0xdfc0fb148802b9c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96316b expref: 20707 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.868858:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784553088:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.868860:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521792 00000100:00100000:0.0:1713481296.868861:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521792 00000100:00100000:1.0:1713481296.868864:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.868866:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801216fcb40/0xdfc0fb14868940f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3217 expref: 26793 pid: 15509 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.868874:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882521920 00000100:00100000:0.0:1713481296.868876:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882521920 00010000:00010000:0.0:1713481296.868880:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097647a80/0xdfc0fb14893abc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f8 expref: 26794 pid: 16458 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.868883:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.868883:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.868899:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522112 00000100:00100000:0.0:1713481296.868900:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522112 00000100:00100000:3.0:1713481296.868901:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784553088 00000100:00100000:3.0:1713481296.868904:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784553088 00010000:00010000:0.0:1713481296.868906:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e9f80/0xdfc0fb148689829 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3233 expref: 26795 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.868909:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820653 00000100:00100000:1.0:1713481296.868913:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013609dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20707:1960:x1796714882521536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.868919:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.868920:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820654 00000100:00100000:3.0:1713481296.868922:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563537 00000100:00100000:0.0:1713481296.868923:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20707:1960:x1796714882521664:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.868923:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c582d00/0xdfc0fb148802b95 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96315d expref: 20707 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.868927:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2877:3492:x1796714784553088:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.868928:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.868929:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c582d00/0xdfc0fb148802b95 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96315d expref: 20707 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.868929:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820655 00010000:00010000:0.0:1713481296.868930:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800831158c0/0xdfc0fb148802b9c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96316b expref: 20707 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.868935:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007807b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26795:1960:x1796714882521792:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.868939:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800831158c0/0xdfc0fb148802b9c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96316b expref: 20707 pid: 9202 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.868939:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43563 count 1 00010000:00010000:1.0:1713481296.868940:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c582d00/0xdfc0fb148802b95 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96315d expref: 20707 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.868942:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.868947:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801216fcb40/0xdfc0fb14868940f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3217 expref: 26795 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.868950:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868951:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.868952:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800831158c0/0xdfc0fb148802b9c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96316b expref: 20706 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.868952:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.868954:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.868956:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801216fcb40/0xdfc0fb14868940f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3217 expref: 26795 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.868959:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.868959:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868960:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.868961:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133df18c0/0xdfc0fb14868986f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3287 expref: 26795 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.868962:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.868968:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868968:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.868970:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.868971:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801216fcb40/0xdfc0fb14868940f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3217 expref: 26795 pid: 15509 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.868973:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.868976:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.868985:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.868985:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013609dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20705:1960:x1796714882521536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (192us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.868986:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.868987:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.868989:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820653 00010000:00010000:2.0:1713481296.868990:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.868992:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133df18c0/0xdfc0fb14868986f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3287 expref: 26794 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.868997:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.868999:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20704:1960:x1796714882521664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.869001:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820656 00010000:00010000:3.0:1713481296.869001:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133df18c0/0xdfc0fb14868986f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3287 expref: 26794 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.869004:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26794:1960:x1796714882521920:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.869005:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820654 00010000:00010000:1.0:1713481296.869008:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.869010:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784553152:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.869011:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097647a80/0xdfc0fb14893abc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f8 expref: 26794 pid: 16458 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.869013:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.869017:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097647a80/0xdfc0fb14893abc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f8 expref: 26794 pid: 16458 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.869025:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820657 00000100:00100000:2.0:1713481296.869026:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007807b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26794:1960:x1796714882521792:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.869028:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097647a80/0xdfc0fb14893abc2 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4f8 expref: 26794 pid: 16458 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.869030:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26794:1960:x1796714882522112:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.869030:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ab15840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.869031:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820655 00010000:00010000:0.0:1713481296.869037:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.869037:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.869038:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.869040:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3be4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c6a expref: 24481 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869041:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e9f80/0xdfc0fb148689829 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3233 expref: 26792 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.869043:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869045:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3be4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c6a expref: 24481 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869048:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869048:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869049:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e9f80/0xdfc0fb148689829 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3233 expref: 26792 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.869053:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869053:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869056:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880079af21c0/0xdfc0fb148a3be4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c6a expref: 24481 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869056:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869057:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869060:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.869061:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120246a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784553216:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.869062:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869063:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b091f80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.869064:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9f80/0xdfc0fb148689829 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3233 expref: 26792 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.869065:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869066:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869069:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b091680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.869069:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869071:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.869072:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665900 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.869073:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.869074:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.869075:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869076:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869078:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869082:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869082:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3be1e lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869084:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869084:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869087:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3be33 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869089:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869093:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869097:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869098:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.869101:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869104:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c775440 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.869106:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.869108:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:1960:x1796714882522112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 78us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.869109:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.869112:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820657 00010000:00010000:1.0:1713481296.869116:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869136:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c775440/0xdfc0fb148a3be10 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.869159:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.869168:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882522240 00000100:00100000:0.0:1713481296.869170:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882522240 00010000:00010000:0.0:1713481296.869177:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083114480/0xdfc0fb148802bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963195 expref: 20704 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.869186:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820658 00000100:00100000:0.0:1713481296.869188:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013609c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20704:1960:x1796714882522240:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.869192:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.869194:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083114480/0xdfc0fb148802bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963195 expref: 20704 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.869203:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083114480/0xdfc0fb148802bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963195 expref: 20704 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.869215:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083114480/0xdfc0fb148802bb1 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x276a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963195 expref: 20704 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.869223:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.869224:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.869226:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.869229:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+291:3491:x1796714784549440:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9675us (9768us total) trans 4296040953 rc 0/0 00010000:00010000:0.0:1713481296.869230:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.869230:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2878:3492:x1796714784549696:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9598us (9658us total) trans 4295960821 rc 0/0 00000100:00100000:3.0:1713481296.869233:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563507 00000100:00100000:2.0:1713481296.869237:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563510 00010000:00010000:0.0:1713481296.869240:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.869247:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013609c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20703:1960:x1796714882522240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.869251:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820658 00000100:00100000:1.0:1713481296.869255:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+290:3493:x1796714784549376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9823us (9878us total) trans 4296040954 rc 0/0 00000004:00080000:3.0:1713481296.869259:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092999180/2, rc 0, transno 1073657 00000100:00100000:1.0:1713481296.869260:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563505 00000100:00100000:3.0:1713481296.869264:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784549440:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.869265:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.869269:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bd8b800/2, rc 0, transno 993525 00010000:00010000:0.0:1713481296.869270:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.869273:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784549696:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.869274:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869281:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869285:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869288:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d20ed00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.869289:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.869290:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713481296.869293:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.869294:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784553280:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.869297:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784553344:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.869300:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869303:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d20ed00/0xdfc0fb148a3be87 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x276a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.869311:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.869314:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869319:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869323:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869327:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869330:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869333:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fe04240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.869335:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.869337:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784553280 00010000:00010000:2.0:1713481296.869338:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.869338:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784553280 00010000:00010000:2.0:1713481296.869350:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.869350:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563538 00000100:00100000:3.0:1713481296.869353:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+291:3492:x1796714784553280:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.869354:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3be6b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.869361:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10097 count 1 00010000:00010000:3.0:1713481296.869370:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869378:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c18fc0/0xdfc0fb148802be2 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631f7 expref: 20702 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.869382:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.869383:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.869385:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869396:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085c18fc0/0xdfc0fb148802be2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631f7 expref: 20702 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.869401:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085c18fc0/0xdfc0fb148802be2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631f7 expref: 20702 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.869405:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+291:3493:x1796714784550656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8636us (8673us total) trans 4296040955 rc 0/0 00000100:00100000:3.0:1713481296.869407:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784553408:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.869410:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563518 00000100:00100000:3.0:1713481296.869418:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124304f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.869457:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.869466:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+2878:3490:x1796714784550464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9381us (9422us total) trans 4295960822 rc 0/0 00000100:00100000:0.0:1713481296.869467:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523136 00000100:00100000:0.0:1713481296.869469:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523136 00000100:00100000:2.0:1713481296.869470:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563514 00010000:00010000:0.0:1713481296.869477:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800908c3180/0xdfc0fb148a13f2d lrc: 5/0,0 mode: PR/PR res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3802d expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.869487:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820659 00000100:00100000:0.0:1713481296.869489:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1959:x1796714882523136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.869493:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.869497:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784550976:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.869500:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800908c3180/0xdfc0fb148a13f2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3802d expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.869506:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800908c3180/0xdfc0fb148a13f2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3802d expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.869519:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800908c3180/0xdfc0fb148a13f2d lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3802d expref: 24482 pid: 16512 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.869519:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120077800/2, rc 0, transno 1073659 00010000:00010000:2.0:1713481296.869522:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880120bae880/0xdfc0fb148a3bebf lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ca2 expref: 24482 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869527:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.869528:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.869530:0:15510:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880120bae880/0xdfc0fb148a3bebf lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ca2 expref: 24481 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.869534:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784550656:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.869536:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880120bae880/0xdfc0fb148a3bebf lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ca2 expref: 24481 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869543:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.869544:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299b800/2, rc 0, transno 1073658 00000100:00100000:1.0:1713481296.869546:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784549376:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.869550:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1959:x1796714882523136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 60us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.869552:0:15510:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880120bae880/0xdfc0fb148a3bebf lrc: 4/0,0 mode: PW/PW res: [0x2c0000408:0x2e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ca2 expref: 24481 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.869554:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820659 00000100:00100000:2.0:1713481296.869561:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f935880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784553536:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.869572:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713481296.869574:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784553472:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.869575:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012cf53840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.869580:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784553600:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.869591:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.869615:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.869637:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713481296.869640:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d37b80/2, rc 0, transno 993526 00000100:00100000:2.0:1713481296.869649:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784550464:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.869652:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784553344 00000100:00100000:1.0:1713481296.869655:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784553344 00000100:00100000:0.0:1713481296.869659:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.869688:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784553600 00000100:00100000:3.0:1713481296.869691:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784553600 00000100:00100000:0.0:1713481296.869697:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.869705:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784553472 00000100:00100000:3.0:1713481296.869707:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784553472 00000100:00100000:3.0:1713481296.869714:0:16502:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523200 00000100:00100000:0.0:1713481296.869715:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523392 00000100:00100000:3.0:1713481296.869716:0:16502:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523200 00000100:00100000:0.0:1713481296.869718:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523392 00000100:00100000:1.0:1713481296.869720:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563539 00000100:00100000:1.0:1713481296.869726:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+292:3493:x1796714784553600:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.869731:0:16502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563540 00000100:00100000:3.0:1713481296.869735:0:16502:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2878:3490:x1796714784553344:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.869737:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125706 00002000:00080000:1.0:1713481296.869740:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10099 count 1 00000100:00100000:2.0:1713481296.869740:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563541 00000100:00100000:0.0:1713481296.869742:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2060:18678:x1796714882523392:12345-192.168.202.24@tcp:35:rm.0 00002000:00080000:3.0:1713481296.869743:0:16502:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43565 count 1 00000100:00100000:2.0:1713481296.869745:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+292:3491:x1796714784553472:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.869751:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869751:0:16502:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.869754:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10098 count 1 00010000:00010000:1.0:1713481296.869759:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c802640/0xdfc0fb148802bf0 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963213 expref: 20702 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.869762:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869762:0:16502:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800733d9f80/0xdfc0fb148689876 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3295 expref: 26790 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.869763:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.869764:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.869765:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869767:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.869768:0:16502:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.869769:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800836f4240/0xdfc0fb148802be9 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963205 expref: 20702 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.869769:0:16502:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.869773:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.869774:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.869776:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.869780:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c802640/0xdfc0fb148802bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963213 expref: 20702 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.869780:0:16502:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800733d9f80/0xdfc0fb148689876 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3295 expref: 26790 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.869785:0:16502:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800733d9f80/0xdfc0fb148689876 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3295 expref: 26790 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.869786:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800836f4240/0xdfc0fb148802be9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963205 expref: 20702 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.869792:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800836f4240/0xdfc0fb148802be9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963205 expref: 20702 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.869792:0:16502:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784553792:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.869793:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c802640/0xdfc0fb148802bf0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963213 expref: 20702 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.869798:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077a82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784553856:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.869802:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784553728:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.869804:0:16502:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.869810:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009713f300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.869817:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563542 00000100:00100000:1.0:1713481296.869818:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665240 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.869820:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013609e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16936:17935:x1796714882523200:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.869825:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2061:18678:x1796714882523392:12345-192.168.202.24@tcp:35:rm.0 Request processed in 81us (125us total) trans 4295107629 rc 0/0 00010000:00010000:3.0:1713481296.869825:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.869832:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125706 00000100:00100000:1.0:1713481296.869833:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784553664:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.869834:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121cd8480/0xdfc0fb148a3bfec lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ce8 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.869844:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.869848:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.869851:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.869852:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.869855:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121cd8480/0xdfc0fb148a3bfec lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ce8 expref: 16937 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.869861:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121cd8480/0xdfc0fb148a3bfec lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ce8 expref: 16937 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.869866:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784553664 00010000:00010000:3.0:1713481296.869867:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121cd8480, rc 0) 00000100:00100000:0.0:1713481296.869868:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784553664 00000100:00100000:3.0:1713481296.869877:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013609e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16937:17935:x1796714882523200:12345-192.168.202.24@tcp:101:dd.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.869880:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563543 00000100:00100000:0.0:1713481296.869885:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2879:3493:x1796714784553664:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.869885:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563542 00002000:00080000:0.0:1713481296.869894:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43567 count 1 00010000:00010000:0.0:1713481296.869905:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869915:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a5d440/0xdfc0fb14868987d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32a3 expref: 26790 pid: 16490 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.869921:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.869923:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.869925:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.869941:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a5d440/0xdfc0fb14868987d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32a3 expref: 26790 pid: 16490 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.869950:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a5d440/0xdfc0fb14868987d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32a3 expref: 26790 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.869959:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013609ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784553920:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.869976:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c43bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.870005:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.870016:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523264 00000100:00100000:2.0:1713481296.870019:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523264 00000100:00100000:2.0:1713481296.870032:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98389 00000100:00100000:2.0:1713481296.870035:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013609d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:1957:x1796714882523264:12345-192.168.202.24@tcp:103:rm.0 00000100:00100000:0.0:1713481296.870037:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784551104:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.870039:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.870047:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133b98d80/0xdfc0fb148a3a7f1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49532 expref: 2171 pid: 15484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.870060:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f84d80/0xdfc0fb148a3bed4 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cb7 expref: 16936 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.870060:0:15497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88009c4f1100) 00010000:00010000:0.0:1713481296.870070:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f84d80, rc 0) 00000100:00100000:1.0:1713481296.870072:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.870073:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.870085:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16936:8499:x1796714882522624:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5187us (5211us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.870086:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013609d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2170:1957:x1796714882523264:12345-192.168.202.24@tcp:103:rm.0 Request processed in 50us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.870090:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98389 00000100:00100000:0.0:1713481296.870091:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563524 00000100:00100000:1.0:1713481296.870108:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.870112:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523456 00000100:00100000:0.0:1713481296.870115:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523456 00000100:00100000:2.0:1713481296.870132:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523520 00000100:00100000:2.0:1713481296.870134:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523520 00000100:00100000:0.0:1713481296.870147:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563544 00000100:00100000:0.0:1713481296.870151:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16936:18844:x1796714882523456:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.870152:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563545 00000100:00100000:2.0:1713481296.870155:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:15045:x1796714882523520:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.870157:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.870160:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.870161:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.870165:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013464f840/0xdfc0fb148a3bffa lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cef expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.870167:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314af3c0/0xdfc0fb148a3c001 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cf6 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.870177:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1713481296.870177:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.870181:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.870184:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.870185:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.870185:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.870186:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.870187:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314af3c0/0xdfc0fb148a3c001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cf6 expref: 24482 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.870190:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013464f840/0xdfc0fb148a3bffa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cef expref: 16937 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.870193:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801314af3c0/0xdfc0fb148a3c001 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cf6 expref: 24482 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.870196:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013464f840/0xdfc0fb148a3bffa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cef expref: 16937 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.870198:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314af3c0, rc 0) 00000100:00100000:3.0:1713481296.870199:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523712 00010000:00010000:0.0:1713481296.870201:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013464f840, rc 0) 00000100:00100000:3.0:1713481296.870202:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523712 00000100:00100000:2.0:1713481296.870207:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:15045:x1796714882523520:12345-192.168.202.24@tcp:101:dd.0 Request processed in 51us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.870211:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563545 00000100:00100000:0.0:1713481296.870213:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16937:18844:x1796714882523456:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.870217:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563544 00000100:00100000:2.0:1713481296.870222:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563546 00000100:00100000:2.0:1713481296.870226:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20703:18792:x1796714882523712:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.870230:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.870231:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.870236:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e5d200/0xdfc0fb148a3c008 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc52a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49cfd expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.870242:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092b99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784551232:192.168.202.24@tcp:104: 00002000:00010000:2.0:1713481296.870244:0:16497:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc52a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.870249:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.870250:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.870252:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e5d200/0xdfc0fb148a3c008 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cfd expref: 20704 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.870257:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3befe lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cbe expref: 20704 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.870257:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e5d200/0xdfc0fb148a3c008 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cfd expref: 20704 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.870261:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e5d200, rc 0) 00010000:00010000:0.0:1713481296.870264:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134fa5d40, rc 0) 00000100:00100000:2.0:1713481296.870269:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20704:18792:x1796714882523712:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 44us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.870272:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20704:17924:x1796714882522688:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5235us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.870273:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563546 00000100:00100000:0.0:1713481296.870276:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563525 00000100:00100000:2.0:1713481296.870294:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523584 00000100:00100000:2.0:1713481296.870296:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523584 00010000:00010000:2.0:1713481296.870302:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124a446c0/0xdfc0fb1488e7ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5541 expref: 16937 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.870311:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523648 00000100:00100000:2.0:1713481296.870312:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523648 00010000:00010000:2.0:1713481296.870317:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350abcc0/0xdfc0fb148a15fef lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39860 expref: 20703 pid: 16517 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.870319:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820660 00000100:00100000:0.0:1713481296.870322:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007841f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16937:1959:x1796714882523584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.870327:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.870328:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820661 00000100:00100000:1.0:1713481296.870329:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.870330:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124a446c0/0xdfc0fb1488e7ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5541 expref: 16937 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.870331:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20703:1959:x1796714882523648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.870335:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124a446c0/0xdfc0fb1488e7ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8ea0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5541 expref: 16937 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.870335:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.870337:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350abcc0/0xdfc0fb148a15fef lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39860 expref: 20703 pid: 16517 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.870341:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523776 00000100:00100000:1.0:1713481296.870343:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523776 00010000:00010000:2.0:1713481296.870343:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350abcc0/0xdfc0fb148a15fef lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39860 expref: 20703 pid: 16517 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.870347:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124a446c0/0xdfc0fb1488e7ec3 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8ea0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5541 expref: 16937 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.870354:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350abcc0/0xdfc0fb148a15fef lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39860 expref: 20703 pid: 16517 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.870356:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.870357:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.870360:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f84d80/0xdfc0fb148a3bed4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cb7 expref: 16936 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.870360:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485922 00010000:00010000:2.0:1713481296.870361:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.870362:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.870363:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2170:18578:x1796714882523776:12345-192.168.202.24@tcp:101:rm.0 00010000:00010000:2.0:1713481296.870364:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3befe lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cbe expref: 20702 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.870365:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f84d80/0xdfc0fb148a3bed4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cb7 expref: 16936 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.870369:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.870369:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3befe lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cbe expref: 20702 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.870375:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092f84d80/0xdfc0fb148a3bed4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8ea0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cb7 expref: 16936 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.870375:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c00f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d04 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.870379:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134fa5d40/0xdfc0fb148a3befe lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cbe expref: 20702 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.870381:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013609d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784553984:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.870385:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880077a80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784554048:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.870391:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.870397:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135684f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.870418:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870424:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870428:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870435:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870439:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870442:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870475:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d4480/0xdfc0fb148a3c024 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870479:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d4480/0xdfc0fb148a3c024 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870483:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d4480/0xdfc0fb148a3c024 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000004:00200000:1.0:1713481296.870497:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x37cc:0x0]: returning size 5 00000004:00200000:1.0:1713481296.870499:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713481296.870505:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d4480/0xdfc0fb148a3c024 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870510:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d4480/0xdfc0fb148a3c024 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870514:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870517:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870522:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870525:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870528:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e0eb840 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.870529:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870532:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870537:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x0 (ffff8800919f3500) 00010000:00010000:1.0:1713481296.870538:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.870540:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870543:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c016 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870550:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870553:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870556:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870558:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009b272ac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.870560:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870565:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870569:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x3931 (ffff88011e210900) 00010000:00010000:1.0:1713481296.870570:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.870571:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870574:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c01d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.870598:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c00f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d04 expref: 2172 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.870606:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d4480/0xdfc0fb148a3c024 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d04 expref: 2171 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.870609:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37cc:0x0].0x0 (ffff8801224d2c00) 00010000:00010000:1.0:1713481296.870610:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713481296.870612:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2d4480, rc 0) 00000100:00100000:1.0:1713481296.870623:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:18578:x1796714882523776:12345-192.168.202.24@tcp:101:rm.0 Request processed in 260us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.870627:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485922 00000100:00100000:0.0:1713481296.871241:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.871254:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523840 00000100:00100000:0.0:1713481296.871257:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523840 00000100:00100000:0.0:1713481296.871268:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563547 00000100:00100000:0.0:1713481296.871271:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013609f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16937:17009:x1796714882523840:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.871276:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.871283:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3c02b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcea9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d0b expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.871291:0:16495:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcea9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.871297:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.871298:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.871301:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3c02b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d0b expref: 16938 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.871307:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007aa158c0/0xdfc0fb148a3c02b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcea9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d0b expref: 16938 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.871312:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007aa158c0, rc 0) 00000100:00100000:0.0:1713481296.871325:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013609f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16938:17009:x1796714882523840:12345-192.168.202.24@tcp:101:dd.0 Request processed in 54us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.871329:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563547 00000100:00100000:0.0:1713481296.871881:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.871908:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882523968 00000100:00100000:0.0:1713481296.871909:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092b9aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784551296:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.871913:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882523968 00010000:00010000:0.0:1713481296.871928:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.871931:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485923 00000100:00100000:1.0:1713481296.871935:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2061:18805:x1796714882523968:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.871942:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20702:1960:x1796714882520896:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6466us (6629us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.871946:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.871947:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820636 00010000:00010000:1.0:1713481296.871953:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c032 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d12 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.872014:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.872021:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872026:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872032:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880120baf180/0xdfc0fb148a3c040 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2cbd:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.872036:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120baf180/0xdfc0fb148a3c040 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872039:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120baf180/0xdfc0fb148a3c040 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.872054:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:14813:1796714784551552:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.872057:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16498:1796714784551488:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.872072:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.872085:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.872099:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20701:1960:x1796714882521344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5737us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.872105:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784551744:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.872107:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820639 00010000:00010000:2.0:1713481296.872142:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.872227:0:10467:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000407:0xbd8b:0x0], index 1: 0 00010000:00010000:1.0:1713481296.872289:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3c047 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2cc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.872293:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3c047 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cc0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872298:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3c047 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2cc0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872310:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872313:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872317:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872320:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872323:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f2d6d00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.872324:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872327:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872332:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbd:0x0].0x0 (ffff8800941bb000) 00010000:00010000:1.0:1713481296.872333:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.872335:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872338:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c039 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000004:00010000:1.0:1713481296.872347:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880092b99c00 reply state ffff88011ef30000 transno 4295107630 ns: mdt-lustre-MDT0001_UUID lock: ffff880120baf180/0xdfc0fb148a3c040 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2cbd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872352:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880120baf180/0xdfc0fb148a3c040 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2cbd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.872355:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cbd:0x0].0x31 (ffff88011e210200) 00010000:00010000:1.0:1713481296.872356:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.872357:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713481296.872374:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c032 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2cbd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d12 expref: 2064 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.872388:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880120bafcc0/0xdfc0fb148a3c047 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2cc0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d12 expref: 2063 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.872392:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2cc0:0x0].0x0 (ffff88009a628400) 00010000:00010000:1.0:1713481296.872393:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713481296.872394:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120bafcc0, rc 0) 00000100:00100000:1.0:1713481296.872423:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18805:x1796714882523968:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 488us (543us total) trans 4295107630 rc 0/0 00000100:00100000:1.0:1713481296.872428:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485923 00000100:00100000:0.0:1713481296.872972:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.873017:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524416 00000100:00100000:1.0:1713481296.873023:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524416 00000100:00100000:1.0:1713481296.873051:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485924 00000100:00100000:1.0:1713481296.873057:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18970:x1796714882524416:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1713481296.873066:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.873077:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c055 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d19 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713481296.873152:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c6f:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.873194:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c055 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d19 expref: 2066 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873200:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c055 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d19 expref: 2066 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873210:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f158b40, rc 0) 00000100:00100000:1.0:1713481296.873237:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18970:x1796714882524416:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 180us (266us total) trans 4295107631 rc 301/301 00000100:00100000:1.0:1713481296.873242:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485924 00000100:00100000:2.0:1713481296.873305:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784551872:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.873331:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.873347:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784552320:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.873360:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784552448:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.873368:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784552512:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.873377:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.873379:0:15506:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078079880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:15506:1796714784552384:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.873382:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.873390:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.873395:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1960:x1796714882520704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5513us (5543us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.873399:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820647 00010000:00010000:1.0:1713481296.873406:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 15 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873413:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00010000:00010000:1.0:1713481296.873416:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1713481296.873417:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16503:1796714784552256:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.873418:0:15506:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 15 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873423:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a761c0, rc 0) 00000100:00100000:0.0:1713481296.873426:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.873442:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.873450:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:15514:x1796714784552192:12345-0@lo:101:mdt_io00_009.0 Request processed in 5699us (5738us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.873454:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82960 00000100:00100000:0.0:1713481296.873475:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.873484:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078078000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_009:lustre-MDT0001-mdtlov_UUID:15514:1796714784552192:0@lo:101:mdt_io00_009.0 00000100:00100000:0.0:1713481296.873489:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524160 00000100:00100000:0.0:1713481296.873492:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524160 00010000:00010000:1.0:1713481296.873496:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873501:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.873505:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800733d8480/0xdfc0fb148689830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3241 expref: 26791 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.873513:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524096 00000100:00100000:1.0:1713481296.873515:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524096 00000100:00100000:1.0:1713481296.873529:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485925 00000100:00100000:0.0:1713481296.873532:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820662 00000100:00100000:1.0:1713481296.873532:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18965:x1796714882524096:12345-192.168.202.24@tcp:36:lfs.0 00000100:00100000:0.0:1713481296.873537:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:1958:x1796714882524160:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.873544:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.873547:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800733d8480/0xdfc0fb148689830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3241 expref: 26791 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.873556:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800733d8480/0xdfc0fb148689830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3241 expref: 26791 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.873574:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800733d8480/0xdfc0fb148689830 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3241 expref: 26791 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.873584:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.873585:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.873586:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.873588:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18965:x1796714882524096:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 54us (160us total) trans 0 rc -17/-17 00010000:00010000:0.0:1713481296.873591:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.873592:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485925 00010000:00010000:0.0:1713481296.873610:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.873616:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.873618:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.873621:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.873622:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:1958:x1796714882524160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.873626:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820662 00010000:00010000:2.0:1713481296.873627:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.873631:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.873635:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.873638:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832a9200 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.873640:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.873640:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.873644:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.873654:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524352 00000100:00100000:0.0:1713481296.873656:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524352 00010000:00010000:2.0:1713481296.873656:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.873658:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.873661:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3bf44 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.873675:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cddd40/0xdfc0fb148802bbf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631b1 expref: 20701 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.873684:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.873693:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524544 00000100:00100000:1.0:1713481296.873693:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.873694:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524544 00010000:00010000:0.0:1713481296.873701:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c583a80/0xdfc0fb148802bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631db expref: 20702 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.873702:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.873709:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524672 00000100:00100000:0.0:1713481296.873711:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524672 00010000:00010000:0.0:1713481296.873715:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800869a4000/0xdfc0fb148802bcd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631cd expref: 20703 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.873715:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.873723:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524224 00000100:00100000:0.0:1713481296.873724:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524224 00010000:00010000:0.0:1713481296.873729:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e9b00/0xdfc0fb148689853 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d325d expref: 26790 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.873732:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.873736:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524480 00000100:00100000:0.0:1713481296.873738:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524480 00010000:00010000:0.0:1713481296.873742:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085c1b600/0xdfc0fb148802bc6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631bf expref: 20704 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.873747:0:15512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524864 00000100:00100000:1.0:1713481296.873751:0:15512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524864 00000100:00100000:0.0:1713481296.873756:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524608 00000100:00100000:0.0:1713481296.873758:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524608 00010000:00010000:0.0:1713481296.873764:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095c9d200/0xdfc0fb148a385df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cff expref: 2171 pid: 6932 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.873772:0:15512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26115 00000100:00100000:3.0:1713481296.873774:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820663 00000100:00100000:1.0:1713481296.873778:0:15512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2394:18955:x1796714882524864:12345-192.168.202.24@tcp:36:mrename.0 00000100:00100000:0.0:1713481296.873779:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820664 00000100:00100000:3.0:1713481296.873781:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20704:1958:x1796714882524352:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.873783:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20704:1958:x1796714882524544:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.873790:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.873790:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.873792:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c583a80/0xdfc0fb148802bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631db expref: 20704 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.873797:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c583a80/0xdfc0fb148802bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631db expref: 20704 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.873797:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cddd40/0xdfc0fb148802bbf lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631b1 expref: 20704 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.873799:0:15512:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713481296.873811:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096e71f80/0xdfc0fb148a3bf6e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cda expref: 2394 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.873811:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cddd40/0xdfc0fb148802bbf lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631b1 expref: 20704 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.873812:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c583a80/0xdfc0fb148802bd4 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x276f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631db expref: 20704 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.873814:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+2880:3490:x1796714784551360:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7424us (7530us total) trans 4295960823 rc 0/0 00000100:00100000:2.0:1713481296.873820:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563527 00010000:00010000:0.0:1713481296.873824:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.873825:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.873826:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.873829:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cddd40/0xdfc0fb148802bbf lrc: 0/0,0 mode: --/PR res: [0x280000408:0x276c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631b1 expref: 20703 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.873831:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873832:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff880084b4fd00) 00010000:00010000:0.0:1713481296.873841:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.873841:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f9cf3c0/0xdfc0fb148a3be64 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c7b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c71 expref: 2393 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.873844:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.873846:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.873847:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820665 00010000:00010000:3.0:1713481296.873849:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.873851:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4018450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20702:1958:x1796714882524672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.873852:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff88007aad9100) 00000100:00100000:0.0:1713481296.873853:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20702:1958:x1796714882524544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 69us (194us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.873855:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.873856:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820664 00010000:00010000:2.0:1713481296.873857:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.873861:0:15512:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.873861:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800869a4000/0xdfc0fb148802bcd lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631cd expref: 20702 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.873867:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800869a4000/0xdfc0fb148802bcd lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631cd expref: 20701 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.873868:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820666 00000100:00100000:0.0:1713481296.873870:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:1958:x1796714882524224:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.873874:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.873874:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:0.0:1713481296.873877:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e9b00/0xdfc0fb148689853 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d325d expref: 26790 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.873877:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.873881:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800869a4000/0xdfc0fb148802bcd lrc: 0/0,0 mode: --/PR res: [0x280000408:0x276e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631cd expref: 20701 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.873882:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e9b00/0xdfc0fb148689853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d325d expref: 26790 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.873882:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.873889:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.873892:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9b00/0xdfc0fb148689853 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d325d expref: 26790 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.873892:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.873893:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.873895:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.873897:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20700:1958:x1796714882524352:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 116us (255us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.873898:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.873899:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.873899:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.873900:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873904:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00000100:00100000:3.0:1713481296.873905:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820663 00010000:00010000:1.0:1713481296.873910:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:2.0:1713481296.873913:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.873920:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:1.0:1713481296.873924:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00000100:00100000:2.0:1713481296.873926:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4018450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20699:1958:x1796714882524672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (241us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.873929:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00000100:00100000:3.0:1713481296.873930:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820667 00000100:00100000:3.0:1713481296.873935:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20699:1958:x1796714882524480:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.873939:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820665 00010000:00010000:3.0:1713481296.873943:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.873949:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085c1b600/0xdfc0fb148802bc6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x276d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631bf expref: 20698 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.873953:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820668 00000100:00100000:2.0:1713481296.873956:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2171:1958:x1796714882524608:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.873959:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085c1b600/0xdfc0fb148802bc6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x276d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631bf expref: 20698 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.873960:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.873964:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095c9d200/0xdfc0fb148a385df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cff expref: 2171 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.873966:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:2.0:1713481296.873969:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095c9d200/0xdfc0fb148a385df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cff expref: 2171 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.873971:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.873973:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.873976:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:2.0:1713481296.873977:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095c9d200/0xdfc0fb148a385df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47cff expref: 2171 pid: 6932 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.873979:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.873979:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c1b600/0xdfc0fb148802bc6 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x276d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631bf expref: 20698 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.873983:0:15512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15512 initiator: MDT0 00010000:00010000:1.0:1713481296.873988:0:15512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2064 pid: 15642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.873990:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.873990:0:14813:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00010000:00010000:1.0:1713481296.873993:0:15512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 4/0,1 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:2.0:1713481296.873993:0:14813:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.873995:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.873997:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.873998:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874000:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874002:0:14813:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874003:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26789:1958:x1796714882524224:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 131us (308us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.874005:0:15512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2064 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874007:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820666 00010000:00010000:3.0:1713481296.874007:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874011:0:15512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2064 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.874012:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.874017:0:15512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15512:1796714784554112:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.874018:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a868e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:14813:1796714784554176:0@lo:105: 00010000:00010000:3.0:1713481296.874026:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.874035:0:15512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012e3c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.874049:0:14813:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.874049:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20697:1958:x1796714882524480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 113us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.874052:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524736 00000100:00100000:1.0:1713481296.874054:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524736 00000100:00100000:3.0:1713481296.874056:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820667 00000100:00100000:0.0:1713481296.874058:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.874066:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801356843c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.874069:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485926 00000100:00100000:1.0:1713481296.874072:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18978:x1796714882524736:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:0.0:1713481296.874074:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554176 00000100:00100000:0.0:1713481296.874076:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554176 00010000:00010000:1.0:1713481296.874078:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.874081:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874081:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874083:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35f840/0xdfc0fb148a3c086 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d20 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874086:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874088:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874091:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20403 00010000:00010000:2.0:1713481296.874091:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874094:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:14813:x1796714784554176:12345-0@lo:105: 00010000:00010000:2.0:1713481296.874095:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874095:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874099:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874100:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874102:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fdeba80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.874102:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874104:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874105:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874107:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874110:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874113:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874114:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874116:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 2/0,0 mode: --/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874117:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874136:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fdeba80/0xdfc0fb148a3bf9f lrc: 0/0,0 mode: --/PW res: [0x280000408:0x276e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874138:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874138:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.874139:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c50d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.874142:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874143:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874149:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.874149:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874151:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880090a74b40) 00010000:00010000:1.0:1713481296.874157:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874161:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874162:0:15514:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874168:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081c50d80/0xdfc0fb148a3bf91 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x276f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874172:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:14813:x1796714784554176:12345-0@lo:105: Request processed in 77us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.874176:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20403 00010000:00010000:1.0:1713481296.874182:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.874185:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.874189:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.874233:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bf3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784552640:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.874243:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.874243:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.874246:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.874250:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.874253:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35db00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.874254:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.874255:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20696:1960:x1796714882520832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6252us (6280us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.874257:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.874261:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820648 00010000:00010000:1.0:1713481296.874262:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88008cf47b00) 00010000:00010000:1.0:1713481296.874263:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.874265:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.874270:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35db00/0xdfc0fb148a3c094 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.874270:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+294:3490:x1796714784552064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6479us (6613us total) trans 4296040956 rc 0/0 00000100:00100000:2.0:1713481296.874277:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563533 00010000:00010000:1.0:1713481296.874288:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874291:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874295:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874302:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1713481296.874303:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524928 00010000:00010000:1.0:1713481296.874305:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.874307:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524928 00010000:00010000:1.0:1713481296.874309:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874313:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874324:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1713481296.874327:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:3.0:1713481296.874327:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+293:3492:x1796714784552128:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6613us (6688us total) trans 4296040957 rc 0/0 00010000:00010000:1.0:1713481296.874329:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.874330:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1713481296.874332:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.874333:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563548 00010000:00010000:0.0:1713481296.874334:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874335:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090a74d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.874337:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.874339:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090a74b40 already unused, calling callback (ffffffffa0efd520) 00000100:00100000:3.0:1713481296.874339:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563532 00010000:00010000:1.0:1713481296.874340:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.874340:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:10479:x1796714882524928:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.874341:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874344:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880084aad100) 00010000:00010000:1.0:1713481296.874345:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00000004:00010000:0.0:1713481296.874346:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874347:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.874348:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.874349:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090a74d80/0xdfc0fb148a3bf7c lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.874358:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099e5ed00/0xdfc0fb148a3c09b lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d27 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874360:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.874362:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713481296.874363:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.874364:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874368:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874371:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874372:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 1/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874372:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099011680/0xdfc0fb148916dde lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65b5 expref: 24482 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.874376:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090a74b40/0xdfc0fb148a3bf83 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bf98 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874377:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1713481296.874378:0:15514:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:1.0:1713481296.874380:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874384:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874385:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.874386:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.874388:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874389:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e5ed00/0xdfc0fb148a3c09b lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d27 expref: 24482 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874393:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1713481296.874394:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1713481296.874395:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874396:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874398:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f0ead00 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:0.0:1713481296.874400:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874400:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874403:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.874404:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874406:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099011680/0xdfc0fb148916dde lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65b5 expref: 24482 pid: 15496 timeout: 0 lvb_type: 1 00000004:00080000:3.0:1713481296.874407:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299aa00/2, rc 0, transno 1073661 00010000:00010000:1.0:1713481296.874409:0:15514:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1713481296.874410:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874413:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.874414:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099011680/0xdfc0fb148916dde lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65b5 expref: 24482 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.874415:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009299aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784552128:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.874416:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 1/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.874424:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784554304:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.874426:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f0ead00/0xdfc0fb148a3bd22 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bd29 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.874428:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2392:18918:x1796714882516096:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 24030us (24256us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.874432:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26113 00000100:00100000:2.0:1713481296.874445:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b1d300 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.874448:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713481296.874450:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1713481296.874453:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.874455:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784554432:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.874456:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1713481296.874458:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e72640 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.874459:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874461:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874463:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e217cc0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.874466:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.874467:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.874470:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.874477:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.874479:0:15565:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713481296.874480:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874482:0:15565:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874482:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874485:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.874485:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.874486:0:15565:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e217a80 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.874488:0:15565:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874489:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874491:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.874492:0:15565:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874493:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217cc0/0xdfc0fb148a3bcf1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bcff expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.874495:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784554496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.874497:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880096e72640/0xdfc0fb148a3bc8f lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdfc0fb148a3bcb9 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874506:0:15565:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874509:0:15565:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713481296.874512:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.874513:0:15565:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874514:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.874515:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.874515:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.874516:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.874516:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.874517:0:15565:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011e217a80/0xdfc0fb148a3bd06 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bd0d expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874519:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713481296.874528:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554432 00000100:00100000:2.0:1713481296.874528:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a868e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:14813:1796714784554176:0@lo:105: 00000100:00100000:0.0:1713481296.874530:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554432 00010000:00010000:2.0:1713481296.874543:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.874546:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713481296.874547:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563549 00010000:00010000:3.0:1713481296.874547:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874548:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.874549:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713481296.874550:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+293:3493:x1796714784554432:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.874554:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.874555:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2170:1958:x1796714882524608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 598us (839us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.874555:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874558:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1713481296.874560:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10100 count 1 00000100:00100000:2.0:1713481296.874560:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820668 00010000:00010000:3.0:1713481296.874562:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.874567:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.874568:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874570:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.874572:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554496 00010000:00010000:1.0:1713481296.874573:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00000100:00100000:2.0:1713481296.874574:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554496 00010000:00010000:0.0:1713481296.874575:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cdeac0/0xdfc0fb148802bf7 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963221 expref: 20695 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.874576:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874579:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.874580:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.874580:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.874582:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874582:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e215d40/0xdfc0fb148a3bcb9 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdfc0fb148a3bc8f expref: 15 pid: 8640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874583:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c50240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.874586:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874591:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cdeac0/0xdfc0fb148802bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963221 expref: 20695 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.874592:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820669 00010000:00010000:3.0:1713481296.874593:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.874594:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+15:3493:x1796714784554496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.874596:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cdeac0/0xdfc0fb148802bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963221 expref: 20695 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.874599:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.874602:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091bf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784554688:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.874608:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.874615:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3bf75 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x276c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874616:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff513c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.874616:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35dd40/0xdfc0fb148a3c0b0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.874623:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35dd40/0xdfc0fb148a3c0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874629:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35dd40/0xdfc0fb148a3c0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.874631:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784554368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.874632:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784554240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.874644:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.874649:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874654:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874658:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784554624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.874659:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874678:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874684:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.874687:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.874689:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708e400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.874692:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.874697:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713481296.874706:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x34a4:0x0]: returning size 4096 00010000:00010000:2.0:1713481296.874709:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713481296.874710:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1713481296.874717:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009708e400/0xdfc0fb148a3bf52 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.874720:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35dd40/0xdfc0fb148a3c0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874727:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874732:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874737:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874742:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874747:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35eac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.874749:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874755:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874762:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00000100:00100000:3.0:1713481296.874763:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+294:3492:x1796714784551808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7643us (7683us total) trans 4296040958 rc 0/0 00010000:00010000:1.0:1713481296.874764:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.874767:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.874771:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563530 00010000:00010000:1.0:1713481296.874772:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35eac0/0xdfc0fb148a3c08d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874784:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874790:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874795:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.874799:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554368 00010000:00010000:1.0:1713481296.874799:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35d200 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.874801:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554368 00010000:00010000:1.0:1713481296.874801:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.874806:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00000004:00080000:3.0:1713481296.874808:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0bd180/2, rc 0, transno 1073662 00010000:00010000:1.0:1713481296.874812:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff88008cf47a00) 00010000:00010000:1.0:1713481296.874813:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.874814:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554624 00000100:00100000:0.0:1713481296.874815:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554624 00010000:00010000:1.0:1713481296.874815:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.874815:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784551808:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.874820:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35d200/0xdfc0fb148a3c0a2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.874823:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98390 00000100:00100000:0.0:1713481296.874825:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0001-mdtlov_UUID+17:3491:x1796714784554368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.874830:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.874833:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+2880:3493:x1796714784551680:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8012us (8066us total) trans 4295960824 rc 0/0 00010000:00010000:0.0:1713481296.874837:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800834add40/0xdfc0fb148a3bd29 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3bd22 expref: 17 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.874838:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563529 00000100:00100000:3.0:1713481296.874847:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784554752:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.874848:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35f840/0xdfc0fb148a3c086 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d20 expref: 2067 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.874851:0:16552:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880096f1ac00) 00010000:00010000:1.0:1713481296.874859:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35dd40/0xdfc0fb148a3c0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d20 expref: 2066 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.874860:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98391 00000100:00100000:2.0:1713481296.874863:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3491:x1796714784554624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.874865:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34a4:0x0].0x0 (ffff88008cf47d00) 00000100:00100000:3.0:1713481296.874866:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.874867:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.874867:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713481296.874868:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.874869:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e35dd40, rc 0) 00010000:00010000:2.0:1713481296.874876:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0e86c0/0xdfc0fb148a3bd0d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3bd06 expref: 16 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.874886:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2066:18978:x1796714882524736:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 812us (1266us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.874889:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3931 (ffff880121573000) 00000100:00100000:1.0:1713481296.874893:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485926 00010000:00010000:2.0:1713481296.874898:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.875019:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0001-mdtlov_UUID+15:3491:x1796714784554368:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.875023:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98390 00000004:00080000:3.0:1713481296.875024:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e2bf100/2, rc 0, transno 993528 00000100:00100000:3.0:1713481296.875032:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784551680:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.875040:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3491:x1796714784554624:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.875047:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98391 00000100:00100000:0.0:1713481296.875050:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784554368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.875055:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784554624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.875066:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.875080:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16542:1796714784552960:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.875085:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.875092:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784554816:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.875105:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.875115:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.875139:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.875148:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784553024:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.875161:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784554560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.875163:0:15562:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.875176:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.875193:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784553152:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.875197:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880082021180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784552768:192.168.202.24@tcp:105: 00000004:00080000:2.0:1713481296.875197:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0bce00/2, rc 0, transno 1073660 00000100:00100000:2.0:1713481296.875203:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784552064:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713481296.875210:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e2bd180/2, rc 0, transno 993527 00010000:00010000:0.0:1713481296.875211:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.875213:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784551360:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.875228:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554240 00000100:00100000:0.0:1713481296.875229:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880082020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16937:1960:x1796714882521280:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6964us (7120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.875229:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554240 00000100:00100000:0.0:1713481296.875235:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820651 00010000:00010000:3.0:1713481296.875239:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.875241:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554560 00000100:00100000:2.0:1713481296.875242:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554560 00000100:00100000:1.0:1713481296.875245:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120246a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6918:1796714784553216:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.875250:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98392 00000100:00100000:2.0:1713481296.875253:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+15:3490:x1796714784554240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.875257:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.875263:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090a761c0/0xdfc0fb148a3bf98 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3431:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3bf83 expref: 15 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875269:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.875269:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784553408:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.875276:0:16520:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3431:0x0].0x0 (ffff88013493c800) 00000100:00100000:1.0:1713481296.875284:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:1960:x1796714882521920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6278us (6418us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.875287:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.875291:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820656 00010000:00010000:3.0:1713481296.875297:0:16493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.875302:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98393 00000100:00100000:2.0:1713481296.875303:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+14:3490:x1796714784554240:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.875306:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+14:3490:x1796714784554560:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.875306:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98392 00010000:00010000:0.0:1713481296.875313:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.875323:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2173c0/0xdfc0fb148a3bcff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3bcf1 expref: 13 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.875327:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784554880:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.875334:0:15529:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:0.0:1713481296.875337:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.875337:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.875350:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784554240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713481296.875356:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784554944:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.875357:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784554560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.875358:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+12:3490:x1796714784554560:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.875362:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98393 00000100:00100000:2.0:1713481296.875378:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554752 00000100:00100000:2.0:1713481296.875380:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554752 00000100:00100000:3.0:1713481296.875381:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.875400:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882524992 00000100:00100000:2.0:1713481296.875402:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882524992 00000100:00100000:1.0:1713481296.875407:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554816 00000100:00100000:1.0:1713481296.875410:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554816 00000100:00100000:2.0:1713481296.875414:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554880 00000100:00100000:0.0:1713481296.875416:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784554944 00000100:00100000:2.0:1713481296.875416:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554880 00000100:00100000:0.0:1713481296.875419:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784554944 00000100:00100000:1.0:1713481296.875425:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563550 00000100:00100000:3.0:1713481296.875426:0:16502:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_073:lustre-OST0001_UUID:16502:1796714784553792:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.875428:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+295:3492:x1796714784554752:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.875429:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563551 00000100:00100000:2.0:1713481296.875432:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16937:18817:x1796714882524992:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.875436:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563552 00010000:00010000:2.0:1713481296.875437:0:16497:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.875438:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2881:3492:x1796714784554816:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713481296.875438:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10101 count 1 00010000:00010000:2.0:1713481296.875444:0:16497:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e5f180/0xdfc0fb148a3c0b7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d2e expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875446:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.875447:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43569 count 1 00010000:00010000:1.0:1713481296.875454:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800836f5680/0xdfc0fb148802bfe lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96322f expref: 20695 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.875454:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800978c5d40/0xdfc0fb1489d0242 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa224fe expref: 20695 pid: 16531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.875455:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.875455:0:16502:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875458:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.875458:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.875459:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.875460:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.875461:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875461:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e5f180/0xdfc0fb148a3c0b7 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d2e expref: 16938 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.875462:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9680/0xdfc0fb148689884 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32b1 expref: 26787 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.875466:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.875467:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.875469:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875472:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800836f5680/0xdfc0fb148802bfe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96322f expref: 20695 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.875472:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800978c5d40/0xdfc0fb1489d0242 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa224fe expref: 20695 pid: 16531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875477:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800978c5d40/0xdfc0fb1489d0242 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa224fe expref: 20695 pid: 16531 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.875478:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800836f5680/0xdfc0fb148802bfe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96322f expref: 20695 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.875479:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e9680/0xdfc0fb148689884 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32b1 expref: 26787 pid: 16454 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.875480:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563553 00000100:00100000:2.0:1713481296.875482:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085caf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784555008:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.875485:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784555072:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.875485:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+295:3490:x1796714784554880:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.875496:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b1df00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.875498:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e9680/0xdfc0fb148689884 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32b1 expref: 26787 pid: 16454 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.875498:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10102 count 1 00000100:00100000:1.0:1713481296.875499:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.875504:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784555136:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.875511:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.875514:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f935880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784553536:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.875520:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563554 00010000:00010000:3.0:1713481296.875522:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134501200/0xdfc0fb148802c05 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96323d expref: 20695 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.875523:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2881:3491:x1796714784554944:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.875528:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.875529:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1713481296.875530:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43571 count 1 00000100:00100000:0.0:1713481296.875531:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.875532:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875533:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880120bae880, rc 0) 00010000:00010000:1.0:1713481296.875538:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875545:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880078778d80/0xdfc0fb14868988b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32bf expref: 26787 pid: 16490 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.875545:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882521024:12345-192.168.202.24@tcp:101:dd.0 Request processed in 12558us (12593us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.875548:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134501200/0xdfc0fb148802c05 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96323d expref: 20695 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.875549:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.875550:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.875551:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.875552:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563521 00010000:00010000:3.0:1713481296.875557:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134501200/0xdfc0fb148802c05 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96323d expref: 20695 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.875560:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880078778d80/0xdfc0fb14868988b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32bf expref: 26787 pid: 16490 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.875566:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880078778d80/0xdfc0fb14868988b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32bf expref: 26787 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.875568:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784555200:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.875571:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013609dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784555264:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.875576:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784552704:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.875586:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b96ba80 going to sleep for 11 seconds 00000001:00080000:0.0:1713481296.875590:0:6914:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295105927 is committed 00000100:00100000:3.0:1713481296.875595:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086c94d80 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.875598:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.875612:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077a82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784553856:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.875616:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.875617:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784553728:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.875625:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.875626:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.875629:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.875633:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525440 00000100:00100000:0.0:1713481296.875635:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525440 00010000:00010000:1.0:1713481296.875635:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.875638:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.875643:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800733d9f80/0xdfc0fb148689876 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3295 expref: 26788 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.875645:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.875652:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820670 00000100:00100000:1.0:1713481296.875652:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.875652:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.875655:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:1958:x1796714882525440:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.875659:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e718c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.875660:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.875677:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800733d9f80/0xdfc0fb148689876 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3295 expref: 26788 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.875677:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.875679:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.875684:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800733d9f80/0xdfc0fb148689876 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3295 expref: 26788 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.875686:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875695:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e215d40/0xdfc0fb148a3bcb9 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdfc0fb148a3bc8f expref: 11 pid: 8640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.875697:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.875698:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800733d9f80/0xdfc0fb148689876 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3295 expref: 26788 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.875701:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875706:0:14813:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880122555500) 00010000:00010000:3.0:1713481296.875708:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e718c0/0xdfc0fb148a3bf8a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x276d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875709:0:14813:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 10 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.875710:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.875711:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.875712:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.875713:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875714:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 10 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875717:0:14813:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 10 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.875718:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.875720:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.875728:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.875728:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 10 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.875729:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525568 00000100:00100000:1.0:1713481296.875731:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525568 00000100:00100000:2.0:1713481296.875733:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085cadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:14813:1796714784555328:0@lo:105: 00000100:00100000:0.0:1713481296.875738:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26787:1958:x1796714882525440:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 82us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.875741:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820670 00000100:00100000:1.0:1713481296.875741:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525632 00000100:00100000:1.0:1713481296.875742:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525632 00000100:00100000:1.0:1713481296.875748:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525824 00000100:00100000:1.0:1713481296.875749:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525824 00000100:00100000:0.0:1713481296.875751:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525312 00000100:00100000:0.0:1713481296.875752:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525312 00000100:00100000:2.0:1713481296.875754:0:14813:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.875756:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563555 00010000:00010000:0.0:1713481296.875759:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085c18fc0/0xdfc0fb148802be2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631f7 expref: 20696 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.875759:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:10409:x1796714882525568:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.875764:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.875765:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009713f300 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.875768:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820671 00000100:00100000:0.0:1713481296.875770:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013609c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20696:1958:x1796714882525312:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.875770:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800736a06c0/0xdfc0fb148a3c0da lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d35 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.875774:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.875777:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085c18fc0/0xdfc0fb148802be2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631f7 expref: 20696 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.875777:0:6917:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1713481296.875781:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880079b88b40/0xdfc0fb14891d17b lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca732 expref: 24483 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.875781:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784555328 00010000:00010000:0.0:1713481296.875782:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085c18fc0/0xdfc0fb148802be2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631f7 expref: 20696 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.875783:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784555328 00010000:00010000:1.0:1713481296.875786:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135af5440/0xdfc0fb14893ac86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ff expref: 26788 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.875789:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.875790:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.875792:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800736a06c0/0xdfc0fb148a3c0da lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d35 expref: 24483 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.875793:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20404 00010000:00010000:0.0:1713481296.875794:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c18fc0/0xdfc0fb148802be2 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631f7 expref: 20696 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.875796:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:14813:x1796714784555328:12345-0@lo:105: 00010000:00010000:2.0:1713481296.875800:0:6917:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875801:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135af5440/0xdfc0fb14893ac86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ff expref: 26788 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.875804:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.875805:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.875805:0:6917:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875806:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135af5440/0xdfc0fb14893ac86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ff expref: 26788 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.875807:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875808:0:6917:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 5/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.875811:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.875811:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120246a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784555392:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.875812:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 5/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875815:0:6917:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875819:0:6917:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 6/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.875828:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880079b88b40/0xdfc0fb14891d17b lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca732 expref: 24483 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.875829:0:6917:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011f9cf600) 00010000:00010000:1.0:1713481296.875833:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880079b88b40/0xdfc0fb14891d17b lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca732 expref: 24483 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.875837:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078079500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784555456:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.875845:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665240 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.875853:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+296:3490:x1796714784552000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8148us (8235us total) trans 4296040959 rc 0/0 00000100:00100000:2.0:1713481296.875855:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:14813:x1796714784555328:12345-0@lo:105: Request processed in 58us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.875858:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20404 00010000:00010000:1.0:1713481296.875859:0:15793:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.875862:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563531 00010000:00010000:1.0:1713481296.875866:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.875886:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563556 00000004:00080000:1.0:1713481296.875888:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1713481296.875890:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:11388:x1796714882525632:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.875898:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.875899:0:16503:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.875909:0:16503:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3c0e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d3c expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.875912:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013609c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20695:1958:x1796714882525312:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 139us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.875919:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820671 00010000:00010000:3.0:1713481296.875925:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0xdfc0fb14894242e lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f0 expref: 24483 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.875927:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563557 00000100:00100000:2.0:1713481296.875930:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26789:11552:x1796714882525824:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.875932:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.875934:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.875935:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.875937:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3c0e1 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d3c expref: 26789 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.875942:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3c0e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d43 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.875946:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525696 00000100:00100000:0.0:1713481296.875949:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525696 00010000:00010000:2.0:1713481296.875952:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e096ac0/0xdfc0fb14895a057 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecda expref: 26790 pid: 15510 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.875953:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0xdfc0fb14894242e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f0 expref: 24483 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.875956:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.875957:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.875959:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3c0e8 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d43 expref: 26790 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.875962:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0xdfc0fb14894242e lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f0 expref: 24483 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.875968:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e096ac0/0xdfc0fb14895a057 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecda expref: 26790 pid: 15510 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.875970:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.875971:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125707 00000100:00100000:3.0:1713481296.875972:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784555520:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.875974:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e096ac0/0xdfc0fb14895a057 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecda expref: 26790 pid: 15510 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.875975:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2066:18970:x1796714882525696:12345-192.168.202.24@tcp:33:lfs.0 00010000:00010000:1.0:1713481296.875980:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.875980:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085cac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784555648:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.875987:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00000100:00100000:3.0:1713481296.875988:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.875993:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091b6b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.875998:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784555584:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.876004:0:16493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876010:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085cadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:14813:1796714784555328:0@lo:105: 00010000:00010000:3.0:1713481296.876016:0:16493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713481296.876018:0:15487:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c6f:0x0]: returning size 4096 00000004:00200000:0.0:1713481296.876020:0:15487:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713481296.876020:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.876023:0:16493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.876030:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.876030:0:16493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876031:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f000 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.876036:0:16493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.876042:0:16493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c53cc0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.876045:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784555584 00010000:00010000:3.0:1713481296.876045:0:16493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.876046:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2066:18970:x1796714882525696:12345-192.168.202.24@tcp:33:lfs.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.876047:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784555584 00000100:00100000:0.0:1713481296.876052:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125707 00010000:00010000:3.0:1713481296.876052:0:16493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876062:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3493:x1796714784554496:12345-0@lo:103:ldlm_bl.0 Request processed in 1465us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.876065:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82961 00010000:00010000:3.0:1713481296.876066:0:16493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876069:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:15793:x1796714784555584:12345-0@lo:101:mdt_io00_014.0 00000100:00100000:2.0:1713481296.876069:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820669 00010000:00010000:3.0:1713481296.876073:0:16493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3bfd0 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876077:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.876085:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d68240/0xdfc0fb148a3c0f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c0ef expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876097:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d68240/0xdfc0fb148a3c0f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c0ef expref: 11 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876106:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d68240/0xdfc0fb148a3c0f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c0ef expref: 11 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876112:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000100:00100000:0.0:1713481296.876113:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784551616:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.876115:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.876117:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d68240, rc 0) 00010000:00010000:0.0:1713481296.876148:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876159:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:15793:x1796714784555584:12345-0@lo:101:mdt_io00_014.0 Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.876165:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82961 00000100:00100000:2.0:1713481296.876184:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784554496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.876197:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784555584:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.876207:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876215:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.876217:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0bdc00/2, rc 0, transno 1073663 00000100:00100000:2.0:1713481296.876225:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784552000:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713481296.876228:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:1.0:1713481296.876240:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00000100:00100000:3.0:1713481296.876241:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+296:3492:x1796714784553280:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6885us (6927us total) trans 4296040960 rc 0/0 00010000:00010000:1.0:1713481296.876245:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00000100:00100000:3.0:1713481296.876249:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563538 00010000:00010000:1.0:1713481296.876252:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.876254:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.876259:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784555776:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.876262:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784555712:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.876273:0:16502:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876274:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.876281:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.876282:0:16502:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.876290:0:16502:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876291:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.876295:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784555776 00000100:00100000:2.0:1713481296.876297:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784555776 00010000:00010000:3.0:1713481296.876297:0:16502:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.876304:0:16502:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876306:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784555712 00000100:00100000:2.0:1713481296.876308:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563558 00000100:00100000:1.0:1713481296.876309:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784555712 00010000:00010000:3.0:1713481296.876310:0:16502:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c51b00 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:2.0:1713481296.876311:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+296:3493:x1796714784555776:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.876313:0:16502:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.876319:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10103 count 1 00010000:00010000:3.0:1713481296.876320:0:16502:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876325:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82962 00010000:00010000:2.0:1713481296.876327:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876329:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007807bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15793:x1796714784555712:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.876333:0:16502:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.876334:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be19b00/0xdfc0fb148802c0c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96324b expref: 20694 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.876336:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.876337:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.876338:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.876340:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.876340:0:16502:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3bfde lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876346:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d6a400/0xdfc0fb148a3c10b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c0fd expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.876350:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be19b00/0xdfc0fb148802c0c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96324b expref: 20694 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.876355:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be19b00/0xdfc0fb148802c0c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96324b expref: 20694 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.876358:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d6a400/0xdfc0fb148a3c10b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c0fd expref: 12 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876364:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784555840:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.876370:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d6a400/0xdfc0fb148a3c10b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c0fd expref: 12 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876374:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff5180 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.876376:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff8801302c2200) 00010000:00010000:1.0:1713481296.876378:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.876381:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d6a400, rc 0) 00000100:00100000:1.0:1713481296.876403:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007807bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784555712:12345-0@lo:101:mdt_io00_014.0 Request processed in 73us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.876408:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82962 00000100:00100000:0.0:1713481296.876421:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.876434:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.876437:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784555712:0@lo:101:mdt_io00_014.0 00000100:00100000:2.0:1713481296.876437:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525888 00000100:00100000:2.0:1713481296.876439:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525888 00000100:00100000:0.0:1713481296.876443:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.876445:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876449:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876454:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525952 00000100:00100000:2.0:1713481296.876456:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525952 00000004:00080000:1.0:1713481296.876458:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:0.0:1713481296.876464:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563559 00000100:00100000:0.0:1713481296.876469:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16939:18836:x1796714882525888:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.876469:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563560 00000100:00100000:2.0:1713481296.876472:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:18805:x1796714882525952:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.876474:0:16488:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.876476:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784555904:0@lo:1000:mdt_io00_014.0 00010000:00010000:2.0:1713481296.876476:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.876481:0:16488:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3c112 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d4a expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.876483:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3c119 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xbd8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d51 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.876491:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133aa2640/0xdfc0fb14891f93d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cbed9 expref: 20694 pid: 16526 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.876492:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xbd8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.876496:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.876497:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.876498:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3c112 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d4a expref: 16940 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876498:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.876498:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.876499:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.876503:0:16502:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:lustre-MDT0001-mdtlov_UUID+2882:3490:x1796714784553344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6766us (6910us total) trans 4295960825 rc 0/0 00010000:00010000:2.0:1713481296.876504:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3c119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xbd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d51 expref: 26792 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876506:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090876480 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.876508:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133aa2640/0xdfc0fb14891f93d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cbed9 expref: 20694 pid: 16526 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.876510:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007fe04240/0xdfc0fb148a3c119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xbd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d51 expref: 26792 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.876511:0:16502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563540 00010000:00010000:0.0:1713481296.876513:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133aa2640/0xdfc0fb14891f93d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cbed9 expref: 20694 pid: 16526 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.876514:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784555904 00010000:00010000:2.0:1713481296.876514:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fe04240, rc 0) 00000100:00100000:1.0:1713481296.876516:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784555904 00000100:00100000:0.0:1713481296.876518:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784555968:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.876524:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26792:18805:x1796714882525952:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 51us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.876525:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82963 00000100:00100000:1.0:1713481296.876528:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880089a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784555904:12345-0@lo:1000:mdt_io00_014.0 00000100:00100000:2.0:1713481296.876528:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563560 00000100:00100000:0.0:1713481296.876530:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098098300 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.876555:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0f1180/2, rc 0, transno 1073664 00000004:00080000:2.0:1713481296.876559:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f936d80/2, rc 0, transno 993529 00000100:00100000:3.0:1713481296.876564:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784553280:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.876565:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784553344:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.876566:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784555904:12345-0@lo:1000:mdt_io00_014.0 Request processed in 37us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.876572:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82963 00000100:00100000:1.0:1713481296.876589:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784555904:0@lo:1000:mdt_io00_014.0 00000100:00100000:3.0:1713481296.876600:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.876609:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880076a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784556032:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.876615:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784556096:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.876629:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556160:0@lo:1000:mdt_io00_014.0 00000100:00100000:3.0:1713481296.876636:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.876638:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525760 00000100:00100000:2.0:1713481296.876639:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525760 00000100:00100000:1.0:1713481296.876642:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.876647:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e9d40/0xdfc0fb14868984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d324f expref: 26792 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.876657:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008323e300 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.876658:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820672 00000100:00100000:2.0:1713481296.876661:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013620ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26792:1958:x1796714882525760:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.876680:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556160 00010000:00010000:2.0:1713481296.876682:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.876683:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556160 00010000:00010000:2.0:1713481296.876685:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e9d40/0xdfc0fb14868984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d324f expref: 26792 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.876690:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e9d40/0xdfc0fb14868984c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d324f expref: 26792 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.876690:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556032 00000100:00100000:1.0:1713481296.876692:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82964 00000100:00100000:3.0:1713481296.876694:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556032 00000100:00100000:1.0:1713481296.876695:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784556160:12345-0@lo:1000:mdt_io00_014.0 00010000:00010000:2.0:1713481296.876700:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9d40/0xdfc0fb14868984c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d324f expref: 26792 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.876707:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.876708:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.876709:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.876711:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563561 00010000:00010000:2.0:1713481296.876714:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.876716:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+297:3492:x1796714784556032:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.876728:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10104 count 1 00010000:00010000:2.0:1713481296.876731:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.876737:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784556160:12345-0@lo:1000:mdt_io00_014.0 Request processed in 41us (94us total) trans 0 rc 1/1 00010000:00010000:0.0:1713481296.876740:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.876740:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876741:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82964 00010000:00010000:0.0:1713481296.876745:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876748:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:1958:x1796714882525760:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (303us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.876751:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.876751:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cdfcc0/0xdfc0fb148802c13 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963259 expref: 20694 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.876755:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820672 00010000:00010000:3.0:1713481296.876757:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.876759:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.876760:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007807b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556160:0@lo:1000:mdt_io00_014.0 00010000:00010000:3.0:1713481296.876762:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876779:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.876780:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cdfcc0/0xdfc0fb148802c13 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963259 expref: 20694 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.876787:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556288:0@lo:1000:mdt_io00_014.0 00010000:00010000:3.0:1713481296.876794:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cdfcc0/0xdfc0fb148802c13 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963259 expref: 20694 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.876799:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.876803:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784556224:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.876806:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008323e0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.876808:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.876813:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876813:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556288 00000100:00100000:1.0:1713481296.876815:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556288 00010000:00010000:0.0:1713481296.876816:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134fa61c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.876818:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.876822:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.876823:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82965 00000100:00100000:3.0:1713481296.876824:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.876826:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007807b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784556288:12345-0@lo:1000:mdt_io00_014.0 00010000:00010000:0.0:1713481296.876833:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.876837:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134fa61c0/0xdfc0fb148a3bf4b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.876840:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556096 00000100:00100000:3.0:1713481296.876843:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556096 00000100:00100000:1.0:1713481296.876856:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007807b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784556288:12345-0@lo:1000:mdt_io00_014.0 Request processed in 29us (56us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.876859:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82965 00000100:00100000:3.0:1713481296.876861:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563562 00000100:00100000:3.0:1713481296.876865:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+2882:3490:x1796714784556096:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713481296.876876:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43573 count 1 00000100:00100000:1.0:1713481296.876877:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556288:0@lo:1000:mdt_io00_014.0 00010000:00010000:3.0:1713481296.876888:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.876899:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800733d9b00/0xdfc0fb148689892 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32cd expref: 26790 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.876905:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.876906:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.876906:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.876909:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876910:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.876914:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.876920:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556352:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.876925:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800733d9b00/0xdfc0fb148689892 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32cd expref: 26790 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.876931:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.876934:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800733d9b00/0xdfc0fb148689892 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32cd expref: 26790 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.876939:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.876947:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556352 00000100:00100000:1.0:1713481296.876948:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556352 00000100:00100000:3.0:1713481296.876949:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784556416:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.876960:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82966 00000100:00100000:0.0:1713481296.876961:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2883:3491:x1796714784551424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10524us (10622us total) trans 4295960826 rc 0/0 00000100:00100000:1.0:1713481296.876962:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:15793:x1796714784556352:12345-0@lo:101:mdt_io00_014.0 00000100:00100000:0.0:1713481296.876966:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563528 00010000:00010000:1.0:1713481296.876967:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.876969:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ab15840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.876973:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c135 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c12e expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.876981:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c135 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c12e expref: 13 pid: 15524 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.876982:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e2bdc00/2, rc 0, transno 993530 00010000:00010000:1.0:1713481296.876986:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c135 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c12e expref: 13 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.876988:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784551424:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.876989:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d7:0x0].0x0 (ffff880097eff700) 00010000:00010000:1.0:1713481296.876991:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.876992:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007da133c0, rc 0) 00000100:00100000:0.0:1713481296.876993:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.877005:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+13:15793:x1796714784556352:12345-0@lo:101:mdt_io00_014.0 Request processed in 42us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.877009:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82966 00000100:00100000:2.0:1713481296.877009:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011f935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784556480:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.877014:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526016 00000100:00100000:3.0:1713481296.877018:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526016 00000100:00100000:1.0:1713481296.877030:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007de2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556352:0@lo:101:mdt_io00_014.0 00000100:00100000:2.0:1713481296.877032:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.877036:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.877037:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563563 00010000:00010000:1.0:1713481296.877040:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.877041:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072ab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16941:18844:x1796714882526016:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.877046:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013609d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784553984:192.168.202.24@tcp:105: 00010000:00010000:3.0:1713481296.877049:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.877053:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.877056:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.877057:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:3.0:1713481296.877060:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3c143 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d58 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877061:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.877066:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16941:1959:x1796714882523584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6743us (6905us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.877071:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820660 00010000:00010000:1.0:1713481296.877071:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00002000:00010000:3.0:1713481296.877073:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.877074:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.877078:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.877083:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120146d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556544:0@lo:101:mdt_io00_014.0 00010000:00010000:3.0:1713481296.877084:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.877086:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.877089:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556480 00010000:00010000:3.0:1713481296.877090:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3c143 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d58 expref: 16941 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.877091:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556480 00000100:00100000:1.0:1713481296.877094:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.877099:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d9f80/0xdfc0fb148a3c143 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d58 expref: 16941 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877100:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f000 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.877101:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563564 00000100:00100000:0.0:1713481296.877104:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2883:3491:x1796714784556480:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.877107:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556544 00010000:00010000:3.0:1713481296.877107:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c0d9f80, rc 0) 00000100:00100000:1.0:1713481296.877109:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556544 00002000:00080000:0.0:1713481296.877111:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43574 count 1 00000100:00100000:1.0:1713481296.877117:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82967 00000100:00100000:1.0:1713481296.877136:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:15793:x1796714784556544:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:0.0:1713481296.877137:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877141:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.877145:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9200/0xdfc0fb148689899 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32db expref: 26790 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.877147:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800992cf3c0/0xdfc0fb148a3c158 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c14a expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877149:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877150:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877151:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877156:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800992cf3c0/0xdfc0fb148a3c158 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c14a expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.877158:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072ab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16941:18844:x1796714882526016:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 115us (162us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.877161:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800992cf3c0/0xdfc0fb148a3c158 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c14a expref: 14 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877163:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e9200/0xdfc0fb148689899 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32db expref: 26790 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.877165:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880097effb00) 00000100:00100000:3.0:1713481296.877165:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563563 00010000:00010000:1.0:1713481296.877166:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.877168:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800992cf3c0, rc 0) 00010000:00010000:0.0:1713481296.877169:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e9200/0xdfc0fb148689899 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32db expref: 26790 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.877175:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800755a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784556608:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.877183:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007de2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:15793:x1796714784556544:12345-0@lo:101:mdt_io00_014.0 Request processed in 46us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.877186:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82967 00000100:00100000:0.0:1713481296.877190:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.877207:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120146d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001-mdtlov_UUID:15793:1796714784556544:0@lo:101:mdt_io00_014.0 00010000:00010000:1.0:1713481296.877213:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877217:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.877219:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.877229:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525056 00010000:00010000:1.0:1713481296.877229:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.877231:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525056 00010000:00010000:1.0:1713481296.877234:0:15793:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877238:0:15793:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 4/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.877239:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e9440/0xdfc0fb14868985a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d326b expref: 26791 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.877247:0:15793:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877251:0:15793:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1713481296.877256:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820673 00000100:00100000:1.0:1713481296.877257:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120146d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001_UUID:15793:1796714784556672:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.877259:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:1959:x1796714882525056:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.877263:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.877265:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e9440/0xdfc0fb14868985a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d326b expref: 26791 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.877269:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fe4f000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.877270:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e9440/0xdfc0fb14868985a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d326b expref: 26791 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.877280:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9440/0xdfc0fb14868985a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d326b expref: 26791 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.877284:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.877286:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877287:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877289:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877293:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877300:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525184 00000100:00100000:1.0:1713481296.877301:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.877303:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.877304:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525184 00000100:00100000:1.0:1713481296.877312:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.877314:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:1959:x1796714882525056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (95us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.877314:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cded00/0xdfc0fb148802bdb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631e9 expref: 20695 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.877318:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820673 00000100:00100000:1.0:1713481296.877320:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526080 00000100:00100000:1.0:1713481296.877322:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526080 00000100:00100000:2.0:1713481296.877326:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525376 00000100:00100000:2.0:1713481296.877328:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525376 00000100:00100000:0.0:1713481296.877329:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820674 00000100:00100000:0.0:1713481296.877331:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20697:1959:x1796714882525184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.877334:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800836f4240/0xdfc0fb148802be9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963205 expref: 20697 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.877335:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.877338:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cded00/0xdfc0fb148802bdb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631e9 expref: 20697 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.877341:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563565 00010000:00010000:0.0:1713481296.877343:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cded00/0xdfc0fb148802bdb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631e9 expref: 20697 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.877344:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820675 00000100:00100000:1.0:1713481296.877345:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20697:15045:x1796714882526080:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.877346:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20697:1959:x1796714882525376:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.877350:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.877351:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.877353:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cded00/0xdfc0fb148802bdb lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2770:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9631e9 expref: 20697 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.877353:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800836f4240/0xdfc0fb148802be9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2772:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963205 expref: 20697 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.877357:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800992cd200/0xdfc0fb148a3c166 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d5f expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877361:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877362:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.877362:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800836f4240/0xdfc0fb148802be9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2772:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963205 expref: 20696 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.877364:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.877365:0:15509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.877371:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877371:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.877372:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.877373:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800836f4240/0xdfc0fb148802be9 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2772:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963205 expref: 20697 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.877375:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800992cd200/0xdfc0fb148a3c166 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d5f expref: 20697 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877379:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.877383:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.877384:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.877385:0:15509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800992cd200/0xdfc0fb148a3c166 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d5f expref: 20696 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877386:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.877388:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20696:1959:x1796714882525184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (103us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.877390:0:15509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800992cd200, rc 0) 00000100:00100000:0.0:1713481296.877391:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820674 00010000:00010000:2.0:1713481296.877392:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877402:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20695:15045:x1796714882526080:12345-192.168.202.24@tcp:101:dd.0 Request processed in 57us (89us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.877405:0:15562:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877406:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563565 00010000:00010000:2.0:1713481296.877407:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.877409:0:15562:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877413:0:15562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877417:0:15562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877420:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20694:1959:x1796714882525376:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (118us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.877421:0:15562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877424:0:15562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134fa6f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.877425:0:15562:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877426:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820675 00010000:00010000:0.0:1713481296.877432:0:15562:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877438:0:15562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877442:0:15562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134fa6f40/0xdfc0fb148a3bfc2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877442:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.877450:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.877458:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.877466:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525120 00000100:00100000:1.0:1713481296.877467:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525120 00000100:00100000:2.0:1713481296.877472:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525248 00010000:00010000:1.0:1713481296.877474:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e98c0/0xdfc0fb148689861 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3279 expref: 26790 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.877475:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525248 00000100:00100000:1.0:1713481296.877483:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882525504 00000100:00100000:1.0:1713481296.877484:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882525504 00010000:00010000:2.0:1713481296.877486:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133df18c0/0xdfc0fb14868986f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3287 expref: 26791 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.877489:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c802640/0xdfc0fb148802bf0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963213 expref: 20694 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.877497:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820676 00000100:00100000:1.0:1713481296.877500:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26791:1959:x1796714882525120:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.877504:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.877504:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820677 00010000:00010000:1.0:1713481296.877506:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e98c0/0xdfc0fb148689861 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3279 expref: 26791 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.877508:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880077069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20694:1959:x1796714882525504:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.877513:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.877515:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e98c0/0xdfc0fb148689861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3279 expref: 26791 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.877518:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c802640/0xdfc0fb148802bf0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2773:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963213 expref: 20694 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.877525:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e98c0/0xdfc0fb148689861 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3279 expref: 26791 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.877526:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c802640/0xdfc0fb148802bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2773:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963213 expref: 20694 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.877531:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.877532:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.877534:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877538:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877541:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c802640/0xdfc0fb148802bf0 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2773:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963213 expref: 20694 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.877552:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+298:3491:x1796714784552832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8865us (8963us total) trans 4296040961 rc 0/0 00010000:00010000:1.0:1713481296.877552:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.877554:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.877555:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.877556:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563536 00010000:00010000:2.0:1713481296.877558:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877560:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:1959:x1796714882525120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.877564:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820676 00010000:00010000:2.0:1713481296.877566:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877574:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820678 00000100:00100000:1.0:1713481296.877576:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26789:1959:x1796714882525248:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.877580:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.877583:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133df18c0/0xdfc0fb14868986f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3287 expref: 26789 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.877585:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.877588:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133df18c0/0xdfc0fb14868986f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3287 expref: 26789 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.877594:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013609ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784553920:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.877599:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133df18c0/0xdfc0fb14868986f lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3287 expref: 26789 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.877599:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20693:1959:x1796714882525504:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.877605:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820677 00010000:00010000:0.0:1713481296.877607:0:16487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877608:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.877609:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.877611:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877615:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877632:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.877639:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877643:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:1959:x1796714882525248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000004:00080000:2.0:1713481296.877644:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120144700/2, rc 0, transno 1073665 00000100:00100000:1.0:1713481296.877646:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820678 00000100:00100000:0.0:1713481296.877649:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.877650:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784552832:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.877652:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.877660:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877674:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.877675:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526144 00000100:00100000:0.0:1713481296.877679:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526144 00010000:00010000:1.0:1713481296.877679:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877683:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.877683:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877687:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.877690:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877695:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.877696:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c50900 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.877697:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563566 00010000:00010000:1.0:1713481296.877698:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e0ea880 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.877699:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877700:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877701:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713481296.877702:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:17924:x1796714882526144:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.877704:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.877705:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877708:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784556736:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.877709:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.877712:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877716:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e0ea880/0xdfc0fb148a3bfd7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877719:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d09cfc0/0xdfc0fb148a3c16d lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d66 expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.877720:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877728:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.877728:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3bfc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877736:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007991db00/0xdfc0fb148a1627a lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39867 expref: 24485 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.877740:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877741:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877743:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d09cfc0/0xdfc0fb148a3c16d lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d66 expref: 24485 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877748:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877753:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007991db00/0xdfc0fb148a1627a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39867 expref: 24485 pid: 16498 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.877757:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007991db00/0xdfc0fb148a1627a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39867 expref: 24485 pid: 16498 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.877757:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877761:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.877763:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800755a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784556800:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.877765:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877769:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877772:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801314ae1c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.877774:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59480 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.877774:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877778:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.877785:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556736 00000100:00100000:0.0:1713481296.877786:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556736 00010000:00010000:2.0:1713481296.877786:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.877790:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801314ae1c0/0xdfc0fb148a3bfe5 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.877797:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563567 00000100:00100000:0.0:1713481296.877800:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+299:3493:x1796714784556736:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.877807:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10105 count 1 00010000:00010000:0.0:1713481296.877814:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.877820:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f159680/0xdfc0fb148802c1a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963267 expref: 20692 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.877828:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877828:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.877830:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.877830:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+299:3493:x1796714784553600:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8104us (8215us total) trans 4296040962 rc 0/0 00000100:00100000:1.0:1713481296.877834:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563539 00010000:00010000:0.0:1713481296.877839:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f159680/0xdfc0fb148802c1a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963267 expref: 20692 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.877844:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f159680/0xdfc0fb148802c1a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963267 expref: 20692 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.877849:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800755a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784556864:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.877859:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c43bb40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.877859:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877863:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877868:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877872:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.877875:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2884:3492:x1796714784553088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8946us (8991us total) trans 4295960827 rc 0/0 00010000:00010000:1.0:1713481296.877876:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877879:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801314ac000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.877881:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.877883:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563537 00010000:00010000:1.0:1713481296.877884:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877890:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+299:3491:x1796714784553472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8145us (8251us total) trans 4296040963 rc 0/0 00000100:00100000:0.0:1713481296.877891:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.877893:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.877896:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801314ac000/0xdfc0fb148a3bfbb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.877896:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563541 00000100:00100000:0.0:1713481296.877912:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:3.0:1713481296.877924:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d35500/2, rc 0, transno 993531 00000004:00080000:2.0:1713481296.877926:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0f3480/2, rc 0, transno 1073667 00000100:00100000:2.0:1713481296.877930:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784553472:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.877933:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.877933:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784553088:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.877951:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526400 00000100:00100000:2.0:1713481296.877954:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013620ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784556928:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.877954:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526400 00000100:00100000:0.0:1713481296.877955:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.877967:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.877982:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526464 00000100:00100000:3.0:1713481296.877985:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526464 00000100:00100000:0.0:1713481296.877987:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784556928 00000100:00100000:0.0:1713481296.877989:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784556928 00000004:00080000:2.0:1713481296.877994:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0f3b80/2, rc 0, transno 1073666 00000100:00100000:2.0:1713481296.878001:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784553600:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.878005:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563568 00000100:00100000:1.0:1713481296.878006:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+2884:3491:x1796714784552896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9395us (9440us total) trans 4295960828 rc 0/0 00000100:00100000:0.0:1713481296.878012:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563569 00000100:00100000:3.0:1713481296.878013:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16941:8499:x1796714882526400:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.878016:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:17935:x1796714882526464:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.878016:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563535 00000100:00100000:2.0:1713481296.878020:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563570 00010000:00010000:0.0:1713481296.878021:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.878021:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.878023:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+299:3493:x1796714784556928:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.878030:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d09d440/0xdfc0fb148a3c17b lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb79d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d7b expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.878032:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10106 count 1 00010000:00010000:3.0:1713481296.878032:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3c182 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d6d expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.878038:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb79d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.878038:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526208 00000100:00100000:1.0:1713481296.878040:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526208 00010000:00010000:2.0:1713481296.878041:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878045:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.878046:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.878047:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c19cfc0/0xdfc0fb1488e7e76 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5548 expref: 16942 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.878048:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a5d440/0xdfc0fb14868987d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32a3 expref: 26790 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.878049:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d09d440/0xdfc0fb148a3c17b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d7b expref: 26790 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.878049:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096ce73c0/0xdfc0fb148802c21 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963275 expref: 20692 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.878052:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.878053:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.878054:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.878055:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d09d440/0xdfc0fb148a3c17b lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d7b expref: 26790 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.878055:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.878055:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.878058:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3c182 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d6d expref: 16942 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878060:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d09d440, rc 0) 00000100:00100000:1.0:1713481296.878061:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820679 00000100:00100000:1.0:1713481296.878064:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:1958:x1796714882526208:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.878064:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096ce73c0/0xdfc0fb148802c21 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963275 expref: 20692 pid: 16497 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.878068:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26790:17935:x1796714882526464:12345-192.168.202.24@tcp:101:dd.0 Request processed in 53us (112us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.878068:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.878069:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096ce73c0/0xdfc0fb148802c21 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963275 expref: 20692 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.878070:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a5d440/0xdfc0fb14868987d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32a3 expref: 26790 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.878072:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563569 00010000:00010000:1.0:1713481296.878076:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a5d440/0xdfc0fb14868987d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32a3 expref: 26790 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.878076:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c19cfc0/0xdfc0fb1488e7e76 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5548 expref: 16942 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.878079:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784556992:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.878085:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c19cfc0/0xdfc0fb1488e7e76 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5548 expref: 16942 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.878089:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a5d440/0xdfc0fb14868987d lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32a3 expref: 26789 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.878090:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb59480 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.878098:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.878098:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.878099:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.878101:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.878101:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784557056:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.878105:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.878110:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526528 00000100:00100000:0.0:1713481296.878112:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526528 00010000:00010000:1.0:1713481296.878116:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713481296.878117:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120147800/2, rc 0, transno 993532 00000100:00100000:0.0:1713481296.878137:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563571 00000100:00100000:2.0:1713481296.878137:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784552896:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.878139:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.878140:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20693:18792:x1796714882526528:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713481296.878143:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784557120:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.878144:0:15560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.878147:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124304d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.878151:0:15560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d09e1c0/0xdfc0fb148a3c190 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc52b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d74 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.878151:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26788:1958:x1796714882526208:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.878154:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820679 00000100:00100000:2.0:1713481296.878156:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1713481296.878159:0:15560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc52b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.878165:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.878166:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.878169:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d09e1c0/0xdfc0fb148a3c190 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d74 expref: 20694 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.878171:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784557120 00010000:00010000:0.0:1713481296.878174:0:15560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d09e1c0/0xdfc0fb148a3c190 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d74 expref: 20694 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.878174:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784557120 00010000:00010000:0.0:1713481296.878179:0:15560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d09e1c0, rc 0) 00000100:00100000:1.0:1713481296.878184:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563572 00000100:00100000:1.0:1713481296.878186:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+300:3491:x1796714784557120:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.878187:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880077a80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6919:1796714784554048:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.878188:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20694:18792:x1796714882526528:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 47us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.878191:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563571 00002000:00080000:1.0:1713481296.878194:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10107 count 1 00010000:00010000:1.0:1713481296.878201:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.878202:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.878206:0:16487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878208:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134503600/0xdfc0fb148802c28 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963283 expref: 20693 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.878210:0:16487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.878210:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008afef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784557248:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.878211:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20693:1959:x1796714882523648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7879us (7979us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.878212:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.878212:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.878214:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878215:0:16487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.878215:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820661 00010000:00010000:0.0:1713481296.878218:0:16487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878222:0:16487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878224:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134503600/0xdfc0fb148802c28 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963283 expref: 20693 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.878225:0:16487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079af3cc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.878227:0:16487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878230:0:16487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878230:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134503600/0xdfc0fb148802c28 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963283 expref: 20692 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.878233:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.878236:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784557312:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.878245:0:16487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878249:0:16487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079af3cc0/0xdfc0fb148a3bff3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.878250:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090876480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.878262:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526336 00000100:00100000:1.0:1713481296.878263:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526336 00000100:00100000:3.0:1713481296.878266:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784557248 00000100:00100000:2.0:1713481296.878270:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.878270:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784557248 00000100:00100000:1.0:1713481296.878274:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485927 00000100:00100000:2.0:1713481296.878275:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784557184:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.878277:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2066:18678:x1796714882526336:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:2.0:1713481296.878287:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.878290:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563573 00010000:00010000:1.0:1713481296.878292:0:15476:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1713481296.878294:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008afec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2885:3492:x1796714784557248:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.878302:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084b95200/0xdfc0fb148a3beb1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49c94 expref: 2066 pid: 15642 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.878307:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43578 count 1 00000100:00100000:2.0:1713481296.878311:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784557184 00000100:00100000:2.0:1713481296.878313:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784557184 00010000:00010000:1.0:1713481296.878316:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121aa3180/0xdfc0fb148a3adee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49731 expref: 2065 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.878319:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878324:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88008ad2f200) 00000100:00100000:2.0:1713481296.878324:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563574 00000100:00100000:2.0:1713481296.878327:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2886:3490:x1796714784557184:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.878329:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133df33c0/0xdfc0fb1486898a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32f7 expref: 26787 pid: 16535 timeout: 0 lvb_type: 1 00002000:00080000:2.0:1713481296.878335:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43576 count 1 00010000:00010000:1.0:1713481296.878336:0:15476:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.878336:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.878337:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.878340:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.878343:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.878347:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2886:3493:x1796714784553664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8463us (8498us total) trans 4295960829 rc 0/0 00010000:00010000:2.0:1713481296.878349:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc52f40/0xdfc0fb1486898a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32e9 expref: 26787 pid: 16490 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.878351:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563543 00010000:00010000:1.0:1713481296.878352:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 3/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.878353:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.878354:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.878356:0:15476:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 3/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.878356:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.878356:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133df33c0/0xdfc0fb1486898a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32f7 expref: 26787 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.878360:0:15476:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 3/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713481296.878365:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133df33c0/0xdfc0fb1486898a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32f7 expref: 26787 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.878366:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784557376:0@lo:101:mdt00_012.0 00010000:00010000:2.0:1713481296.878366:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc52f40/0xdfc0fb1486898a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32e9 expref: 26787 pid: 16490 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.878371:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc52f40/0xdfc0fb1486898a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32e9 expref: 26787 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.878377:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784557504:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.878380:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.878381:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.878381:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008afeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784557440:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.878388:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526592 00000100:00100000:0.0:1713481296.878389:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526592 00000100:00100000:1.0:1713481296.878391:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008323e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.878391:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb59180 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.878397:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784557376 00000100:00100000:0.0:1713481296.878398:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563575 00000100:00100000:1.0:1713481296.878398:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784557376 00000100:00100000:3.0:1713481296.878399:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801243043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.878401:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16943:17009:x1796714882526592:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.878405:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.878408:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82968 00000100:00100000:1.0:1713481296.878411:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+14:15476:x1796714784557376:12345-0@lo:101:mdt00_012.0 00010000:00010000:0.0:1713481296.878412:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322be1c0/0xdfc0fb148a3c1b3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xceaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d82 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878416:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1713481296.878418:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011e2bce00/2, rc 0, transno 993533 00002000:00010000:0.0:1713481296.878419:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xceaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.878421:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 2/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c1ac expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878429:0:15524:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2791 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878434:0:15524:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 4/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 15 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.878434:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784553664:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.878444:0:15524:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2791 pid: 15483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878448:0:15524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2791 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.878448:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.878453:0:15524:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec40e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000_UUID:15524:1796714784557568:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.878455:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.878462:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.878462:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.878464:0:15524:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008323e300 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.878468:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.878469:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008afec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784557632:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.878475:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.878480:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fde9d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.878483:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.878489:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.878490:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.878503:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.878509:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.878509:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007fde9d40/0xdfc0fb148a3bfa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.878518:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526720 00000100:00100000:1.0:1713481296.878520:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526720 00000100:00100000:3.0:1713481296.878520:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784557632 00000100:00100000:3.0:1713481296.878523:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784557632 00000100:00100000:1.0:1713481296.878531:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485928 00000100:00100000:1.0:1713481296.878534:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2167:18578:x1796714882526720:12345-192.168.202.24@tcp:36:rm.0 00000100:00100000:3.0:1713481296.878541:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563576 00000100:00100000:3.0:1713481296.878545:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008afedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2886:3492:x1796714784557632:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.878553:0:10467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00080000:3.0:1713481296.878556:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43580 count 1 00010000:00010000:1.0:1713481296.878561:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d4480/0xdfc0fb148a3c024 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d04 expref: 2167 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.878567:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878574:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121a70480/0xdfc0fb1489cbb31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x37cc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa202c2 expref: 2166 pid: 15482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.878579:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb1486898ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3305 expref: 26787 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.878585:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.878586:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37cc:0x0].0x0 (ffff8801224d2c00) 00010000:00010000:3.0:1713481296.878586:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.878589:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878599:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009606cb40/0xdfc0fb148a30ce0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x37c5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa43673 expref: 2165 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.878607:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb1486898ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3305 expref: 26787 pid: 16485 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.878611:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x0 (ffff8800919f3500) 00010000:00010000:1.0:1713481296.878613:0:10467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.878616:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb1486898ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3305 expref: 26787 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.878620:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.878623:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2887:3493:x1796714784552576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10524us (10556us total) trans 4295960830 rc 0/0 00010000:00010000:1.0:1713481296.878625:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.878628:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.878628:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563534 00000100:00100000:3.0:1713481296.878630:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008afee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784557696:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.878634:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d8c0/0xdfc0fb148a3c1cf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x37c5:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.878637:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d8c0/0xdfc0fb148a3c1cf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.878640:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d8c0/0xdfc0fb148a3c1cf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.878648:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6180 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.878683:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.878688:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.878691:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.878720:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.878721:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.878725:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322be1c0/0xdfc0fb148a3c1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d82 expref: 16944 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878732:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322be1c0/0xdfc0fb148a3c1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d82 expref: 16944 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.878740:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322be1c0, rc 0) 00000100:00100000:0.0:1713481296.878752:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16944:17009:x1796714882526592:12345-192.168.202.24@tcp:101:dd.0 Request processed in 350us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.878756:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563575 00000100:00100000:1.0:1713481296.878807:0:15512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_007:lustre-MDT0001_UUID:15512:1796714784554112:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.878821:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880091bf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784554688:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.878823:0:15512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.878833:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.878847:0:10467:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x12:0x0].14791, 64 off954816 00000004:00080000:2.0:1713481296.878847:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a86b800/2, rc 0, transno 993534 00000100:00100000:0.0:1713481296.878855:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.878861:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784552576:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.878870:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526848 00000100:00100000:1.0:1713481296.878872:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526848 00000100:00100000:2.0:1713481296.878874:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011e2bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784554304:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.878885:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.878885:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26116 00000100:00100000:1.0:1713481296.878888:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18978:x1796714882526848:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:2.0:1713481296.878891:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099e5ed00/0xdfc0fb148a3c09b lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d27 expref: 24485 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.878891:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.878898:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784557760:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.878900:0:15514:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.878901:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e5ed00, rc 0) 00010000:00010000:1.0:1713481296.878906:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35dd40/0xdfc0fb148a3c0b0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x34a4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d20 expref: 2065 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.878913:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24485:10479:x1796714882524928:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4575us (4855us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.878915:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.878917:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34a4:0x0].0x0 (ffff88008cf47d00) 00000100:00100000:2.0:1713481296.878917:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563548 00010000:00010000:1.0:1713481296.878924:0:15514:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.878924:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.878931:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784557760 00010000:00010000:1.0:1713481296.878932:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.878933:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784557760 00010000:00010000:1.0:1713481296.878937:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.878940:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.878946:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:1.0:1713481296.878949:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.878950:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563577 00010000:00010000:1.0:1713481296.878953:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.878953:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2887:3491:x1796714784557760:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.878959:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00002000:00080000:2.0:1713481296.878961:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43582 count 1 00010000:00010000:2.0:1713481296.878968:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878969:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 2/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.878973:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.878974:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 4/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.878975:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132fe7cc0/0xdfc0fb148689972 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3313 expref: 26787 pid: 16540 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.878979:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.878980:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.878981:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.878982:0:15514:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT1 00010000:00010000:2.0:1713481296.878991:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132fe7cc0/0xdfc0fb148689972 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3313 expref: 26787 pid: 16540 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.878994:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.878996:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132fe7cc0/0xdfc0fb148689972 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3313 expref: 26787 pid: 16540 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.879006:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880089a91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784557824:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.879016:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526912 00000100:00100000:2.0:1713481296.879016:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb59780 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.879019:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526912 00000100:00100000:2.0:1713481296.879032:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882526976 00000100:00100000:2.0:1713481296.879033:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882526976 00010000:00010000:1.0:1713481296.879036:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2065 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.879040:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099011680/0xdfc0fb148916dde lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65b5 expref: 24485 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.879052:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820680 00000100:00100000:1.0:1713481296.879055:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:1957:x1796714882526912:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.879055:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820681 00000100:00100000:2.0:1713481296.879058:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011faea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24485:1959:x1796714882526976:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.879060:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.879062:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.879063:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2065 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.879068:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2065 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.879072:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099011680/0xdfc0fb148916dde lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65b5 expref: 24485 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879076:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ffa0240/0xdfc0fb148a3bf21 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c6f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49cd3 expref: 2065 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.879080:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099011680/0xdfc0fb148916dde lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65b5 expref: 24485 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879086:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff880084b4fd00) 00010000:00010000:1.0:1713481296.879089:0:16580:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879092:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15512 initiator: MDT1 00010000:00010000:2.0:1713481296.879094:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099011680/0xdfc0fb148916dde lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x29be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65b5 expref: 24485 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879095:0:16580:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879104:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.879105:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.879106:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.879109:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e5ed00/0xdfc0fb148a3c09b lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d27 expref: 24484 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.879114:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:1957:x1796714882526912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (199us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.879117:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e5ed00/0xdfc0fb148a3c09b lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d27 expref: 24484 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.879132:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820680 00010000:00010000:2.0:1713481296.879147:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099e5ed00/0xdfc0fb148a3c09b lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x29be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d27 expref: 24484 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.879153:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784557888:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.879160:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527040 00000100:00100000:0.0:1713481296.879161:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.879162:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527040 00000100:00100000:2.0:1713481296.879164:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089b1d300 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.879173:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485929 00000100:00100000:1.0:1713481296.879176:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18930:x1796714882527040:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.879176:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527104 00000100:00100000:2.0:1713481296.879178:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527104 00010000:00010000:1.0:1713481296.879181:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.879185:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cdeac0/0xdfc0fb148802bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963221 expref: 20693 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879188:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013155eac0/0xdfc0fb148a3c1f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d89 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.879197:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820682 00000100:00100000:2.0:1713481296.879202:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20693:1957:x1796714882527104:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.879208:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.879212:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.879212:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cdeac0/0xdfc0fb148802bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2774:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963221 expref: 20693 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.879214:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784555520:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.879218:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.879220:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cdeac0/0xdfc0fb148802bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2774:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963221 expref: 20693 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879223:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879227:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879233:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.879233:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cdeac0/0xdfc0fb148802bf7 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2774:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963221 expref: 20693 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879239:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.879239:0:16503:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3c0e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d3c expref: 26787 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879242:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.879244:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.879245:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.879248:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.879249:0:16503:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124311f80, rc 0) 00010000:00010000:2.0:1713481296.879255:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.879263:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26787:11388:x1796714882525632:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3372us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.879268:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527232 00000100:00100000:0.0:1713481296.879270:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527232 00000100:00100000:3.0:1713481296.879270:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563556 00010000:00010000:1.0:1713481296.879271:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800980873c0/0xdfc0fb148a3c20e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.879274:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.879275:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800980873c0/0xdfc0fb148a3c20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879278:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800980873c0/0xdfc0fb148a3c20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000004:00200000:1.0:1713481296.879289:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51f4:0x0]: returning size 4096 00000100:00100000:2.0:1713481296.879289:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20692:1957:x1796714882527104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (128us total) trans 0 rc 0/0 00000004:00200000:1.0:1713481296.879291:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713481296.879296:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820682 00000004:00010000:1.0:1713481296.879298:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800980873c0/0xdfc0fb148a3c20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879303:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879306:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879309:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879312:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879314:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013155c900 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879316:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879319:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.879321:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125708 00010000:00010000:1.0:1713481296.879323:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000100:00100000:0.0:1713481296.879324:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18970:x1796714882527232:12345-192.168.202.24@tcp:35:lfs.0 00010000:00010000:1.0:1713481296.879325:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.879326:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879329:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013155c900/0xdfc0fb148a3c200 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.879331:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085cac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784555648:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.879339:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879342:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879345:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879347:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013155d200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879349:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879352:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879355:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3431 (ffff8800999bd000) 00010000:00010000:2.0:1713481296.879355:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3c0e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d43 expref: 26786 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879356:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.879357:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.879360:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013155d200/0xdfc0fb148a3c207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.879365:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737af600, rc 0) 00000100:00100000:2.0:1713481296.879378:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26786:11552:x1796714882525824:12345-192.168.202.24@tcp:101:dd.0 Request processed in 3447us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.879384:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563557 00010000:00010000:1.0:1713481296.879396:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013155eac0/0xdfc0fb148a3c1f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d89 expref: 2794 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879408:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800980873c0/0xdfc0fb148a3c20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d89 expref: 2793 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879412:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff8800999bd800) 00010000:00010000:1.0:1713481296.879413:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1713481296.879414:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800980873c0, rc 0) 00000100:00100000:1.0:1713481296.879425:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18930:x1796714882527040:12345-192.168.202.24@tcp:101:dd.0 Request processed in 248us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.879428:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485929 00000100:00100000:0.0:1713481296.879439:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18970:x1796714882527232:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 112us (225us total) trans 4295107632 rc 0/0 00010000:00010000:1.0:1713481296.879444:0:15512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.879446:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125708 00010000:00010000:1.0:1713481296.879448:0:15512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879469:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.879477:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879481:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879482:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879484:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879485:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879487:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879489:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879490:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35c000 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879491:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879492:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa15d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.879494:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879496:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879497:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879501:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff880084b4fd00) 00010000:00010000:1.0:1713481296.879502:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.879504:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879505:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879507:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c000/0xdfc0fb148a3c07f lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:0.0:1713481296.879509:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c0a9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879523:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879526:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879529:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879531:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35c480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879532:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879535:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879539:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c7b:0x0].0x0 (ffff880124ba5000) 00010000:00010000:1.0:1713481296.879540:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.879541:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879543:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c480/0xdfc0fb148a3c078 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c7b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879563:0:15512:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879566:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879569:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879572:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879574:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f15aac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879576:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879578:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879581:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.879582:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.879584:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879586:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f15aac0/0xdfc0fb148a3c063 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879595:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879597:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879600:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879603:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35cfc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879604:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879607:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879610:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff880124ba5500) 00010000:00010000:1.0:1713481296.879611:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.879612:0:15512:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879616:0:15512:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879618:0:15512:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879632:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879635:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35cfc0/0xdfc0fb148a3c06a lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879641:0:15512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879643:0:15512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.879646:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+301:3493:x1796714784554432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5093us (5167us total) trans 4296040964 rc 0/0 00010000:00010000:1.0:1713481296.879646:0:15512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879648:0:15512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35c240 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879650:0:15512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15512 initiator: MDT1 00000100:00100000:0.0:1713481296.879652:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563549 00010000:00010000:1.0:1713481296.879653:0:15512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879657:0:15512:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff880124ba5f00) 00010000:00010000:1.0:1713481296.879658:0:15512:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.879659:0:15512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00010000:00010000:1.0:1713481296.879678:0:15512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011e35c240/0xdfc0fb148a3c071 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15512 initiator: MDT1 00000004:00080000:2.0:1713481296.879679:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081e37800/2, rc 0, transno 1073668 00000100:00100000:2.0:1713481296.879685:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784554432:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.879699:0:15512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880076a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2391:18955:x1796714882524864:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 5922us (5966us total) trans 0 rc -39/-39 00000100:00100000:1.0:1713481296.879703:0:15512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26115 00000100:00100000:0.0:1713481296.879707:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.879715:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527296 00000100:00100000:0.0:1713481296.879717:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527296 00000100:00100000:2.0:1713481296.879717:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.879722:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784557952:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.879728:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563578 00000100:00100000:0.0:1713481296.879731:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011faebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20692:14753:x1796714882527296:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.879736:0:16495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.879736:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.879737:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879740:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:0.0:1713481296.879742:0:16495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322bfa80/0xdfc0fb148a3c215 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d90 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.879751:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820f6f40/0xdfc0fb148a13f34 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38034 expref: 20693 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.879752:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784557952 00000100:00100000:2.0:1713481296.879754:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784557952 00010000:00010000:0.0:1713481296.879755:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.879756:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.879758:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322bfa80/0xdfc0fb148a3c215 lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d90 expref: 20693 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.879767:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820f6f40/0xdfc0fb148a13f34 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38034 expref: 20693 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.879771:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563579 00010000:00010000:0.0:1713481296.879772:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820f6f40/0xdfc0fb148a13f34 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38034 expref: 20693 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879775:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00000100:00100000:2.0:1713481296.879775:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+301:3490:x1796714784557952:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.879777:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011fae9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784558016:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.879779:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879783:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00002000:00080000:2.0:1713481296.879784:0:15510:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10108 count 1 00000100:00100000:0.0:1713481296.879788:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff513c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.879789:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15514 initiator: MDT0 00010000:00010000:2.0:1713481296.879793:0:15510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.879795:0:15514:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879798:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.879800:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d44b40/0xdfc0fb148802c2f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x277c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963291 expref: 20693 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.879804:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.879804:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.879806:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 4/0,1 mode: --/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.879815:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d44b40/0xdfc0fb148802c2f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963291 expref: 20693 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.879818:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.879820:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d44b40/0xdfc0fb148802c2f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963291 expref: 20693 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.879821:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879824:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.879825:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784558080:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.879826:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098087cc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879828:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879830:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879834:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c6f:0x0].0x0 (ffff88009e0ded00) 00010000:00010000:1.0:1713481296.879835:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.879837:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879839:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098087cc0/0xdfc0fb148a3c223 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879849:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.879852:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a540 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.879853:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879858:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879862:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098086640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879864:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.879867:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784555840:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.879869:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.879873:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784555968:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.879875:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34a4:0x0].0x0 (ffff8800999bd200) 00010000:00010000:1.0:1713481296.879877:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1713481296.879879:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879884:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098086640/0xdfc0fb148a3c21c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34a4:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.879885:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.879886:0:16488:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3c112 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d4a expref: 16943 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.879893:0:16488:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081ca5440, rc 0) 00010000:00010000:1.0:1713481296.879898:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879903:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.879905:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16943:18836:x1796714882525888:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 3436us (3484us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.879908:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.879910:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563559 00010000:00010000:1.0:1713481296.879912:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d04c480 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879914:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879919:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879928:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff880124ba5500) 00010000:00010000:1.0:1713481296.879929:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.879931:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879935:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c1eb lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879957:0:15514:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879962:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.879964:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.879967:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879972:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879975:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d04cfc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.879978:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879983:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.879989:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.879991:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.879993:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00000100:00100000:0.0:1713481296.879996:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.879997:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c1dd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.880008:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.880008:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527360 00000100:00100000:2.0:1713481296.880011:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527360 00010000:00010000:1.0:1713481296.880013:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.880018:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.880019:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0xdfc0fb14894242e lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f0 expref: 24485 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.880021:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d04f600 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.880022:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.880025:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15514 initiator: MDT1 00000100:00100000:2.0:1713481296.880028:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527488 00010000:00010000:1.0:1713481296.880029:0:15514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff8800999bd100) 00000100:00100000:2.0:1713481296.880029:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527488 00000100:00100000:0.0:1713481296.880030:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.880030:0:15514:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.880031:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:1.0:1713481296.880034:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011d04f600/0xdfc0fb148a3c1e4 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15514 initiator: MDT1 00010000:00010000:2.0:1713481296.880034:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be19b00/0xdfc0fb148802c0c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96324b expref: 20694 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.880041:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527424 00000100:00100000:2.0:1713481296.880042:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527424 00010000:00010000:2.0:1713481296.880047:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e096ac0/0xdfc0fb14895a057 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecda expref: 26786 pid: 15510 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.880054:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820683 00000100:00100000:2.0:1713481296.880057:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24485:1960:x1796714882527360:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.880060:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.880061:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18978:x1796714882526848:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 1172us (1205us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713481296.880061:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.880063:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0xdfc0fb14894242e lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f0 expref: 24485 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.880066:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26116 00010000:00010000:2.0:1713481296.880068:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0xdfc0fb14894242e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f0 expref: 24485 pid: 16544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.880074:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527552 00000100:00100000:0.0:1713481296.880076:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527552 00010000:00010000:2.0:1713481296.880078:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0xdfc0fb14894242e lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f0 expref: 24485 pid: 16544 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.880084:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880085:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.880087:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133aa2640/0xdfc0fb14891f93d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cbed9 expref: 20695 pid: 16526 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.880087:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3c0e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d3c expref: 26786 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880095:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3c0e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d3c expref: 26786 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880101:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820684 00000100:00100000:0.0:1713481296.880105:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820685 00000100:00100000:1.0:1713481296.880105:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011faead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20695:1960:x1796714882527488:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.880106:0:15497:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880124311f80/0xdfc0fb148a3c0e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x7a89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d3c expref: 26786 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.880110:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26786:1960:x1796714882527424:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.880110:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.880111:0:15497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072ab6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15497:1796714784558144:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.880114:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be19b00/0xdfc0fb148802c0c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2777:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96324b expref: 20695 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.880116:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.880142:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be19b00/0xdfc0fb148802c0c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2777:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96324b expref: 20695 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.880144:0:15497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5aa80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.880146:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e096ac0/0xdfc0fb14895a057 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecda expref: 26786 pid: 15510 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.880156:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e096ac0/0xdfc0fb14895a057 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecda expref: 26786 pid: 15510 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.880157:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be19b00/0xdfc0fb148802c0c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2777:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96324b expref: 20695 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.880157:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820686 00000100:00100000:2.0:1713481296.880160:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20695:1960:x1796714882527552:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.880165:0:15529:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.880168:0:15529:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133aa2640/0xdfc0fb14891f93d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cbed9 expref: 20694 pid: 16526 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.880171:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.880172:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880173:0:15529:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133aa2640/0xdfc0fb14891f93d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cbed9 expref: 20694 pid: 16526 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.880174:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e096ac0/0xdfc0fb14895a057 lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecda expref: 26786 pid: 15510 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.880174:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880180:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880183:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.880184:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880185:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133aa2640/0xdfc0fb14891f93d lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cbed9 expref: 20694 pid: 16526 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.880187:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3c0e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d43 expref: 26785 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880194:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3c0e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d43 expref: 26785 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880194:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880195:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880197:0:15529:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3c112 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d4a expref: 16942 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880198:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.880205:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3c112 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d4a expref: 16942 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880211:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800737af600/0xdfc0fb148a3c0e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x82d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d43 expref: 26785 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880212:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011faead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20693:1960:x1796714882527488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 105us (215us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.880215:0:15529:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880081ca5440/0xdfc0fb148a3c112 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8066:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d4a expref: 16942 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880218:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820684 00000100:00100000:2.0:1713481296.880220:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072ab5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784558272:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.880221:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121e9dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784558208:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.880230:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a600 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.880235:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098098300 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.880241:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1713481296.880244:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040947 00010000:00010000:2.0:1713481296.880246:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880250:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880254:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880257:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880260:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fe073c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.880261:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.880262:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880267:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.880267:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880274:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.880275:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880279:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fe073c0/0xdfc0fb148a3c104 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880283:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880287:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880292:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880297:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880301:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098084000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.880304:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880308:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880314:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37cc:0x0].0x0 (ffff8800999bde00) 00002000:00080000:3.0:1713481296.880314:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57810 00010000:00010000:1.0:1713481296.880316:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1713481296.880319:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 3/0,0 mode: --/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880323:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098084000/0xdfc0fb148a3c231 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x37cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880340:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880345:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880349:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880354:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d04cb40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.880356:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.880357:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.880360:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880365:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37cc:0x0].0x0 (ffff8800999bde00) 00010000:00010000:1.0:1713481296.880367:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.880369:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880372:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04cb40/0xdfc0fb148a3c1d6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x37cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.880374:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527680 00000100:00100000:0.0:1713481296.880378:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527680 00000100:00100000:2.0:1713481296.880383:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+303:3493:x1796714784555776:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4070us (4107us total) trans 4296040966 rc 0/0 00000100:00100000:2.0:1713481296.880387:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563558 00000100:00100000:0.0:1713481296.880393:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125709 00000100:00100000:0.0:1713481296.880397:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18805:x1796714882527680:12345-192.168.202.24@tcp:35:dir_create.sh.0 00000004:00080000:2.0:1713481296.880411:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085cadf80/2, rc 0, transno 1073670 00000100:00100000:2.0:1713481296.880414:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784555776:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.880441:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713481296.880445:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784558336:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.880460:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.880464:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880468:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880471:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880473:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.880474:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784558336 00000100:00100000:2.0:1713481296.880475:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784558336 00010000:00010000:1.0:1713481296.880476:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d04fa80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.880477:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880480:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000100:00100000:2.0:1713481296.880485:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563580 00010000:00010000:1.0:1713481296.880487:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x0 (ffff8800919f3500) 00010000:00010000:1.0:1713481296.880488:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.880488:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+303:3493:x1796714784558336:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.880490:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880493:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04fa80/0xdfc0fb148a3c1c8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x37c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00002000:00080000:2.0:1713481296.880495:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10109 count 1 00000100:00100000:0.0:1713481296.880498:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18805:x1796714882527680:12345-192.168.202.24@tcp:35:dir_create.sh.0 Request processed in 100us (141us total) trans 4295107633 rc 0/0 00000004:00010000:1.0:1713481296.880499:0:10467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88011ec42680 reply state ffff8800922f0000 transno 4295105928 ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d8c0/0xdfc0fb148a3c1cf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.880503:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125709 00010000:00010000:2.0:1713481296.880503:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880504:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d8c0/0xdfc0fb148a3c1cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x37c5:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.880507:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x3931 (ffff8800999bd500) 00010000:00010000:1.0:1713481296.880509:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.880510:0:10467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713481296.880510:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f159f80/0xdfc0fb148802c36 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96329f expref: 20692 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.880514:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880515:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880517:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880525:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2166:18578:x1796714882526720:12345-192.168.202.24@tcp:36:rm.0 Request processed in 1990us (2015us total) trans 4295105928 rc 0/0 00010000:00010000:2.0:1713481296.880526:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f159f80/0xdfc0fb148802c36 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96329f expref: 20692 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.880529:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485928 00010000:00010000:2.0:1713481296.880531:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f159f80/0xdfc0fb148802c36 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96329f expref: 20692 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.880536:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784558400:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.880545:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.880558:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784555072:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.880560:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085caf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784555008:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.880570:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c2fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784555136:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.880574:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880579:0:16497:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e5f180/0xdfc0fb148a3c0b7 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d2e expref: 16942 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880586:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880586:0:16497:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e5f180, rc 0) 00000100:00100000:2.0:1713481296.880593:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16942:18817:x1796714882524992:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 5160us (5528us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.880597:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563551 00000100:00100000:3.0:1713481296.880628:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784555200:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.880638:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013609dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784555264:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.880646:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880651:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880681:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120246a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784555392:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.880687:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078079500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784555456:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.880691:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.880703:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527744 00000100:00100000:0.0:1713481296.880705:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527744 00010000:00010000:1.0:1713481296.880706:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800736a06c0/0xdfc0fb148a3c0da lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d35 expref: 24484 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880713:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800978c5d40/0xdfc0fb1489d0242 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa224fe expref: 20693 pid: 16531 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.880716:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800736a06c0, rc 0) 00000100:00100000:0.0:1713481296.880724:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820687 00000100:00100000:0.0:1713481296.880727:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20693:1960:x1796714882527744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.880729:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:10409:x1796714882525568:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4969us (5065us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.880731:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.880733:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800978c5d40/0xdfc0fb1489d0242 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa224fe expref: 20693 pid: 16531 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.880736:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563555 00010000:00010000:0.0:1713481296.880739:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800978c5d40/0xdfc0fb1489d0242 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa224fe expref: 20693 pid: 16531 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.880750:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800978c5d40/0xdfc0fb1489d0242 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa224fe expref: 20693 pid: 16531 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.880758:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.880759:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.880761:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099e5f180/0xdfc0fb148a3c0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d2e expref: 16941 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880769:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e5f180/0xdfc0fb148a3c0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d2e expref: 16941 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880776:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.880780:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099e5f180/0xdfc0fb148a3c0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d2e expref: 16941 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.880785:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784558464:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.880789:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528000 00000100:00100000:2.0:1713481296.880791:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528000 00010000:00010000:2.0:1713481296.880799:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135af5440/0xdfc0fb14893ac86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ff expref: 26786 pid: 16474 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.880802:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.880804:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098c3e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.880817:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527872 00000100:00100000:2.0:1713481296.880818:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527872 00010000:00010000:2.0:1713481296.880823:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e9680/0xdfc0fb148689884 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32b1 expref: 26787 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.880824:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820688 00000100:00100000:1.0:1713481296.880829:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26787:1960:x1796714882528000:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.880832:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820689 00000100:00100000:2.0:1713481296.880835:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26787:1960:x1796714882527872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.880836:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.880840:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.880841:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135af5440/0xdfc0fb14893ac86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ff expref: 26787 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.880842:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e9680/0xdfc0fb148689884 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32b1 expref: 26787 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.880848:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e9680/0xdfc0fb148689884 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32b1 expref: 26787 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.880850:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135af5440/0xdfc0fb14893ac86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ff expref: 26787 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.880857:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9680/0xdfc0fb148689884 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32b1 expref: 26787 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.880862:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135af5440/0xdfc0fb14893ac86 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db4ff expref: 26786 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.880863:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880864:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.880866:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.880870:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.880876:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.880885:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26785:1960:x1796714882528000:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 57us (110us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.880888:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880889:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820688 00010000:00010000:2.0:1713481296.880889:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.880896:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.880900:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26785:1960:x1796714882527872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.880903:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.880904:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820689 00010000:00010000:0.0:1713481296.880909:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880915:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880918:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.880920:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081ca4b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.880922:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.880929:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880930:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.880930:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527808 00000100:00100000:2.0:1713481296.880932:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527808 00010000:00010000:2.0:1713481296.880938:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800836f5680/0xdfc0fb148802bfe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96322f expref: 20693 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.880941:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.880944:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.880945:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081ca4b40/0xdfc0fb148a3c0c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.880951:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528064 00000100:00100000:2.0:1713481296.880953:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528064 00000100:00100000:1.0:1713481296.880956:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882527936 00000100:00100000:1.0:1713481296.880959:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882527936 00010000:00010000:2.0:1713481296.880961:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134501200/0xdfc0fb148802c05 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96323d expref: 20694 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.880970:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880078778d80/0xdfc0fb14868988b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32bf expref: 26784 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.880975:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820690 00000100:00100000:2.0:1713481296.880979:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20694:1957:x1796714882527808:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.880984:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.880985:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820691 00010000:00010000:2.0:1713481296.880988:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800836f5680/0xdfc0fb148802bfe lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2775:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96322f expref: 20694 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.880989:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20694:1957:x1796714882528064:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.880995:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.880996:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800836f5680/0xdfc0fb148802bfe lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2775:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96322f expref: 20694 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.880999:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134501200/0xdfc0fb148802c05 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96323d expref: 20694 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.881007:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134501200/0xdfc0fb148802c05 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96323d expref: 20694 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.881012:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800836f5680/0xdfc0fb148802bfe lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2775:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96322f expref: 20694 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.881022:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881023:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.881025:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134501200/0xdfc0fb148802c05 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96323d expref: 20693 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.881025:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881029:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881040:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.881041:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881041:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.881043:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881048:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881050:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20692:1957:x1796714882527808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.881053:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820690 00000100:00100000:2.0:1713481296.881065:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820692 00010000:00010000:1.0:1713481296.881068:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.881068:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26784:1957:x1796714882527936:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.881073:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.881073:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881076:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880078778d80/0xdfc0fb14868988b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32bf expref: 26784 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.881079:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20691:1957:x1796714882528064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 90us (148us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.881081:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880078778d80/0xdfc0fb14868988b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32bf expref: 26784 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.881082:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.881083:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820691 00010000:00010000:2.0:1713481296.881092:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880078778d80/0xdfc0fb14868988b lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32bf expref: 26784 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.881093:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880089a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2888:3492:x1796714784554816:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5652us (5976us total) trans 4295960831 rc 0/0 00010000:00010000:3.0:1713481296.881094:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.881099:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563552 00010000:00010000:3.0:1713481296.881100:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881101:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881101:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881102:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881103:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881106:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881108:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881108:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881110:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881114:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881114:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b090000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.881117:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.881132:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881137:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e35df80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.881137:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881139:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881143:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26783:1957:x1796714882527936:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (198us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.881144:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881146:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881147:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820692 00010000:00010000:1.0:1713481296.881159:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881159:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.881164:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.881165:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e35df80/0xdfc0fb148a3c0be lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881166:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b090000/0xdfc0fb148a3c0cc lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881176:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528128 00000100:00100000:2.0:1713481296.881178:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528128 00010000:00010000:2.0:1713481296.881185:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880079b88b40/0xdfc0fb14891d17b lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca732 expref: 24484 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.881193:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820693 00000100:00100000:2.0:1713481296.881196:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1957:x1796714882528128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.881200:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.881202:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880079b88b40/0xdfc0fb14891d17b lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca732 expref: 24484 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.881207:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.881207:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880079b88b40/0xdfc0fb14891d17b lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca732 expref: 24484 pid: 16533 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.881218:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079b88b40/0xdfc0fb14891d17b lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca732 expref: 24484 pid: 16533 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.881223:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528192 00000100:00100000:0.0:1713481296.881226:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528192 00010000:00010000:2.0:1713481296.881227:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881228:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881230:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800736a06c0/0xdfc0fb148a3c0da lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d35 expref: 24483 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881237:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800736a06c0/0xdfc0fb148a3c0da lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d35 expref: 24483 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.881242:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563581 00000004:00080000:3.0:1713481296.881242:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007841c000/2, rc 0, transno 993535 00000100:00100000:0.0:1713481296.881247:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26783:18811:x1796714882528192:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.881247:0:14813:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800736a06c0/0xdfc0fb148a3c0da lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d35 expref: 24483 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.881250:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007841c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784554816:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.881253:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.881253:0:14813:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d34a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784558528:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.881263:0:14813:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.881264:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322bf840/0xdfc0fb148a3c23f lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xba53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d97 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.881275:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xba53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.881284:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.881286:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.881293:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+305:3492:x1796714784554752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5863us (6425us total) trans 4296040967 rc 0/0 00000100:00100000:2.0:1713481296.881293:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784558592:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.881294:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322bf840/0xdfc0fb148a3c23f lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xba53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d97 expref: 26784 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.881297:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563550 00010000:00010000:0.0:1713481296.881303:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322bf840/0xdfc0fb148a3c23f lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xba53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d97 expref: 26784 pid: 16515 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.881304:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081e34a80/2, rc 0, transno 1073671 00000100:00100000:2.0:1713481296.881307:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.881309:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322bf840, rc 0) 00000100:00100000:3.0:1713481296.881312:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784554752:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.881314:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784558592 00000100:00100000:1.0:1713481296.881316:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784558592 00000100:00100000:1.0:1713481296.881326:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563582 00000100:00100000:1.0:1713481296.881329:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2888:3493:x1796714784558592:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.881330:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26784:18811:x1796714882528192:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 83us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.881335:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563581 00002000:00080000:1.0:1713481296.881337:0:16509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43584 count 1 00010000:00010000:1.0:1713481296.881345:0:16509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881352:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133df3a80/0xdfc0fb1486898b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3321 expref: 26783 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.881356:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.881357:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.881358:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881363:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784558656:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.881369:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133df3a80/0xdfc0fb1486898b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3321 expref: 26783 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.881374:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133df3a80/0xdfc0fb1486898b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3321 expref: 26783 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.881380:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012062e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784558720:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.881383:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.881391:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086caed80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.881401:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881405:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881409:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881412:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784558656 00010000:00010000:1.0:1713481296.881413:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881415:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784558656 00010000:00010000:1.0:1713481296.881416:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881419:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800736a1d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.881421:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881425:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.881434:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.881435:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+305:3490:x1796714784554880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5948us (6094us total) trans 4296040968 rc 0/0 00010000:00010000:1.0:1713481296.881437:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800736a1d40/0xdfc0fb148a3c0d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881442:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563583 00000100:00100000:3.0:1713481296.881446:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563553 00000100:00100000:2.0:1713481296.881447:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+305:3490:x1796714784558656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.881459:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10110 count 1 00000100:00100000:0.0:1713481296.881465:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.881470:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881480:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096ce6ac0/0xdfc0fb148802c3d lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632ad expref: 20690 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.881486:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881488:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881490:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 4/0,1 mode: --/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.881500:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784556224:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.881507:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096ce6ac0/0xdfc0fb148802c3d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632ad expref: 20690 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.881515:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096ce6ac0/0xdfc0fb148802c3d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632ad expref: 20690 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.881521:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784556608:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.881524:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784558784:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.881527:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.881539:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881541:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a900 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.881543:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2889:3491:x1796714784554944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6019us (6161us total) trans 4295960832 rc 0/0 00000100:00100000:1.0:1713481296.881547:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563554 00000100:00100000:3.0:1713481296.881553:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784556416:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.881556:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528256 00000100:00100000:2.0:1713481296.881558:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528256 00010000:00010000:2.0:1713481296.881567:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cdfcc0/0xdfc0fb148802c13 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963259 expref: 20691 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.881572:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881578:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820694 00000100:00100000:2.0:1713481296.881581:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20691:1960:x1796714882528256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.881584:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.881586:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cdfcc0/0xdfc0fb148802c13 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2778:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963259 expref: 20691 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.881592:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cdfcc0/0xdfc0fb148802c13 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2778:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963259 expref: 20691 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:3.0:1713481296.881598:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0f1500/2, rc 0, transno 993536 00010000:00010000:2.0:1713481296.881605:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cdfcc0/0xdfc0fb148802c13 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2778:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963259 expref: 20691 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.881605:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784554944:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.881615:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881616:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.881618:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881622:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.881637:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.881640:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784558848:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.881648:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20690:1960:x1796714882528256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 66us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.881651:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820694 00000100:00100000:1.0:1713481296.881660:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120146d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0001_UUID:15793:1796714784556672:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.881679:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.881691:0:15793:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000004:00080000:2.0:1713481296.881696:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0f0380/2, rc 0, transno 1073672 00000100:00100000:2.0:1713481296.881701:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784554880:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.881710:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784558848 00000100:00100000:0.0:1713481296.881714:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784558848 00010000:00010000:3.0:1713481296.881720:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.881724:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784558912:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.881728:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.881733:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563584 00010000:00010000:3.0:1713481296.881735:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.881737:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2889:3491:x1796714784558848:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.881740:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.881742:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.881748:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43586 count 1 00010000:00010000:3.0:1713481296.881750:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881756:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124310000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.881758:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881759:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881767:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.881768:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800733dbcc0/0xdfc0fb1486898bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d332f expref: 26783 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.881774:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.881776:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.881779:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881781:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.881787:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c120 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.881794:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800733dbcc0/0xdfc0fb1486898bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d332f expref: 26783 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.881802:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800733dbcc0/0xdfc0fb1486898bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d332f expref: 26783 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.881811:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800755a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784558976:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.881827:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.881840:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784558912 00000100:00100000:0.0:1713481296.881843:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784558912 00000100:00100000:0.0:1713481296.881860:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563585 00000100:00100000:0.0:1713481296.881864:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+306:3492:x1796714784558912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.881875:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10111 count 1 00010000:00010000:0.0:1713481296.881884:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.881893:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801345006c0/0xdfc0fb148802c44 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632bb expref: 20689 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.881899:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.881900:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.881902:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.881918:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801345006c0/0xdfc0fb148802c44 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632bb expref: 20689 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.881927:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801345006c0/0xdfc0fb148802c44 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632bb expref: 20689 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.881935:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094068380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784559040:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.881942:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:lustre-MDT0001-mdtlov_UUID+306:3492:x1796714784556032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5223us (5303us total) trans 4296040969 rc 0/0 00000004:00080000:2.0:1713481296.881944:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076a49180/2, rc 0, transno 1073673 00000100:00100000:2.0:1713481296.881948:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880076a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784556032:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.881950:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563561 00000100:00100000:2.0:1713481296.881964:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.881968:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784559104:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.881969:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091cedc00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.881979:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.881995:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559104 00000100:00100000:0.0:1713481296.881998:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559104 00000100:00100000:0.0:1713481296.882016:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563586 00000100:00100000:0.0:1713481296.882020:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+306:3492:x1796714784559104:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.882030:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10112 count 1 00010000:00010000:0.0:1713481296.882039:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.882048:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d44480/0xdfc0fb148802c4b lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632c9 expref: 20689 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.882054:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.882055:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.882057:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.882177:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d44480/0xdfc0fb148802c4b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632c9 expref: 20689 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.882185:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d44480/0xdfc0fb148802c4b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632c9 expref: 20689 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.882199:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094069880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784559168:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.882219:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091872c00 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.882232:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.882269:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.882271:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528384 00000100:00100000:2.0:1713481296.882274:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528384 00000100:00100000:2.0:1713481296.882294:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563587 00000100:00100000:2.0:1713481296.882297:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16942:18844:x1796714882528384:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.882303:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.882311:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801207aef40/0xdfc0fb148a3c269 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49d9e expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.882320:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.882327:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.882328:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.882331:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801207aef40/0xdfc0fb148a3c269 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d9e expref: 16943 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882336:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801207aef40/0xdfc0fb148a3c269 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d9e expref: 16943 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882341:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207aef40, rc 0) 00000100:00100000:2.0:1713481296.882357:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16943:18844:x1796714882528384:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 58us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.882361:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563587 00000100:00100000:2.0:1713481296.882378:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528448 00000100:00100000:2.0:1713481296.882380:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528448 00010000:00010000:2.0:1713481296.882386:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e9200/0xdfc0fb148689899 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32db expref: 26784 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.882403:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820695 00000100:00100000:2.0:1713481296.882406:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009406b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26784:1959:x1796714882528448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.882409:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.882412:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e9200/0xdfc0fb148689899 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32db expref: 26784 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.882418:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e9200/0xdfc0fb148689899 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32db expref: 26784 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.882427:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e9200/0xdfc0fb148689899 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32db expref: 26784 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.882431:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.882433:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.882434:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.882436:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882440:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.882444:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.882445:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528320 00000100:00100000:0.0:1713481296.882448:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528320 00010000:00010000:2.0:1713481296.882453:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.882462:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800733d9b00/0xdfc0fb148689892 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32cd expref: 26784 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.882465:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009406b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26784:1959:x1796714882528448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.882469:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820695 00000100:00100000:2.0:1713481296.882478:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528512 00000100:00100000:2.0:1713481296.882479:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528512 00000100:00100000:0.0:1713481296.882481:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820696 00000100:00100000:0.0:1713481296.882485:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26783:1959:x1796714882528320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.882485:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.882491:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.882495:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800733d9b00/0xdfc0fb148689892 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32cd expref: 26783 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.882500:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820697 00010000:00010000:0.0:1713481296.882503:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800733d9b00/0xdfc0fb148689892 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32cd expref: 26783 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.882503:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2391:1959:x1796714882528512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.882507:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.882510:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.882515:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.882519:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800733d9b00/0xdfc0fb148689892 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32cd expref: 26783 pid: 16545 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.882522:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.882522:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092f86400/0xdfc0fb148a3b84b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49a79 expref: 2391 pid: 15475 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.882529:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.882531:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.882534:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882535:0:16520:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880084aad100) 00010000:00010000:2.0:1713481296.882537:0:16520:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.882541:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.882545:0:16520:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.882546:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882556:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.882567:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012062ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2390:1959:x1796714882528512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 63us (122us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.882570:0:15793:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.882571:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820697 00010000:00010000:0.0:1713481296.882573:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.882574:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:3.0:1713481296.882578:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.882585:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528576 00000100:00100000:2.0:1713481296.882586:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528576 00010000:00010000:3.0:1713481296.882586:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.882592:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26782:1959:x1796714882528320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 105us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.882594:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.882596:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563588 00000100:00100000:0.0:1713481296.882598:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820696 00000100:00100000:2.0:1713481296.882598:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:15045:x1796714882528576:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.882602:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882603:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.882609:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882610:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207ad200/0xdfc0fb148a3c270 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49da5 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.882615:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d3f8480 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.882618:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882619:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00002000:00010000:2.0:1713481296.882621:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.882624:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882625:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.882626:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882626:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.882627:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.882629:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.882630:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207ad200/0xdfc0fb148a3c270 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49da5 expref: 24485 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882631:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800992cdf80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.882633:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882633:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.882636:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.882636:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801207ad200/0xdfc0fb148a3c270 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49da5 expref: 24485 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.882638:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.882640:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882640:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801207ad200, rc 0) 00010000:00010000:1.0:1713481296.882641:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880084aad100) 00010000:00010000:1.0:1713481296.882643:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.882644:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:3.0:1713481296.882645:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c127 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.882646:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882647:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800992cdf80/0xdfc0fb148a3c15f lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000100:00100000:2.0:1713481296.882650:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24485:15045:x1796714882528576:12345-192.168.202.24@tcp:101:dd.0 Request processed in 51us (128us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.882652:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.882654:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563588 00010000:00010000:0.0:1713481296.882658:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b091680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.882660:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.882684:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882685:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882690:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882693:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.882696:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.882702:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b091680/0xdfc0fb148a3c151 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882702:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713481296.882704:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882707:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.882709:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882711:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882713:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882715:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800992cf180 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.882718:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713481296.882718:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882720:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00000004:00010000:2.0:1713481296.882722:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882723:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.882726:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.882729:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007da106c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.882730:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.882733:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.882737:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d7:0x0].0x0 (ffff880122a33900) 00010000:00010000:2.0:1713481296.882737:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882739:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1713481296.882740:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.882743:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007da106c0/0xdfc0fb148a3c13c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.882743:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.882750:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 1/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.882753:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:2.0:1713481296.882754:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cf180/0xdfc0fb148a3c14a lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c158 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882756:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882760:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882763:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882768:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1713481296.882769:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:2.0:1713481296.882769:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1713481296.882771:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882771:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882774:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882774:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095d698c0 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.882776:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882778:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.882780:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882783:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1713481296.882785:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882786:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882789:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882789:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.882791:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 1/0,0 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882792:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882795:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d698c0/0xdfc0fb148a3c12e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c135 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882796:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1713481296.882808:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1713481296.882811:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882814:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079bcaf40 already unused, calling callback (ffffffffa0efd520) 00000100:00100000:1.0:1713481296.882816:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013620ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18948:x1796714882522560:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 17947us (17995us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713481296.882816:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.882818:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880077a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+2891:3490:x1796714784556096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5950us (6036us total) trans 4295960833 rc 0/0 00000004:00010000:2.0:1713481296.882819:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.882820:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26114 00010000:00010000:2.0:1713481296.882825:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.882826:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563562 00010000:00010000:2.0:1713481296.882828:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.882832:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882835:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880079bcaf40/0xdfc0fb148a3c0ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c0f6 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882849:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1713481296.882851:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882854:0:15565:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713481296.882854:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095d68480 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:2.0:1713481296.882856:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882857:0:15565:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713481296.882859:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882860:0:15565:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011f9cf600 already unused, calling callback (ffffffffa0efd520) 00000100:00100000:0.0:1713481296.882861:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2890:3491:x1796714784556480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5755us (5827us total) trans 4295960834 rc 0/0 00010000:00010000:1.0:1713481296.882862:0:15565:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.882866:0:15565:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.882868:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563564 00010000:00010000:2.0:1713481296.882868:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882871:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713481296.882873:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882876:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880095d68480/0xdfc0fb148a3c0fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c10b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882877:0:15565:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882880:0:15565:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.882884:0:15565:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.882888:0:15565:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011f9cf600/0xdfc0fb148a3bee2 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3bef7 expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.882889:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.882890:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.882891:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.882894:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.882898:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.882903:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.882903:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.882904:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.882907:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.882910:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.882914:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.882927:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:2.0:1713481296.882933:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f935880/2, rc 0, transno 993538 00000100:00100000:0.0:1713481296.882938:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528640 00000100:00100000:0.0:1713481296.882941:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528640 00000100:00100000:2.0:1713481296.882944:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011f935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784556480:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.882949:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1713481296.882952:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.882959:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563589 00000100:00100000:2.0:1713481296.882963:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.882964:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800898a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16943:17935:x1796714882528640:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.882971:0:9203:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.882971:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800898a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.882980:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.882982:0:9203:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c277 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49dac expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.882987:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559552:0@lo:6:osp-syn-1-1.0 00002000:00010000:0.0:1713481296.882994:0:9203:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713481296.882996:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.883002:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.883004:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.883008:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c277 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dac expref: 16944 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883019:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784559360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.883023:0:9203:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b272ac0/0xdfc0fb148a3c277 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dac expref: 16944 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.883025:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784557056:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.883028:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.883031:0:9203:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b272ac0, rc 0) 00000100:00100000:2.0:1713481296.883035:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.883038:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784559424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.883045:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.883048:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800898a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16944:17935:x1796714882528640:12345-192.168.202.24@tcp:101:dd.0 Request processed in 83us (120us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.883048:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3c182 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d6d expref: 16944 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.883054:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563589 00000100:00100000:1.0:1713481296.883058:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559296 00000100:00100000:1.0:1713481296.883062:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559296 00000100:00100000:2.0:1713481296.883064:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559232 00010000:00010000:3.0:1713481296.883064:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c0d98c0, rc 0) 00000100:00100000:2.0:1713481296.883065:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559232 00000100:00100000:0.0:1713481296.883068:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559552 00000100:00100000:0.0:1713481296.883071:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559552 00000100:00100000:1.0:1713481296.883076:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559488 00000100:00100000:1.0:1713481296.883077:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559488 00000100:00100000:2.0:1713481296.883078:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559360 00000100:00100000:2.0:1713481296.883079:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559360 00000100:00100000:1.0:1713481296.883084:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559424 00000100:00100000:1.0:1713481296.883086:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559424 00000100:00100000:0.0:1713481296.883087:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563590 00000100:00100000:3.0:1713481296.883087:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16943:8499:x1796714882526400:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5075us (5151us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.883088:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98394 00000100:00100000:2.0:1713481296.883091:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+20:3491:x1796714784559296:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.883092:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2890:3491:x1796714784559552:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.883094:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563568 00000100:00100000:1.0:1713481296.883096:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98395 00010000:00010000:2.0:1713481296.883096:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.883098:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3491:x1796714784559232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.883103:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.883103:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c135 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x34d7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3c12e expref: 20 pid: 15524 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.883104:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43588 count 1 00010000:00010000:1.0:1713481296.883110:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800992cf3c0/0xdfc0fb148a3c158 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3c14a expref: 19 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.883113:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.883113:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x34d7:0x0].0x0 (ffff880097eff700) 00010000:00010000:2.0:1713481296.883133:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.883141:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880097effb00) 00010000:00010000:0.0:1713481296.883147:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e86c0/0xdfc0fb1486898c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d333d expref: 26781 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.883147:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.883152:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+18:3491:x1796714784559296:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (237us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.883153:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.883154:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.883156:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98394 00010000:00010000:0.0:1713481296.883157:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.883163:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3491:x1796714784559232:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.883167:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98395 00000100:00100000:2.0:1713481296.883171:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98396 00000100:00100000:2.0:1713481296.883175:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+17:3491:x1796714784559488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.883181:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.883182:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98397 00000100:00100000:1.0:1713481296.883184:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3492:x1796714784559360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.883189:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.883189:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f9cdb00/0xdfc0fb148a3bef7 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3bee2 expref: 16 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883195:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d68240/0xdfc0fb148a3c0f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3c0ef expref: 16 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883202:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.883203:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880122555500) 00010000:00010000:1.0:1713481296.883204:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.883215:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3492:x1796714784559360:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.883218:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98397 00010000:00010000:2.0:1713481296.883220:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.883226:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98398 00000100:00100000:1.0:1713481296.883228:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3492:x1796714784559424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.883232:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.883238:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d6a400/0xdfc0fb148a3c10b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3131 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3c0fd expref: 13 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883244:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3491:x1796714784559488:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.883252:0:6920:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3131 (ffff8801302c2200) 00000100:00100000:2.0:1713481296.883253:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98396 00010000:00010000:0.0:1713481296.883254:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e86c0/0xdfc0fb1486898c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d333d expref: 26781 pid: 16454 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.883259:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.883268:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e86c0/0xdfc0fb1486898c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d333d expref: 26781 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.883269:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3492:x1796714784559424:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.883273:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98398 00000100:00100000:0.0:1713481296.883277:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009406b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784559616:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.883289:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.883296:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800898a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.883297:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091872000 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.883302:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784559424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.883303:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.883308:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784559360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.883325:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15562:1796714784556800:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.883347:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.883351:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d09cfc0/0xdfc0fb148a3c16d lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d66 expref: 24484 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883360:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528704 00010000:00010000:0.0:1713481296.883361:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d09cfc0, rc 0) 00000100:00100000:2.0:1713481296.883363:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528704 00010000:00010000:2.0:1713481296.883374:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007991db00/0xdfc0fb148a1627a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39867 expref: 24485 pid: 16498 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.883381:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24485:17924:x1796714882526144:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5678us (5731us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.883387:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563566 00000100:00100000:2.0:1713481296.883396:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820698 00000100:00100000:2.0:1713481296.883399:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b401ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:1959:x1796714882528704:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.883404:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.883406:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007991db00/0xdfc0fb148a1627a lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39867 expref: 24484 pid: 16498 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.883408:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.883412:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007991db00/0xdfc0fb148a1627a lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39867 expref: 24484 pid: 16498 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.883415:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528768 00000100:00100000:1.0:1713481296.883417:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528768 00010000:00010000:2.0:1713481296.883423:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007991db00/0xdfc0fb148a1627a lrc: 0/0,0 mode: --/PR res: [0x2c0000407:0xb362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39867 expref: 24484 pid: 16498 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.883425:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19cfc0/0xdfc0fb1488e7e76 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5548 expref: 16943 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.883433:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.883434:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.883435:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820699 00010000:00010000:2.0:1713481296.883436:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d09cfc0/0xdfc0fb148a3c16d lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d66 expref: 24483 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.883438:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800898a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16943:1959:x1796714882528768:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.883442:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.883444:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d09cfc0/0xdfc0fb148a3c16d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d66 expref: 24483 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883445:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c19cfc0/0xdfc0fb1488e7e76 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5548 expref: 16943 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.883450:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c19cfc0/0xdfc0fb1488e7e76 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8ea1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5548 expref: 16943 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.883456:0:16520:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011d09cfc0/0xdfc0fb148a3c16d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d66 expref: 24483 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883461:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:16520:1796714784559680:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.883465:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19cfc0/0xdfc0fb1488e7e76 lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8ea1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b5548 expref: 16943 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.883472:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.883473:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.883475:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3c182 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d6d expref: 16942 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883475:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bff0480 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.883480:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3c182 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d6d expref: 16942 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883491:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007c0d98c0/0xdfc0fb148a3c182 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8ea1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d6d expref: 16942 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883493:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800891b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784556992:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.883496:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800898a5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0000_UUID:16624:1796714784559744:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.883509:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b96ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.883520:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.883538:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a868a80/2, rc 0, transno 993537 00000100:00100000:2.0:1713481296.883551:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784556096:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.883555:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.883586:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.883589:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784557312:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.883591:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784559808:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.883604:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.883609:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.883620:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784556864:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.883626:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528832 00000100:00100000:2.0:1713481296.883628:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528832 00000100:00100000:2.0:1713481296.883636:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559808 00000100:00100000:2.0:1713481296.883638:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559808 00010000:00010000:0.0:1713481296.883645:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883652:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563591 00000100:00100000:2.0:1713481296.883655:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800898a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16943:17009:x1796714882528832:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.883660:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.883681:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563592 00010000:00010000:2.0:1713481296.883682:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121d1fcc0/0xdfc0fb148a3c285 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xceab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49db3 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.883688:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+2891:3493:x1796714784559808:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:2.0:1713481296.883692:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xceab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.883699:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.883700:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713481296.883701:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43590 count 1 00000100:00100000:1.0:1713481296.883703:0:15524:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec40e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000_UUID:15524:1796714784557568:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.883703:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1fcc0/0xdfc0fb148a3c285 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49db3 expref: 16944 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.883709:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121d1fcc0/0xdfc0fb148a3c285 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49db3 expref: 16944 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.883713:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121d1fcc0, rc 0) 00010000:00010000:3.0:1713481296.883714:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.883725:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801216918c0/0xdfc0fb1486898ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d334b expref: 26781 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.883727:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800898a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16944:17009:x1796714882528832:12345-192.168.202.24@tcp:101:dd.0 Request processed in 71us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.883729:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 3/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 10 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.883731:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563591 00010000:00010000:3.0:1713481296.883733:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.883735:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.883736:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.883736:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88012ba3a500) 00010000:00010000:3.0:1713481296.883737:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883738:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.883740:0:15524:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 3/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 10 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883744:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d04d200, rc 0) 00000100:00100000:0.0:1713481296.883749:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528960 00000100:00100000:0.0:1713481296.883752:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528960 00010000:00010000:3.0:1713481296.883756:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801216918c0/0xdfc0fb1486898ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d334b expref: 26781 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.883759:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784557504:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.883763:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134503600/0xdfc0fb148802c28 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963283 expref: 20690 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.883763:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:15476:x1796714784557376:12345-0@lo:101:mdt00_012.0 Request processed in 5351us (5381us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.883766:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801216918c0/0xdfc0fb1486898ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d334b expref: 26781 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.883767:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82968 00000100:00100000:0.0:1713481296.883777:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820700 00010000:00010000:2.0:1713481296.883777:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.883777:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784559872:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.883782:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20690:1960:x1796714882528960:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.883788:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.883791:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134503600/0xdfc0fb148802c28 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963283 expref: 20690 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.883791:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784557376:0@lo:101:mdt00_012.0 00000100:00100000:2.0:1713481296.883794:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880089a91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784557824:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.883798:0:15476:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 4/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.883799:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134503600/0xdfc0fb148802c28 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963283 expref: 20690 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.883802:0:15476:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 4/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.883804:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6780 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.883810:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.883816:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134503600/0xdfc0fb148802c28 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x277b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963283 expref: 20690 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.883826:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.883830:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.883832:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.883832:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008afeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784557440:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.883835:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.883836:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529088 00000100:00100000:1.0:1713481296.883837:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529088 00010000:00010000:0.0:1713481296.883841:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883846:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc52f40/0xdfc0fb1486898a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32e9 expref: 26782 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.883856:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.883857:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820701 00000100:00100000:1.0:1713481296.883860:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800898a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26782:1960:x1796714882529088:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.883861:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.883864:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.883866:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc52f40/0xdfc0fb1486898a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32e9 expref: 26782 pid: 16490 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.883873:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc52f40/0xdfc0fb1486898a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32e9 expref: 26782 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.883878:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20689:1960:x1796714882528960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.883880:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008afee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784557696:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.883883:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc52f40/0xdfc0fb1486898a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32e9 expref: 26782 pid: 16490 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.883884:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820700 00010000:00010000:1.0:1713481296.883895:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.883896:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.883898:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.883904:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883905:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883919:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.883922:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.883930:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.883935:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.883935:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.883937:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800898a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26781:1960:x1796714882529088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.883941:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.883943:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820701 00010000:00010000:2.0:1713481296.883947:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.883952:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121613840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.883955:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.883957:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529216 00000100:00100000:0.0:1713481296.883959:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529216 00010000:00010000:2.0:1713481296.883962:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883968:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.883970:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2793 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.883974:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883975:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.883981:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121613840/0xdfc0fb148a3c1a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.883982:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.883990:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820702 00000100:00100000:0.0:1713481296.883993:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:1960:x1796714882529216:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.883993:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.883999:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.884000:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884003:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2793 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.884004:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800992cc240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.884007:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884010:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2793 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.884012:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884022:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012064eac0/0xdfc0fb148a3b96a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x230:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ac6 expref: 2793 pid: 15483 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.884025:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884030:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800992cc240/0xdfc0fb148a3c197 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x277b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884038:0:9218:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88012ba3a500) 00010000:00010000:0.0:1713481296.884041:0:9218:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 2/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 9 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884046:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 9 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884050:0:9218:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 9 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884061:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 9 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.884067:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009406b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:9218:1796714784559936:0@lo:105: 00000100:00100000:0.0:1713481296.884083:0:9218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.884095:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2892:3490:x1796714784557184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5766us (5806us total) trans 4295960835 rc 0/0 00000100:00100000:0.0:1713481296.884099:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c43bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.884099:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563574 00000100:00100000:2.0:1713481296.884139:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784559936 00000100:00100000:2.0:1713481296.884141:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784559936 00000100:00100000:0.0:1713481296.884153:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.884154:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20405 00000100:00100000:2.0:1713481296.884157:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9218:x1796714784559936:12345-0@lo:105: 00010000:00010000:2.0:1713481296.884162:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 5/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884168:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 5/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.884169:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529344 00000100:00100000:0.0:1713481296.884172:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529344 00010000:00010000:2.0:1713481296.884172:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 5/0,1 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884175:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+307:3491:x1796714784557120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5987us (6018us total) trans 4296040970 rc 0/0 00010000:00010000:2.0:1713481296.884176:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884179:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884180:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563572 00010000:00010000:2.0:1713481296.884183:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884184:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132fe7cc0/0xdfc0fb148689972 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3313 expref: 26781 pid: 16540 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.884194:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800992cc900) 00000100:00100000:0.0:1713481296.884200:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820703 00010000:00010000:1.0:1713481296.884201:0:15476:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.884205:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800755a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26781:1960:x1796714882529344:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.884206:0:15476:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884211:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.884213:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9218:x1796714784559936:12345-0@lo:105: Request processed in 55us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.884215:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132fe7cc0/0xdfc0fb148689972 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3313 expref: 26781 pid: 16540 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.884217:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20405 00000004:00080000:1.0:1713481296.884222:0:15476:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x230:0x0] 00010000:00010000:0.0:1713481296.884223:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132fe7cc0/0xdfc0fb148689972 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3313 expref: 26781 pid: 16540 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.884235:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fdb1d40/0xdfc0fb148a3c293 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x230:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713481296.884238:0:15476:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fdb1d40/0xdfc0fb148a3c293 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.884239:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132fe7cc0/0xdfc0fb148689972 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3313 expref: 26781 pid: 16540 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.884239:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e55c700/2, rc 0, transno 1073674 00010000:00010000:1.0:1713481296.884243:0:15476:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fdb1d40/0xdfc0fb148a3c293 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.884244:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784557120:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.884250:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560000:0@lo:101:mdt00_012.0 00010000:00010000:0.0:1713481296.884251:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.884252:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.884255:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884261:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884262:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.884274:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784560064:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.884276:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008323e0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.884279:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.884288:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560000 00000100:00100000:2.0:1713481296.884288:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.884290:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560000 00000100:00100000:0.0:1713481296.884293:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26780:1960:x1796714882529344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 88us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.884297:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820703 00000100:00100000:1.0:1713481296.884304:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82969 00010000:00010000:2.0:1713481296.884305:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884307:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:15476:x1796714784560000:12345-0@lo:101:mdt00_012.0 00010000:00010000:2.0:1713481296.884310:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884312:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.884314:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884318:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884319:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdb0480/0xdfc0fb148a3c29a lrc: 2/0,0 mode: --/PW res: [0x200000400:0x230:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c293 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.884320:0:9218:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009406b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:9218:1796714784559936:0@lo:105: 00010000:00010000:2.0:1713481296.884321:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884324:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121610240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.884326:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884328:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdb0480/0xdfc0fb148a3c29a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c293 expref: 11 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884329:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884331:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.884334:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdb0480/0xdfc0fb148a3c29a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c293 expref: 11 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884337:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x35 (ffff88009301a200) 00000100:00100000:0.0:1713481296.884339:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:1960:x1796714882529216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 345us (405us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.884339:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.884339:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884340:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdb0480, rc 0) 00000100:00100000:0.0:1713481296.884343:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820702 00010000:00010000:2.0:1713481296.884346:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121610240/0xdfc0fb148a3c1f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884353:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15476:x1796714784560000:12345-0@lo:101:mdt00_012.0 Request processed in 46us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.884357:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82969 00000100:00100000:0.0:1713481296.884373:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.884373:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560064 00000100:00100000:1.0:1713481296.884375:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560064 00000100:00100000:0.0:1713481296.884383:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882528896 00000100:00100000:1.0:1713481296.884383:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563593 00000100:00100000:0.0:1713481296.884384:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882528896 00000100:00100000:1.0:1713481296.884386:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+307:3493:x1796714784560064:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.884391:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce73c0/0xdfc0fb148802c21 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963275 expref: 20689 pid: 16497 timeout: 815 lvb_type: 1 00002000:00080000:1.0:1713481296.884393:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10113 count 1 00000100:00100000:0.0:1713481296.884400:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820704 00000100:00100000:0.0:1713481296.884402:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009406b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20689:1960:x1796714882528896:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.884402:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884406:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.884408:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096ce73c0/0xdfc0fb148802c21 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963275 expref: 20689 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.884409:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f158240/0xdfc0fb148802c52 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632d7 expref: 20689 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.884412:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.884413:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096ce73c0/0xdfc0fb148802c21 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963275 expref: 20689 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.884413:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.884415:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884424:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f158240/0xdfc0fb148802c52 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632d7 expref: 20689 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.884426:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096ce73c0/0xdfc0fb148802c21 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x277a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963275 expref: 20689 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.884430:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f158240/0xdfc0fb148802c52 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632d7 expref: 20689 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.884436:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784560128:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.884438:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.884439:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.884441:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884446:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884449:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008323e300 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.884454:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2892:3491:x1796714784557760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5499us (5529us total) trans 4295960836 rc 0/0 00010000:00010000:0.0:1713481296.884455:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.884458:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563577 00000100:00100000:1.0:1713481296.884464:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560000:0@lo:101:mdt00_012.0 00000100:00100000:0.0:1713481296.884467:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009406b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20688:1960:x1796714882528896:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 64us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.884470:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820704 00010000:00010000:1.0:1713481296.884470:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fdb1d40/0xdfc0fb148a3c293 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c29a expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884474:0:15476:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fdb1d40/0xdfc0fb148a3c293 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c29a expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.884483:0:15476:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x230:0x0] 00000004:00080000:2.0:1713481296.884484:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b360000/2, rc 0, transno 993540 00000100:00100000:2.0:1713481296.884496:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784557760:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.884499:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560192:0@lo:1000:mdt00_012.0 00000100:00100000:0.0:1713481296.884504:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.884506:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884510:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.884514:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529024 00000100:00100000:1.0:1713481296.884514:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.884514:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.884516:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529024 00010000:00010000:2.0:1713481296.884518:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884521:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090876480 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.884522:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f159680/0xdfc0fb148802c1a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963267 expref: 20688 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.884522:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884525:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096b45200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.884526:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884528:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560192 00000100:00100000:3.0:1713481296.884529:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.884530:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560192 00010000:00010000:2.0:1713481296.884530:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.884531:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820705 00000100:00100000:0.0:1713481296.884533:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20688:1960:x1796714882529024:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.884537:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.884537:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784560256:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.884539:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f159680/0xdfc0fb148802c1a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2779:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963267 expref: 20688 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.884541:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82970 00010000:00010000:2.0:1713481296.884541:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884543:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:15476:x1796714784560192:12345-0@lo:1000:mdt00_012.0 00010000:00010000:2.0:1713481296.884544:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b45200/0xdfc0fb148a3c189 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x277a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884545:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f159680/0xdfc0fb148802c1a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2779:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963267 expref: 20688 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.884558:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f159680/0xdfc0fb148802c1a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2779:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963267 expref: 20688 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.884563:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.884567:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.884568:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.884569:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884573:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884582:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.884591:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:15476:x1796714784560192:12345-0@lo:1000:mdt00_012.0 Request processed in 45us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.884592:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20687:1960:x1796714882529024:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.884595:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820705 00000100:00100000:1.0:1713481296.884598:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82970 00010000:00010000:0.0:1713481296.884607:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884612:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884616:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884619:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884625:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560192:0@lo:1000:mdt00_012.0 00010000:00010000:0.0:1713481296.884626:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884630:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d09fa80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.884631:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884637:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.884650:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+308:3493:x1796714784556928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6626us (6681us total) trans 4296040971 rc 0/0 00000100:00100000:2.0:1713481296.884654:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563570 00000100:00100000:1.0:1713481296.884684:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560320:0@lo:1000:mdt00_012.0 00000100:00100000:2.0:1713481296.884688:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560256 00000100:00100000:2.0:1713481296.884691:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560256 00000100:00100000:1.0:1713481296.884700:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.884702:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563594 00000100:00100000:2.0:1713481296.884704:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2892:3491:x1796714784560256:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.884708:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123665900 going to sleep for 11 seconds 00002000:00080000:2.0:1713481296.884713:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43592 count 1 00000100:00100000:1.0:1713481296.884715:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560320 00000100:00100000:1.0:1713481296.884717:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560320 00010000:00010000:2.0:1713481296.884720:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.884727:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82971 00010000:00010000:2.0:1713481296.884727:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8d80/0xdfc0fb1486898d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3359 expref: 26779 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.884730:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15476:x1796714784560320:12345-0@lo:1000:mdt00_012.0 00010000:00010000:2.0:1713481296.884731:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.884732:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.884733:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.884741:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884743:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e8d80/0xdfc0fb1486898d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3359 expref: 26779 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.884749:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d09fa80/0xdfc0fb148a3c174 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884749:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e8d80/0xdfc0fb1486898d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3359 expref: 26779 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.884754:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880089a91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784560384:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.884769:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb59780 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.884773:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:15476:x1796714784560320:12345-0@lo:1000:mdt00_012.0 Request processed in 42us (72us total) trans 0 rc 1/1 00000100:00100000:1.0:1713481296.884777:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82971 00000004:00080000:2.0:1713481296.884785:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013620ea00/2, rc 0, transno 1073675 00000100:00100000:2.0:1713481296.884789:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013620ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784556928:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.884795:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560320:0@lo:1000:mdt00_012.0 00000004:00080000:2.0:1713481296.884823:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072b4ca80/2, rc 0, transno 993539 00010000:00010000:1.0:1713481296.884824:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15476 initiator: MDT0 00000100:00100000:3.0:1713481296.884825:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784560448:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.884828:0:15476:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713481296.884828:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784557184:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.884832:0:15476:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713481296.884838:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560512:0@lo:101:mdt00_012.0 00000100:00100000:3.0:1713481296.884849:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.884851:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.884862:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090876480 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.884864:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560448 00000100:00100000:2.0:1713481296.884866:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560448 00000100:00100000:1.0:1713481296.884868:0:15506:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560512 00000100:00100000:1.0:1713481296.884869:0:15506:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560512 00000100:00100000:2.0:1713481296.884876:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563595 00000100:00100000:1.0:1713481296.884878:0:15506:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82972 00000100:00100000:2.0:1713481296.884878:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008afee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+309:3491:x1796714784560448:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.884880:0:15506:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:15476:x1796714784560512:12345-0@lo:101:mdt00_012.0 00010000:00010000:1.0:1713481296.884885:0:15506:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.884891:0:15506:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8ed00/0xdfc0fb148a3c2b6 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c2af expref: -99 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884900:0:15506:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8ed00/0xdfc0fb148a3c2b6 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c2af expref: 12 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884905:0:15506:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8ed00/0xdfc0fb148a3c2b6 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c2af expref: 12 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.884907:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008afeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784560576:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.884909:0:15506:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff880131446300) 00010000:00010000:1.0:1713481296.884910:0:15506:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713481296.884912:0:15506:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133c8ed00, rc 0) 00000100:00100000:2.0:1713481296.884921:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.884924:0:15506:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:15476:x1796714784560512:12345-0@lo:101:mdt00_012.0 Request processed in 43us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.884927:0:15506:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82972 00000100:00100000:1.0:1713481296.884943:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001-mdtlov_UUID:15476:1796714784560512:0@lo:101:mdt00_012.0 00000100:00100000:2.0:1713481296.884945:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560576 00000100:00100000:2.0:1713481296.884947:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560576 00010000:00010000:1.0:1713481296.884949:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884953:0:15476:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.884955:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563596 00000100:00100000:2.0:1713481296.884957:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800891b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2893:3492:x1796714784560576:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.884964:0:16541:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43594 count 1 00010000:00010000:1.0:1713481296.884969:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713481296.884972:0:16541:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.884973:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.884977:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713481296.884979:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800733d9440/0xdfc0fb1486898df lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3367 expref: 26779 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.884982:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.884983:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.884985:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.884994:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800733d9440/0xdfc0fb1486898df lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3367 expref: 26779 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.884999:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800733d9440/0xdfc0fb1486898df lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3367 expref: 26779 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.885004:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012003ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784560640:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.885015:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+309:3493:x1796714784556736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7212us (7284us total) trans 4296040972 rc 0/0 00000100:00100000:2.0:1713481296.885016:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb59180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.885021:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563567 00000004:00080000:2.0:1713481296.885033:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a868e00/2, rc 0, transno 1073676 00000100:00100000:2.0:1713481296.885037:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784556736:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.885055:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.885058:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012003bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784560704:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.885070:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.885074:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.885095:0:15509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560704 00002000:00080000:2.0:1713481296.885096:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10114 count 1 00000100:00100000:0.0:1713481296.885098:0:15509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560704 00010000:00010000:2.0:1713481296.885104:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.885113:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563597 00010000:00010000:2.0:1713481296.885114:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096ce7600/0xdfc0fb148802c59 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632e5 expref: 20686 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.885132:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.885133:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.885135:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.885137:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+309:3492:x1796714784560704:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.885145:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096ce7600/0xdfc0fb148802c59 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632e5 expref: 20686 pid: 16497 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713481296.885149:0:15509:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10115 count 1 00010000:00010000:2.0:1713481296.885150:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096ce7600/0xdfc0fb148802c59 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632e5 expref: 20686 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.885155:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784560768:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.885160:0:15509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.885161:0:15476:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x9a:0x0].1986, 416 off1629648 00000100:00100000:2.0:1713481296.885167:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096380c00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.885171:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134503180/0xdfc0fb148802c60 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632f3 expref: 20686 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.885177:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885179:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885181:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713481296.885194:0:15476:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0xa5:0x0].861, 496 off796664 00000004:00080000:1.0:1713481296.885197:0:15476:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880090876480 with version 16903 00010000:00010000:0.0:1713481296.885198:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134503180/0xdfc0fb148802c60 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632f3 expref: 20686 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.885206:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134503180/0xdfc0fb148802c60 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632f3 expref: 20686 pid: 16538 timeout: 815 lvb_type: 1 00000004:00080000:2.0:1713481296.885207:0:8077:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a5738e40 version 16903 rpc_version 16903 00000100:00100000:0.0:1713481296.885216:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784560832:192.168.202.24@tcp:104: 00000020:00100000:2.0:1713481296.885217:0:8077:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713481296.885221:0:8077:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012003a680 x1796714784560960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1472/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1713481296.885229:0:8077:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012003a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784560960:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713481296.885236:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59480 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.885236:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.885251:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529152 00000100:00100000:0.0:1713481296.885254:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529152 00000100:00100000:1.0:1713481296.885256:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529664 00000100:00100000:1.0:1713481296.885258:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529664 00000100:00100000:2.0:1713481296.885259:0:8077:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.885265:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133df33c0/0xdfc0fb1486898a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32f7 expref: 26780 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.885273:0:8077:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c5aec00 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.885277:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485930 00000100:00100000:1.0:1713481296.885280:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2792:18930:x1796714882529664:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:0.0:1713481296.885282:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820706 00010000:00010000:1.0:1713481296.885285:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.885286:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26780:1960:x1796714882529152:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.885287:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784560960 00000100:00100000:2.0:1713481296.885289:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784560960 00010000:00010000:1.0:1713481296.885292:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8fa80/0xdfc0fb148a3c2d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49dc1 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.885293:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.885296:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133df33c0/0xdfc0fb1486898a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32f7 expref: 26780 pid: 16535 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.885304:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133df33c0/0xdfc0fb1486898a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32f7 expref: 26780 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.885305:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82973 00000100:00100000:2.0:1713481296.885310:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091227450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:8077:x1796714784560960:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1713481296.885321:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133df33c0/0xdfc0fb1486898a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d32f7 expref: 26780 pid: 16535 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.885336:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885338:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885341:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.885348:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885356:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885361:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885365:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885372:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8cfc0/0xdfc0fb148a3c2e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x51f4:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885376:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8cfc0/0xdfc0fb148a3c2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.885378:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.885379:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8cfc0/0xdfc0fb148a3c2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.885381:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885389:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.885391:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26779:1960:x1796714882529152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 103us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.885397:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820706 00010000:00010000:3.0:1713481296.885397:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885405:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885417:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885423:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d86c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.885426:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885433:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885447:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.885448:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.885453:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c19e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.885465:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529280 00000100:00100000:0.0:1713481296.885468:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529280 00010000:00010000:0.0:1713481296.885478:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb1486898ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3305 expref: 26779 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.885495:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820707 00000100:00100000:0.0:1713481296.885499:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26779:1960:x1796714882529280:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.885505:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091227450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+13:8077:x1796714784560960:12345-0@lo:1000:osp_up0-1.0 Request processed in 194us (245us total) trans 4295105929 rc 0/0 00010000:00010000:0.0:1713481296.885506:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.885510:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb1486898ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3305 expref: 26779 pid: 16485 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.885510:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82973 00010000:00010000:0.0:1713481296.885519:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb1486898ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3305 expref: 26779 pid: 16485 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.885531:0:15576:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000407:0xd901:0x0], index 0: 0 00010000:00010000:0.0:1713481296.885534:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb1486898ae lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3305 expref: 26779 pid: 16485 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.885548:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885550:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885553:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.885559:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.885578:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.885592:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1960:x1796714882529280:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.885598:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820707 00010000:00010000:1.0:1713481296.885598:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08240/0xdfc0fb148a3c2ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885602:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08240/0xdfc0fb148a3c2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5231:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885606:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08240/0xdfc0fb148a3c2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5231:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.885614:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008afec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2894:3492:x1796714784557248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7318us (7379us total) trans 4295960837 rc 0/0 00000100:00100000:3.0:1713481296.885621:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563573 00010000:00010000:1.0:1713481296.885623:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885627:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885630:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885633:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885636:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133c8e640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.885638:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885641:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885645:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff8800999bd800) 00010000:00010000:1.0:1713481296.885646:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.885648:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.885648:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885651:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8e640/0xdfc0fb148a3c2e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.885656:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885679:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.885681:0:15576:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009c894a80 reply state ffff880079580000 transno 4295105930 ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8cfc0/0xdfc0fb148a3c2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x51f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.885687:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8cfc0/0xdfc0fb148a3c2e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x51f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.885687:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.885689:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011fae9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16495:1796714784558016:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.885691:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x31 (ffff880096f1ac00) 00010000:00010000:1.0:1713481296.885692:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713481296.885693:0:15576:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713481296.885694:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885699:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d8900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.885702:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885709:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885712:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8fa80/0xdfc0fb148a3c2d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x51f4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dc1 expref: 2795 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.885714:0:16495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322bfa80/0xdfc0fb148a3c215 lrc: 3/0,0 mode: --/PW res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d90 expref: 20686 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885722:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.885724:0:16495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322bfa80, rc 0) 00010000:00010000:1.0:1713481296.885726:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08240/0xdfc0fb148a3c2ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5231:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dc1 expref: 2794 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.885729:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c1c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885730:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5231:0x0].0x0 (ffff88009e0de300) 00010000:00010000:1.0:1713481296.885731:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713481296.885732:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca08240, rc 0) 00000100:00100000:0.0:1713481296.885741:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011faebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20686:14753:x1796714882527296:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6008us (6033us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.885744:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18930:x1796714882529664:12345-192.168.202.24@tcp:101:dd.0 Request processed in 463us (508us total) trans 4295105930 rc 0/0 00000100:00100000:0.0:1713481296.885747:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563578 00000100:00100000:1.0:1713481296.885748:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485930 00000100:00100000:1.0:1713481296.885787:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.885806:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529408 00000100:00100000:1.0:1713481296.885806:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.885809:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529408 00000100:00100000:1.0:1713481296.885814:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.885819:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820f6f40/0xdfc0fb148a13f34 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38034 expref: 20686 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.885822:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.885829:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529728 00000100:00100000:1.0:1713481296.885831:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529728 00000100:00100000:0.0:1713481296.885834:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529472 00000100:00100000:0.0:1713481296.885836:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529472 00000100:00100000:1.0:1713481296.885841:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485931 00010000:00010000:0.0:1713481296.885843:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095d44b40/0xdfc0fb148802c2f lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x277c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963291 expref: 20687 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.885844:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18692:x1796714882529728:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:3.0:1713481296.885849:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008afedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+2894:3492:x1796714784557632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7302us (7357us total) trans 4295960838 rc 0/0 00010000:00010000:1.0:1713481296.885850:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.885856:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820708 00010000:00010000:1.0:1713481296.885856:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09b00/0xdfc0fb148a3c2fc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49dc8 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.885856:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563576 00000100:00100000:0.0:1713481296.885860:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20687:1959:x1796714882529408:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.885867:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.885872:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529536 00000100:00100000:3.0:1713481296.885876:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529536 00010000:00010000:0.0:1713481296.885877:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820f6f40/0xdfc0fb148a13f34 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc17b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38034 expref: 20687 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.885884:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820f6f40/0xdfc0fb148a13f34 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc17b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38034 expref: 20688 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.885892:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563598 00000100:00100000:3.0:1713481296.885897:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20688:18792:x1796714882529536:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.885901:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820f6f40/0xdfc0fb148a13f34 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xc17b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38034 expref: 20688 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.885901:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.885905:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.885908:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.885917:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3c30a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc52c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49dba expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885918:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.885922:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885924:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.885928:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801322bfa80/0xdfc0fb148a3c215 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d90 expref: 20687 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885928:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00002000:00010000:3.0:1713481296.885931:0:16481:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc52c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.885933:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.885935:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322bfa80/0xdfc0fb148a3c215 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d90 expref: 20687 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885938:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.885942:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.885944:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.885948:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3c30a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dba expref: 20688 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.885953:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801322bfa80/0xdfc0fb148a3c215 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49d90 expref: 20688 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.885956:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.885959:0:16481:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b091f80/0xdfc0fb148a3c30a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dba expref: 20688 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.885962:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c02680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784561024:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.885962:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.885967:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:3.0:1713481296.885967:0:16481:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b091f80, rc 0) 00010000:00010000:1.0:1713481296.885972:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.885976:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ca09200 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.885978:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237b9840 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.885979:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.885984:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00000100:00100000:3.0:1713481296.885984:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20688:18792:x1796714882529536:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 86us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.885990:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563598 00010000:00010000:1.0:1713481296.885991:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c12:0x0].0x0 (ffff88012430b000) 00010000:00010000:1.0:1713481296.885992:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.885994:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.885995:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820709 00010000:00010000:1.0:1713481296.885998:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09200/0xdfc0fb148a3c303 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.886000:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20688:1959:x1796714882529472:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.886006:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.886011:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095d44b40/0xdfc0fb148802c2f lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x277c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963291 expref: 20687 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.886011:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.886013:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.886016:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.886019:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095d44b40/0xdfc0fb148802c2f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963291 expref: 20687 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.886019:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ca0bcc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.886020:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.886023:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.886026:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c12:0x0].0x3331 (ffff88012430b300) 00010000:00010000:1.0:1713481296.886027:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.886028:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:1.0:1713481296.886031:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c311 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2c12:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.886035:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.886036:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.886039:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.886045:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886057:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09b00/0xdfc0fb148a3c2fc lrc: 1/0,0 mode: --/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dc8 expref: 2066 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886061:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca09b00/0xdfc0fb148a3c2fc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2c12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dc8 expref: 2066 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.886062:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.886069:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca09b00, rc 0) 00000100:00100000:0.0:1713481296.886074:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20687:1959:x1796714882529472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.886079:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820709 00000100:00100000:1.0:1713481296.886080:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18692:x1796714882529728:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 236us (257us total) trans 0 rc 301/301 00000100:00100000:1.0:1713481296.886084:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485931 00000100:00100000:1.0:1713481296.886152:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.886166:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.886176:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529920 00000100:00100000:1.0:1713481296.886178:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529920 00000100:00100000:1.0:1713481296.886190:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26117 00000100:00100000:1.0:1713481296.886193:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:19010:x1796714882529920:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:1.0:1713481296.886207:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713481296.886216:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007df05f80/0xdfc0fb148a37283 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa47684 expref: 2795 pid: 15473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886228:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5218:0x0].0x0 (ffff880092ed2100) 00010000:00010000:1.0:1713481296.886233:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801207cc6c0/0xdfc0fb148a3b105 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49818 expref: 2794 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886248:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880083968200) 00010000:00010000:1.0:1713481296.886255:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.886266:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886271:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886275:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886282:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886285:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886288:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886294:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886297:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886300:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886329:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886333:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886336:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886352:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886355:0:15793:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.886359:0:15793:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15793 initiator: MDT0 00000100:00100000:1.0:1713481296.886366:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078022d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784561088:0@lo:101:mdt_io00_014.0 00000100:00100000:0.0:1713481296.886378:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529792 00000100:00100000:0.0:1713481296.886381:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529792 00000100:00100000:1.0:1713481296.886382:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.886391:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009678bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.886405:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98399 00000100:00100000:2.0:1713481296.886405:0:8077:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012003a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8077:1796714784560960:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713481296.886406:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561088 00000100:00100000:1.0:1713481296.886407:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561088 00000100:00100000:0.0:1713481296.886409:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2390:1960:x1796714882529792:12345-192.168.202.24@tcp:103:mrename.0 00010000:00010000:0.0:1713481296.886416:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:1.0:1713481296.886419:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82974 00000100:00100000:1.0:1713481296.886422:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+35:15793:x1796714784561088:12345-0@lo:101:mdt_io00_014.0 00010000:00010000:0.0:1713481296.886426:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012048cfc0/0xdfc0fb148a2f57f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa42e7e expref: 2390 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886434:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1713481296.886434:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008afec700/2, rc 0, transno 993542 00010000:00010000:1.0:1713481296.886440:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ccd440/0xdfc0fb148a3c33b lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfc0fb148a3c334 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.886447:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008afec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784557632:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.886450:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ccd440/0xdfc0fb148a3c33b lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdfc0fb148a3c334 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.886451:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800733fe640/0xdfc0fb148a2a90b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2be4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa41517 expref: 2389 pid: 15476 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.886454:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008afef480/2, rc 0, transno 993541 00010000:00010000:1.0:1713481296.886455:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ccd440/0xdfc0fb148a3c33b lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdfc0fb148a3c334 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.886457:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008afef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784557248:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.886459:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880092a16a00) 00010000:00010000:1.0:1713481296.886460:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1713481296.886462:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ccd440, rc 0) 00010000:00010000:0.0:1713481296.886464:0:9218:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880092a16a00) 00010000:00010000:0.0:1713481296.886467:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.886475:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d44b40/0xdfc0fb148802c2f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x277c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963291 expref: 20686 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.886480:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:1960:x1796714882529792:12345-192.168.202.24@tcp:103:mrename.0 Request processed in 70us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.886480:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+36:15793:x1796714784561088:12345-0@lo:101:mdt_io00_014.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.886483:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82974 00000100:00100000:2.0:1713481296.886485:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784558080:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.886486:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98399 00000100:00100000:3.0:1713481296.886486:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784561216:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.886509:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.886510:0:15510:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.886513:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078022d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784561088:0@lo:101:mdt_io00_014.0 00010000:00010000:2.0:1713481296.886516:0:15510:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.886520:0:15510:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886523:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.886524:0:15510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886531:0:15793:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.886531:0:15510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.886533:0:16495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561216 00010000:00010000:2.0:1713481296.886534:0:15510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.886537:0:16495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561216 00010000:00010000:2.0:1713481296.886538:0:15510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801302b06c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.886539:0:15510:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.886539:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1713481296.886543:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x2be4:0x0] 00010000:00010000:2.0:1713481296.886543:0:15510:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.886544:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784561152:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.886549:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.886552:0:15510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 2/0,0 mode: --/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886554:0:15793:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880081723180/0xdfc0fb148a3011e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4323d expref: 2165 pid: 15642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.886555:0:16495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563599 00010000:00010000:2.0:1713481296.886556:0:15510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801302b06c0/0xdfc0fb148a3c22a lrc: 0/0,0 mode: --/PW res: [0x280000408:0x277c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886558:0:15793:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.886560:0:16495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2894:3491:x1796714784561216:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.886562:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.886567:0:15793:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880081723180/0xdfc0fb148a3011e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4323d expref: 2165 pid: 15642 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713481296.886571:0:16495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43598 count 1 00010000:00010000:1.0:1713481296.886572:0:15793:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880081723180/0xdfc0fb148a3011e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4323d expref: 2165 pid: 15642 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.886578:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078022d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000_UUID:15793:1796714784561280:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.886582:0:16495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.886586:0:16462:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561152 00000100:00100000:1.0:1713481296.886589:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009678bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.886589:0:16462:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561152 00010000:00010000:0.0:1713481296.886593:0:16495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009840a400/0xdfc0fb1486898e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3383 expref: 26777 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.886599:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:1.0:1713481296.886599:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2c36:0x0]: returning size 4096 00010000:00010000:0.0:1713481296.886601:0:16495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.886603:0:16495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886606:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713481296.886607:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563600 00010000:00010000:1.0:1713481296.886610:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713481296.886612:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2895:3491:x1796714784561152:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.886613:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713481296.886619:0:16495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009840a400/0xdfc0fb1486898e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3383 expref: 26777 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.886619:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133c8fcc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.886620:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.886624:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00002000:00080000:3.0:1713481296.886626:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43596 count 1 00010000:00010000:0.0:1713481296.886627:0:16495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009840a400/0xdfc0fb1486898e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3383 expref: 26777 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.886628:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff88011e210900) 00010000:00010000:1.0:1713481296.886629:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.886630:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713481296.886633:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880133c8fcc0/0xdfc0fb148a3c2bd lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713481296.886636:0:16495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784561344:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.886640:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886642:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886646:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886650:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.886650:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133df3840/0xdfc0fb1486898d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3375 expref: 26777 pid: 15542 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.886653:0:16495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff513c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.886657:0:15476:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713481296.886657:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.886658:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.886661:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.886678:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+310:3490:x1796714784557952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6902us (6940us total) trans 4296040973 rc 0/0 00010000:00010000:1.0:1713481296.886682:0:6922:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1713481296.886683:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563579 00010000:00010000:1.0:1713481296.886685:0:6922:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886688:0:6922:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133c8d200 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.886691:0:6922:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713481296.886695:0:6922:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.886696:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133df3840/0xdfc0fb1486898d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3375 expref: 26777 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.886705:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133df3840/0xdfc0fb1486898d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3375 expref: 26777 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.886706:0:6922:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886709:0:6922:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.886716:0:6922:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 1/0,0 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.886716:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a869180/2, rc 0, transno 1073677 00000100:00100000:3.0:1713481296.886716:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784561408:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.886720:0:6922:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880133c8d200/0xdfc0fb148a3c2af lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c2b6 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.886721:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784557952:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.886734:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713481296.886734:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.886735:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.886735:0:6922:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.886741:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784561472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.886755:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.886773:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.886776:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012003b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784561536:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.886785:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.886803:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561536 00000100:00100000:3.0:1713481296.886806:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561536 00000004:00080000:1.0:1713481296.886825:0:15476:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x230:0x0] 00000100:00100000:2.0:1713481296.886826:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6919:1796714784557888:192.168.202.24@tcp:105: 00000100:00100000:3.0:1713481296.886827:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563601 00000100:00100000:0.0:1713481296.886828:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561472 00010000:00010000:1.0:1713481296.886828:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.886832:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561472 00010000:00010000:1.0:1713481296.886832:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.886832:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800798f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+310:3492:x1796714784561536:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.886836:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886842:0:15476:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1713481296.886843:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10116 count 1 00000004:00080000:1.0:1713481296.886844:0:15476:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x230:0x0] 00010000:00010000:2.0:1713481296.886844:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.886847:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fdb1d40/0xdfc0fb148a3c293 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c29a expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886851:0:15476:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88008fdb1d40/0xdfc0fb148a3c293 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x230:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdfc0fb148a3c29a expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.886854:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98400 00000100:00100000:2.0:1713481296.886854:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011faea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1959:x1796714882526976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7795us (7882us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.886855:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.886858:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0001-mdtlov_UUID+13:3492:x1796714784561472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.886859:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820681 00010000:00010000:0.0:1713481296.886864:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.886868:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800755a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18678:x1796714882526336:12345-192.168.202.24@tcp:36:rm.0 Request processed in 8590us (8955us total) trans 4295107634 rc 0/0 00010000:00010000:3.0:1713481296.886871:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086d58b40/0xdfc0fb148802c67 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963301 expref: 20685 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.886872:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485927 00010000:00010000:0.0:1713481296.886874:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133c8ed00/0xdfc0fb148a3c2b6 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2c36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3c2af expref: 13 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.886877:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.886879:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.886881:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.886899:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086d58b40/0xdfc0fb148802c67 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963301 expref: 20685 pid: 9201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.886904:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.886908:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086d58b40/0xdfc0fb148802c67 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963301 expref: 20685 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.886915:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.886918:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b0fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784561600:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.886921:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530048 00000100:00100000:1.0:1713481296.886922:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530048 00000100:00100000:1.0:1713481296.886935:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485932 00000100:00100000:2.0:1713481296.886936:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882529984 00000100:00100000:3.0:1713481296.886936:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.886937:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:18729:x1796714882530048:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:2.0:1713481296.886940:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882529984 00010000:00010000:1.0:1713481296.886943:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.886949:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090b14900/0xdfc0fb148a3c35e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49dd6 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.886950:0:16580:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2c36:0x0].0x0 (ffff880131446300) 00000100:00100000:2.0:1713481296.886957:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563602 00010000:00010000:0.0:1713481296.886961:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.886962:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20686:10479:x1796714882529984:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.886968:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.886977:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121d1cb40/0xdfc0fb148a3c365 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49dcf expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886987:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.886989:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007995ed00/0xdfc0fb148916de5 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65bc expref: 20687 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.886993:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.886993:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.886994:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.886996:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1cb40/0xdfc0fb148a3c365 lrc: 4/0,0 mode: --/PW res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dcf expref: 20687 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.886997:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887004:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.887006:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007995ed00/0xdfc0fb148916de5 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65bc expref: 20687 pid: 16460 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.887007:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887010:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.887015:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007995ed00/0xdfc0fb148916de5 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65bc expref: 20687 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.887020:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784561664:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.887037:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099062400/0xdfc0fb148a3c37a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887041:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099062400/0xdfc0fb148a3c37a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887044:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099062400/0xdfc0fb148a3c37a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.887048:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962ce180 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.887056:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0001-mdtlov_UUID+12:3492:x1796714784561472:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (298us total) trans 0 rc 0/0 00000004:00200000:1.0:1713481296.887056:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x347f:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.887058:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713481296.887062:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98400 00000004:00010000:1.0:1713481296.887063:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099062400/0xdfc0fb148a3c37a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.887064:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784561472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.887068:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887071:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887073:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887076:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887079:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b15b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.887080:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.887081:0:8073:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713481296.887083:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.887086:0:8073:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887088:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.887089:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.887091:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.887092:0:8073:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800992cc900 already unused, calling callback (ffffffffa0efd520) 00010000:00010000:1.0:1713481296.887093:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b15b00/0xdfc0fb148a3c36c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.887096:0:8073:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887103:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887106:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887109:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887111:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099060d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.887113:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887115:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887139:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff88009afb0d00) 00010000:00010000:1.0:1713481296.887141:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.887142:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887145:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099060d80/0xdfc0fb148a3c373 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.887169:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090b14900/0xdfc0fb148a3c35e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dd6 expref: 2390 pid: 15576 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713481296.887171:0:8073:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887181:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099062400/0xdfc0fb148a3c37a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dd6 expref: 2389 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887185:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff88009cbf1000) 00010000:00010000:0.0:1713481296.887186:0:8073:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 2/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887186:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.887187:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099062400, rc 0) 00010000:00010000:0.0:1713481296.887191:0:8073:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713481296.887198:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2389:18729:x1796714882530048:12345-192.168.202.24@tcp:101:rm.0 Request processed in 260us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.887201:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485932 00000100:00100000:2.0:1713481296.887205:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784561728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.887210:0:8073:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 1/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.887225:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.887241:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.887250:0:15497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072ab6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15497:1796714784558144:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.887263:0:8073:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800992cc900/0xdfc0fb148a3c1ac lrc: 0/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c1ba expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.887271:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.887278:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882527360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7221us (7316us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.887283:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820683 00010000:00010000:0.0:1713481296.887288:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713481296.887290:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713481296.887290:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.887292:0:8073:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713481296.887299:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561728 00000100:00100000:2.0:1713481296.887301:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561728 00000100:00100000:0.0:1713481296.887306:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530176 00000100:00100000:0.0:1713481296.887309:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530176 00000100:00100000:2.0:1713481296.887311:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98401 00000100:00100000:2.0:1713481296.887313:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3490:x1796714784561728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.887317:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.887324:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d04d200/0xdfc0fb148a3c1ba lrc: 0/0,0 mode: --/CW res: [0x200000400:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3c1ac expref: 12 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.887333:0:15497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x230:0x0].0x0 (ffff88012ba3a500) 00000100:00100000:1.0:1713481296.887334:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012062e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784558720:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.887337:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530304 00000100:00100000:0.0:1713481296.887339:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530304 00010000:00010000:2.0:1713481296.887345:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.887355:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125710 00010000:00010000:1.0:1713481296.887361:0:16509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.887362:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125711 00000100:00100000:2.0:1713481296.887362:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+11:3490:x1796714784561728:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.887363:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2166:18578:x1796714882530176:12345-192.168.202.24@tcp:35:rm.0 00000100:00100000:2.0:1713481296.887366:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98401 00000100:00100000:0.0:1713481296.887367:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18811:x1796714882530304:12345-192.168.202.24@tcp:35:dir_create.sh.0 00000100:00100000:2.0:1713481296.887387:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072ab5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:15529:1796714784558272:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.887395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.887404:0:15529:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.887411:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20687:1960:x1796714882527552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7250us (7352us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.887415:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820686 00000100:00100000:2.0:1713481296.887438:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880092999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784558784:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.887443:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.887451:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530432 00000100:00100000:1.0:1713481296.887453:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530432 00010000:00010000:2.0:1713481296.887461:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.887467:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485933 00000100:00100000:1.0:1713481296.887470:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2168:18951:x1796714882530432:12345-192.168.202.24@tcp:101:mrename.0 00000100:00100000:2.0:1713481296.887475:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530368 00010000:00010000:1.0:1713481296.887476:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.887476:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530368 00010000:00010000:1.0:1713481296.887481:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099063600/0xdfc0fb148a3c381 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49de4 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.887486:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563603 00000100:00100000:2.0:1713481296.887488:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16944:18844:x1796714882530368:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.887493:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.887499:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121d1ed00/0xdfc0fb148a3c388 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ddd expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.887499:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18578:x1796714882530176:12345-192.168.202.24@tcp:35:rm.0 Request processed in 135us (255us total) trans 4295105931 rc 0/0 00000100:00100000:3.0:1713481296.887506:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125710 00002000:00010000:2.0:1713481296.887507:0:15510:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713481296.887514:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.887515:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.887518:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1ed00/0xdfc0fb148a3c388 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ddd expref: 16945 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887524:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.887524:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121d1ed00/0xdfc0fb148a3c388 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ddd expref: 16945 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887529:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.887529:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121d1ed00, rc 0) 00010000:00010000:1.0:1713481296.887533:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.887538:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16945:18844:x1796714882530368:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 49us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.887541:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.887542:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563603 00010000:00010000:1.0:1713481296.887544:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887547:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.887561:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18811:x1796714882530304:12345-192.168.202.24@tcp:35:dir_create.sh.0 Request processed in 192us (270us total) trans 4295107635 rc 0/0 00000100:00100000:2.0:1713481296.887563:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784561728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.887566:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125711 00010000:00010000:1.0:1713481296.887570:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b3c0/0xdfc0fb148a3c39d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5213:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887573:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b3c0/0xdfc0fb148a3c39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5213:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887576:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b3c0/0xdfc0fb148a3c39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5213:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.887583:0:14813:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d34a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:14813:1796714784558528:192.168.202.24@tcp:105: 00000004:00200000:1.0:1713481296.887589:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5213:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.887591:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713481296.887596:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b3c0/0xdfc0fb148a3c39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5213:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.887598:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121e9dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16552:1796714784558208:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.887601:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.887602:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.887604:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887607:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.887610:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24481:1957:x1796714882528128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6413us (6448us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.887611:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887614:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800990621c0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:2.0:1713481296.887614:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820693 00010000:00010000:0.0:1713481296.887615:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.887617:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887621:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887628:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:1.0:1713481296.887630:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.887632:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887637:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990621c0/0xdfc0fb148a3c38f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887649:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887653:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887657:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887661:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008484b180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.887676:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.887679:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26777:1960:x1796714882527424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7567us (7648us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.887680:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.887683:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820685 00010000:00010000:1.0:1713481296.887685:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff880096e88500) 00010000:00010000:1.0:1713481296.887687:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.887689:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.887693:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c396 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000100:00100000:2.0:1713481296.887707:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784558400:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.887712:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c2fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784558464:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.887725:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.887729:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887732:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099063600/0xdfc0fb148a3c381 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49de4 expref: 2169 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.887733:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20686:1960:x1796714882527744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7005us (7042us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.887736:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820687 00010000:00010000:1.0:1713481296.887747:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008484b3c0/0xdfc0fb148a3c39d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5213:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49de4 expref: 2168 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.887752:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5213:0x0].0x0 (ffff880096e88600) 00010000:00010000:1.0:1713481296.887754:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.887755:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008484b3c0, rc 0) 00000100:00100000:1.0:1713481296.887771:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2168:18951:x1796714882530432:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 299us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.887776:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485933 00000100:00100000:0.0:1713481296.887810:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800755a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784558976:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.887824:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.887826:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:16520:1796714784559680:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.887827:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.887837:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.887844:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.887849:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094068380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784559040:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.887851:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.887853:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b401ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:1959:x1796714882528704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4453us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.887857:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820698 00010000:00010000:0.0:1713481296.887863:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.887866:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.887880:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.887887:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094069880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16515:1796714784559168:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.887892:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.887904:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.887905:0:16515:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.887914:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530752 00000100:00100000:2.0:1713481296.887916:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530752 00000100:00100000:1.0:1713481296.887917:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.887922:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce6ac0/0xdfc0fb148802c3d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632ad expref: 20686 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.887927:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530496 00000100:00100000:0.0:1713481296.887930:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530496 00000100:00100000:1.0:1713481296.887930:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.887936:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530624 00000100:00100000:2.0:1713481296.887937:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530624 00010000:00010000:2.0:1713481296.887941:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f159f80/0xdfc0fb148802c36 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96329f expref: 20687 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.887955:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.887955:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530688 00000100:00100000:2.0:1713481296.887956:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530688 00000100:00100000:0.0:1713481296.887957:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530560 00000100:00100000:0.0:1713481296.887959:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530560 00010000:00010000:2.0:1713481296.887961:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133df3a80/0xdfc0fb1486898b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3321 expref: 26777 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.887963:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530816 00000100:00100000:3.0:1713481296.887967:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530816 00000100:00100000:2.0:1713481296.887972:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531008 00000100:00100000:1.0:1713481296.887973:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530944 00000100:00100000:2.0:1713481296.887974:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531008 00000100:00100000:0.0:1713481296.887976:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563604 00000100:00100000:1.0:1713481296.887976:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530944 00010000:00010000:2.0:1713481296.887979:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095d44480/0xdfc0fb148802c4b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632c9 expref: 20690 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.887981:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16946:11552:x1796714882530496:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.887986:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882530880 00010000:00010000:1.0:1713481296.887987:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801345006c0/0xdfc0fb148802c44 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632bb expref: 20690 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.887987:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882530880 00010000:00010000:0.0:1713481296.887988:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.887990:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563605 00010000:00010000:2.0:1713481296.887992:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800733dbcc0/0xdfc0fb1486898bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d332f expref: 26778 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.887996:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16946:11388:x1796714882530560:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.887998:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d04f600/0xdfc0fb148a3c3a4 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49deb expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.887998:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531072 00000100:00100000:2.0:1713481296.887999:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531072 00000100:00100000:1.0:1713481296.888002:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820710 00010000:00010000:2.0:1713481296.888003:0:16520:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e86c0/0xdfc0fb1486898c3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d333d expref: 26779 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.888004:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.888007:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20690:1959:x1796714882530752:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.888009:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820711 00000100:00100000:2.0:1713481296.888012:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20690:1959:x1796714882530624:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.888013:0:15562:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880120960480/0xdfc0fb14895a168 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecf6 expref: 16947 pid: 16476 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.888013:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3c3ab lrc: 2/0,0 mode: --/PW res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49df2 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888014:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.888016:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.888018:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096ce6ac0/0xdfc0fb148802c3d lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632ad expref: 20690 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.888019:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888019:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f159f80/0xdfc0fb148802c36 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96329f expref: 20690 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.888021:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.888024:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d04f600/0xdfc0fb148a3c3a4 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49deb expref: 16948 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888024:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f159f80/0xdfc0fb148802c36 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96329f expref: 20690 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.888025:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096ce6ac0/0xdfc0fb148802c3d lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632ad expref: 20690 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.888028:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f8cfc0/0xdfc0fb14894219c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f7 expref: 20690 pid: 16480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.888034:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f159f80/0xdfc0fb148802c36 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x277d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96329f expref: 20690 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.888035:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.888036:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.888039:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3c3ab lrc: 4/0,0 mode: --/PW res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49df2 expref: 16948 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888040:0:15562:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880120960480/0xdfc0fb14895a168 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecf6 expref: 16948 pid: 16476 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.888041:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.888042:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096ce6ac0/0xdfc0fb148802c3d lrc: 0/0,0 mode: --/PR res: [0x280000408:0x277e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632ad expref: 20689 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.888042:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888043:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888048:0:15562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880120960480/0xdfc0fb14895a168 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecf6 expref: 16948 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.888048:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.888054:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f8cfc0/0xdfc0fb14894219c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f7 expref: 20688 pid: 16480 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.888057:0:15562:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784561792:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.888057:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888057:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.888059:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.888062:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.888062:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f8cfc0/0xdfc0fb14894219c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f7 expref: 20688 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.888065:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20688:1959:x1796714882530624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.888069:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.888069:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820711 00000100:00100000:3.0:1713481296.888072:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b0fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784561856:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.888076:0:15562:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091872c00 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.888081:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820712 00000100:00100000:2.0:1713481296.888083:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26779:1957:x1796714882530688:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.888087:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.888087:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801243043c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.888088:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.888090:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133df3a80/0xdfc0fb1486898b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3321 expref: 26779 pid: 16535 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.888095:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133df3a80/0xdfc0fb1486898b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3321 expref: 26779 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.888096:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820713 00000100:00100000:0.0:1713481296.888101:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20687:1957:x1796714882531008:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.888103:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20687:1959:x1796714882530752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (236us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.888105:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133df3a80/0xdfc0fb1486898b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3321 expref: 26779 pid: 16535 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.888108:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.888108:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563606 00000100:00100000:1.0:1713481296.888109:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820710 00010000:00010000:0.0:1713481296.888113:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095d44480/0xdfc0fb148802c4b lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632c9 expref: 20687 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.888113:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888114:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.888114:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20687:15045:x1796714882530816:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.888115:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888134:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.888141:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.888142:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095d44480/0xdfc0fb148802c4b lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632c9 expref: 20687 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.888143:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.888152:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820714 00000100:00100000:2.0:1713481296.888152:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1957:x1796714882530688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (259us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.888153:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3c3b2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49df9 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.888155:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820712 00000100:00100000:1.0:1713481296.888157:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20686:1959:x1796714882530944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.888163:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d44480/0xdfc0fb148802c4b lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632c9 expref: 20686 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.888165:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.888166:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820715 00000100:00100000:2.0:1713481296.888168:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26777:1957:x1796714882530880:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.888169:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801345006c0/0xdfc0fb148802c44 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x277f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632bb expref: 20686 pid: 16538 timeout: 815 lvb_type: 1 00002000:00010000:3.0:1713481296.888171:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.888173:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888173:0:16520:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.888174:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888175:0:16520:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800733dbcc0/0xdfc0fb1486898bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d332f expref: 26777 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.888176:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888178:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801345006c0/0xdfc0fb148802c44 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x277f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632bb expref: 20686 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.888181:0:16520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800733dbcc0/0xdfc0fb1486898bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d332f expref: 26777 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.888182:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.888183:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.888183:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.888188:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3c3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49df9 expref: 20686 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888191:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800733dbcc0/0xdfc0fb1486898bc lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d332f expref: 26777 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.888197:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801345006c0/0xdfc0fb148802c44 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x277f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632bb expref: 20686 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.888199:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.888199:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081c50240/0xdfc0fb148a3c3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49df9 expref: 20686 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888200:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.888200:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888201:0:16520:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888206:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.888207:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081c50240, rc 0) 00010000:00010000:1.0:1713481296.888213:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.888214:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20685:1957:x1796714882531008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 112us (295us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.888214:0:16520:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.888215:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.888217:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.888219:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820713 00010000:00010000:1.0:1713481296.888224:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.888224:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20685:15045:x1796714882530816:12345-192.168.202.24@tcp:101:dd.0 Request processed in 110us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.888225:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26776:1957:x1796714882530880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.888228:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820715 00000100:00100000:3.0:1713481296.888232:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563606 00000100:00100000:0.0:1713481296.888238:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820716 00000100:00100000:0.0:1713481296.888242:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26775:1957:x1796714882531072:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.888242:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.888248:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.888253:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e86c0/0xdfc0fb1486898c3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d333d expref: 26775 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.888258:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20683:1959:x1796714882530944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 99us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.888261:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e86c0/0xdfc0fb1486898c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d333d expref: 26775 pid: 16454 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.888264:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820714 00010000:00010000:2.0:1713481296.888264:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888271:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888276:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.888277:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888278:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888280:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888284:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888286:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888288:0:16509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888294:0:16509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888294:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888299:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.888299:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009708d8c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.888302:0:16509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888302:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888308:0:16509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888308:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.888311:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26775:1957:x1796714882531072:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 68us (355us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.888315:0:16509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.888316:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820716 00010000:00010000:2.0:1713481296.888320:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888321:0:16509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800980846c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.888323:0:16509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888325:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009708d8c0/0xdfc0fb148a3c238 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x277d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888330:0:16509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888341:0:16509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888352:0:16509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800980846c0/0xdfc0fb148a3c246 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888357:0:16515:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888365:0:16515:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888371:0:16515:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888382:0:16515:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888388:0:16515:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888394:0:16515:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f2d6d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.888397:0:16515:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888403:0:16515:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888418:0:16515:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888425:0:16515:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2d6d00/0xdfc0fb148a3c262 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.888432:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+311:3493:x1796714784558336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7943us (7970us total) trans 4296040974 rc 0/0 00000100:00100000:2.0:1713481296.888437:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563580 00000100:00100000:1.0:1713481296.888483:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+2896:3493:x1796714784558592:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7151us (7173us total) trans 4295960839 rc 0/0 00000100:00100000:1.0:1713481296.888489:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563582 00010000:00010000:1.0:1713481296.888517:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888523:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888530:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888534:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888538:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888541:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f2d7600 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.888543:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888547:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888558:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888562:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2d7600/0xdfc0fb148a3c25b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x277f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.888585:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+311:3492:x1796714784559104:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6562us (6602us total) trans 4296040975 rc 0/0 00000100:00100000:0.0:1713481296.888591:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563586 00010000:00010000:0.0:1713481296.888619:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888626:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888634:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888640:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888646:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888651:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f158b40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.888653:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.888654:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+311:3492:x1796714784558912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6789us (6912us total) trans 4296040976 rc 0/0 00000100:00100000:1.0:1713481296.888658:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563585 00010000:00010000:0.0:1713481296.888659:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888692:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.888694:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c896a00/2, rc 0, transno 1073679 00010000:00010000:1.0:1713481296.888695:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888698:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f158b40/0xdfc0fb148a3c254 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.888699:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784559104:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.888700:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888704:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.888704:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a0bc000/2, rc 0, transno 1073680 00000100:00100000:2.0:1713481296.888706:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a0bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784558912:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.888708:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888711:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888714:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d8f8fc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.888716:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888720:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888731:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 2/0,0 mode: --/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.888734:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c24d lrc: 0/0,0 mode: --/PW res: [0x280000408:0x277e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.888740:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784561984:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.888744:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784561920:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.888755:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.888776:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713481296.888779:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b361500/2, rc 0, transno 993543 00000100:00100000:2.0:1713481296.888786:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784558592:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1713481296.888795:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072ab5f80/2, rc 0, transno 1073678 00000100:00100000:2.0:1713481296.888798:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784558336:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.888816:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.888820:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784562048:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.888829:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+311:3490:x1796714784558656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7382us (7445us total) trans 4296040977 rc 0/0 00000100:00100000:1.0:1713481296.888833:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563583 00000100:00100000:0.0:1713481296.888837:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2896:3491:x1796714784558848:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7098us (7172us total) trans 4295960840 rc 0/0 00000100:00100000:2.0:1713481296.888839:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.888843:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563584 00000004:00080000:3.0:1713481296.888846:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b363b80/2, rc 0, transno 993544 00000100:00100000:1.0:1713481296.888847:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561984 00000100:00100000:1.0:1713481296.888849:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561984 00000100:00100000:3.0:1713481296.888853:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784558848:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.888856:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b0faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784562112:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.888859:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784561920 00000100:00100000:1.0:1713481296.888860:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784561920 00000100:00100000:0.0:1713481296.888863:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784562048 00000100:00100000:2.0:1713481296.888865:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.888866:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784562048 00000100:00100000:1.0:1713481296.888868:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563607 00000100:00100000:1.0:1713481296.888870:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+313:3492:x1796714784561984:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713481296.888876:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072a16300/2, rc 0, transno 1073681 00002000:00080000:1.0:1713481296.888878:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10118 count 1 00000100:00100000:2.0:1713481296.888879:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784558656:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.888882:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784562112 00000100:00100000:0.0:1713481296.888884:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784562112 00000100:00100000:2.0:1713481296.888884:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713481296.888886:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.888887:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b0fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784562176:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.888894:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f15a400/0xdfc0fb148802c6e lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96331d expref: 20682 pid: 9202 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.888895:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.888896:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563608 00000100:00100000:0.0:1713481296.888900:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+313:3491:x1796714784561920:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.888900:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.888901:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.888901:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784562176 00010000:00010000:1.0:1713481296.888904:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.888904:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784562176 00002000:00080000:0.0:1713481296.888911:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10117 count 1 00000100:00100000:2.0:1713481296.888914:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563609 00000100:00100000:2.0:1713481296.888917:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+313:3492:x1796714784562048:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.888920:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f15a400/0xdfc0fb148802c6e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96331d expref: 20682 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.888921:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.888926:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10119 count 1 00000100:00100000:3.0:1713481296.888928:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563610 00010000:00010000:1.0:1713481296.888929:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f15a400/0xdfc0fb148802c6e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96331d expref: 20682 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.888933:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880089a49f80/0xdfc0fb148803202 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96330f expref: 20682 pid: 16480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.888933:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2897:3490:x1796714784562112:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.888934:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.888938:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.888939:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.888939:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aa5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784562240:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.888941:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096ce4fc0/0xdfc0fb148802c75 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96332b expref: 20682 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.888942:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888945:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.888946:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713481296.888946:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43600 count 1 00010000:00010000:2.0:1713481296.888948:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.888955:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801224d3780 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.888957:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096ce4fc0/0xdfc0fb148802c75 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96332b expref: 20682 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.888958:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880089a49f80/0xdfc0fb148803202 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96330f expref: 20682 pid: 16480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.888958:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.888963:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096ce4fc0/0xdfc0fb148802c75 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96332b expref: 20682 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.888966:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880089a49f80/0xdfc0fb148803202 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96330f expref: 20682 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.888968:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084ae1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784562368:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.888973:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563611 00010000:00010000:3.0:1713481296.888975:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8fc0/0xdfc0fb1486898ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3391 expref: 26774 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.888976:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c03480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784562304:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.888978:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2897:3490:x1796714784562176:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.888978:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.888982:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.888983:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.888986:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.888990:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43602 count 1 00000100:00100000:0.0:1713481296.888992:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.888997:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008afec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784562432:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.889001:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.889003:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e8fc0/0xdfc0fb1486898ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3391 expref: 26774 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.889007:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.889010:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121693cc0/0xdfc0fb1486898f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d339f expref: 26774 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.889012:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e8fc0/0xdfc0fb1486898ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3391 expref: 26774 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.889013:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889014:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889016:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.889023:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784562496:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.889026:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e86c0/0xdfc0fb1486898c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d333d expref: 26774 pid: 16454 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.889028:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121693cc0/0xdfc0fb1486898f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d339f expref: 26774 pid: 15542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.889031:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784562432 00000100:00100000:2.0:1713481296.889033:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784562432 00010000:00010000:1.0:1713481296.889036:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121693cc0/0xdfc0fb1486898f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d339f expref: 26774 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.889041:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ab15840 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.889042:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009406b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784559616:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.889043:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aa5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784562560:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.889044:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563612 00000100:00100000:2.0:1713481296.889046:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008afedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+314:3492:x1796714784562432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.889053:0:16532:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10120 count 1 00000100:00100000:1.0:1713481296.889055:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086caed80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.889060:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889061:0:16532:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889067:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889067:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a668fc0/0xdfc0fb148802ca6 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963339 expref: 20682 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.889071:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.889072:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.889073:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889074:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.889076:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.889080:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889083:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a668fc0/0xdfc0fb148802ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963339 expref: 20682 pid: 16497 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.889086:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531136 00010000:00010000:0.0:1713481296.889087:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.889088:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531136 00010000:00010000:2.0:1713481296.889088:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a668fc0/0xdfc0fb148802ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963339 expref: 20682 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.889093:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.889093:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085cad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784562624:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.889098:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e0e9680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.889101:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.889102:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a000 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.889107:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.889109:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563613 00000100:00100000:1.0:1713481296.889112:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26774:17935:x1796714882531136:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.889132:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.889141:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800849acd80/0xdfc0fb148a3c3e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb79e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e00 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889144:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889151:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c27e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.889151:0:16509:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb79e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.889156:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889157:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889160:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800849acd80/0xdfc0fb148a3c3e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e00 expref: 26775 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889166:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800849acd80/0xdfc0fb148a3c3e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e00 expref: 26775 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889170:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800849acd80, rc 0) 00000100:00100000:1.0:1713481296.889180:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26775:17935:x1796714882531136:12345-192.168.202.24@tcp:101:dd.0 Request processed in 67us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.889184:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563613 00000100:00100000:1.0:1713481296.889218:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.889225:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531200 00000100:00100000:1.0:1713481296.889227:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531200 00000100:00100000:1.0:1713481296.889244:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563614 00000100:00100000:1.0:1713481296.889247:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ded0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20683:17924:x1796714882531200:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.889252:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.889258:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124e8d440/0xdfc0fb148a3c3ea lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e07 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889267:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350a86c0/0xdfc0fb148a15ff6 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3986e expref: 20684 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.889271:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889272:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889273:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124e8d440/0xdfc0fb148a3c3ea lrc: 4/0,0 mode: --/PW res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e07 expref: 20684 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889283:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350a86c0/0xdfc0fb148a15ff6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3986e expref: 20684 pid: 16453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.889287:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350a86c0/0xdfc0fb148a15ff6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3986e expref: 20684 pid: 16453 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.889292:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2898:3491:x1796714784559552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6198us (6292us total) trans 4295960841 rc 0/0 00000100:00100000:1.0:1713481296.889293:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aa5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784562688:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.889299:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563590 00000100:00100000:1.0:1713481296.889303:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096236840 going to sleep for 11 seconds 00000004:00080000:3.0:1713481296.889306:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b360700/2, rc 0, transno 993545 00000100:00100000:3.0:1713481296.889315:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784559552:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.889336:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800898a5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0000_UUID:16624:1796714784559744:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.889356:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.889363:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800898a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16948:1959:x1796714882528768:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5924us (5955us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.889368:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820699 00000100:00100000:0.0:1713481296.889377:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.889393:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531264 00000100:00100000:0.0:1713481296.889396:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531264 00000100:00100000:2.0:1713481296.889397:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.889403:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784562752:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.889412:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563615 00000100:00100000:0.0:1713481296.889416:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24480:10409:x1796714882531264:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:2.0:1713481296.889416:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.889424:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.889432:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c3f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e0e expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.889448:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.889449:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008372a1c0/0xdfc0fb14891d45a lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca739 expref: 24481 pid: 15498 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.889456:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990846c0/0xdfc0fb14893abc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db506 expref: 26774 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.889462:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.889464:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.889464:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784562752 00000100:00100000:3.0:1713481296.889464:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784559872:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.889466:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784562752 00010000:00010000:0.0:1713481296.889467:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c3f1 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e0e expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.889476:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531328 00000100:00100000:2.0:1713481296.889477:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531328 00010000:00010000:0.0:1713481296.889484:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990846c0/0xdfc0fb14893abc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db506 expref: 26774 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.889484:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563616 00000100:00100000:2.0:1713481296.889486:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2898:3492:x1796714784562752:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.889493:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990846c0/0xdfc0fb14893abc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db506 expref: 26774 pid: 16541 timeout: 815 lvb_type: 1 00002000:00080000:2.0:1713481296.889493:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43604 count 1 00010000:00010000:3.0:1713481296.889493:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889501:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.889502:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784562816:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.889508:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782eb600/0xdfc0fb1486898fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33ad expref: 26774 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.889511:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.889512:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.889514:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889523:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008372a1c0/0xdfc0fb14891d45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca739 expref: 24481 pid: 15498 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.889524:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782eb600/0xdfc0fb1486898fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33ad expref: 26774 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.889530:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782eb600/0xdfc0fb1486898fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33ad expref: 26774 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.889531:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008372a1c0/0xdfc0fb14891d45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca739 expref: 24481 pid: 15498 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.889535:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784562944:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.889540:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097717100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784562880:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.889544:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.889545:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a900 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.889552:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091872000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.889558:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531392 00000100:00100000:2.0:1713481296.889559:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531392 00000100:00100000:1.0:1713481296.889562:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1713481296.889568:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531520 00000100:00100000:2.0:1713481296.889572:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563617 00000100:00100000:3.0:1713481296.889572:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531520 00000100:00100000:2.0:1713481296.889575:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16949:18836:x1796714882531328:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713481296.889580:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563618 00010000:00010000:2.0:1713481296.889580:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.889585:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784560128:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.889586:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16949:17009:x1796714882531392:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.889588:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e880/0xdfc0fb148a3c3ff lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e15 expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889593:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713481296.889598:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563619 00010000:00010000:2.0:1713481296.889602:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fe6400/0xdfc0fb14891fffe lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc4a5 expref: 20684 pid: 16453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889603:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098084000/0xdfc0fb148a3c406 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xceac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e1c expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889603:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.889603:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26775:18817:x1796714882531520:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.889608:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713481296.889610:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713481296.889611:0:16503:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.889613:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e880/0xdfc0fb148a3c3ff lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e15 expref: 16950 pid: 15510 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.889615:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xceac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713481296.889621:0:16503:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c40d lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e23 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889624:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.889625:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.889628:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132fe6400/0xdfc0fb14891fffe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc4a5 expref: 20684 pid: 16453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889630:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098084000/0xdfc0fb148a3c406 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e1c expref: 16951 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.889631:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.889635:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132fe6400/0xdfc0fb14891fffe lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc4a5 expref: 20684 pid: 16453 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.889638:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531584 00010000:00010000:3.0:1713481296.889639:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800770bf180/0xdfc0fb1489d034c lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2253d expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889640:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098084000/0xdfc0fb148a3c406 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e1c expref: 16951 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.889640:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531584 00000100:00100000:2.0:1713481296.889643:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784563008:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.889646:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.889647:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098084000, rc 0) 00010000:00010000:3.0:1713481296.889647:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713481296.889648:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f158240/0xdfc0fb148802c52 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632d7 expref: 20685 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.889650:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c40d lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e23 expref: 26776 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.889658:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820717 00000100:00100000:2.0:1713481296.889658:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a600 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.889660:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20685:1958:x1796714882531584:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.889681:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16951:17009:x1796714882531392:12345-192.168.202.24@tcp:101:dd.0 Request processed in 77us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.889683:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.889686:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f158240/0xdfc0fb148802c52 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2781:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632d7 expref: 20685 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.889686:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800770bf180/0xdfc0fb1489d034c lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2253d expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.889687:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563618 00010000:00010000:1.0:1713481296.889692:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f158240/0xdfc0fb148802c52 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2781:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632d7 expref: 20685 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.889695:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880089a91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784560384:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.889696:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800770bf180/0xdfc0fb1489d034c lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2253d expref: 24481 pid: 16515 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.889705:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f158240/0xdfc0fb148802c52 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2781:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632d7 expref: 20685 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.889707:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784563072:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.889713:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889714:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889715:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889719:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889720:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.889726:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6780 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.889732:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.889742:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20684:1958:x1796714882531584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.889746:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820717 00000100:00100000:0.0:1713481296.889753:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.889764:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889768:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889772:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.889775:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531712 00010000:00010000:1.0:1713481296.889776:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.889777:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531712 00010000:00010000:1.0:1713481296.889783:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.889786:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880092a5e1c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.889788:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.889790:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563620 00010000:00010000:1.0:1713481296.889792:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.889793:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16951:8499:x1796714882531712:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.889798:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889798:0:16487:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.889799:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.889801:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a5e1c0/0xdfc0fb148a3c2a1 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889804:0:16487:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c414 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e2a expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889814:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991ddf80/0xdfc0fb1488e7eca lrc: 2/0,0 mode: PR/PR res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b554f expref: 16952 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.889818:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.889819:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.889821:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c414 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e2a expref: 16952 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.889833:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991ddf80/0xdfc0fb1488e7eca lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b554f expref: 16952 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.889838:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991ddf80/0xdfc0fb1488e7eca lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b554f expref: 16952 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.889843:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784563136:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.889854:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.889902:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+315:3493:x1796714784560064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5515us (5613us total) trans 4296040978 rc 0/0 00000100:00100000:0.0:1713481296.889905:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.889907:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563593 00000004:00080000:2.0:1713481296.889918:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ec3ca80/2, rc 0, transno 1073682 00000100:00100000:1.0:1713481296.889924:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531648 00000100:00100000:2.0:1713481296.889925:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784560064:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.889926:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531648 00000100:00100000:0.0:1713481296.889928:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531456 00000100:00100000:0.0:1713481296.889931:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531456 00010000:00010000:1.0:1713481296.889933:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e8d80/0xdfc0fb1486898d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3359 expref: 26777 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.889943:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820718 00010000:00010000:0.0:1713481296.889944:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801216918c0/0xdfc0fb1486898ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d334b expref: 26778 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.889946:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1960:x1796714882531648:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.889950:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.889952:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e8d80/0xdfc0fb1486898d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3359 expref: 26778 pid: 16527 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.889957:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e8d80/0xdfc0fb1486898d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3359 expref: 26778 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.889963:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820719 00000100:00100000:2.0:1713481296.889964:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784563200:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.889966:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8d80/0xdfc0fb1486898d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3359 expref: 26778 pid: 16527 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.889968:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26778:1960:x1796714882531456:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.889972:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889973:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.889974:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889975:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.889978:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.889979:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801216918c0/0xdfc0fb1486898ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d334b expref: 26777 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.889983:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.889988:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.889989:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801216918c0/0xdfc0fb1486898ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d334b expref: 26777 pid: 16535 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.889999:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26777:1960:x1796714882531648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 52us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.890002:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820718 00010000:00010000:0.0:1713481296.890006:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801216918c0/0xdfc0fb1486898ca lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d334b expref: 26777 pid: 16535 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.890012:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.890016:0:16490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784563200 00000100:00100000:1.0:1713481296.890017:0:16490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784563200 00010000:00010000:2.0:1713481296.890017:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.890019:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.890021:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.890021:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.890024:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.890025:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563621 00010000:00010000:2.0:1713481296.890025:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.890027:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+315:3490:x1796714784563200:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.890030:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.890032:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713481296.890034:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10121 count 1 00010000:00010000:2.0:1713481296.890035:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121d1d680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.890037:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.890041:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.890042:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.890048:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880086d58000/0xdfc0fb148802c7c lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963347 expref: 20683 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.890050:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.890052:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.890053:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.890054:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.890054:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121d1d680/0xdfc0fb148a3c2a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.890056:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.890061:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.890063:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880086d58000/0xdfc0fb148802c7c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963347 expref: 20683 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.890068:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880086d58000/0xdfc0fb148802c7c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963347 expref: 20683 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.890069:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.890071:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26775:1960:x1796714882531456:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.890074:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784563264:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.890077:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820719 00010000:00010000:3.0:1713481296.890082:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.890085:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008323e300 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.890089:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.890096:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.890102:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c50d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.890105:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.890112:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.890149:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.890156:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c28c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.890175:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2899:3491:x1796714784560256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5469us (5612us total) trans 4295960842 rc 0/0 00000100:00100000:2.0:1713481296.890180:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563594 00000100:00100000:3.0:1713481296.890303:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+2899:3493:x1796714784559808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6614us (6695us total) trans 4295960843 rc 0/0 00000004:00080000:2.0:1713481296.890304:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b363480/2, rc 0, transno 993547 00000100:00100000:2.0:1713481296.890309:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784559808:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.890311:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563592 00000100:00100000:2.0:1713481296.890328:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713481296.890332:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784563328:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.890344:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713481296.890357:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880072b4e680/2, rc 0, transno 993546 00000100:00100000:3.0:1713481296.890366:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880072b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784560256:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.890384:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784563328 00000100:00100000:2.0:1713481296.890385:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784563392:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.890387:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784563328 00000100:00100000:2.0:1713481296.890396:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.890403:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784563392 00000100:00100000:3.0:1713481296.890405:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784563392 00000100:00100000:2.0:1713481296.890433:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563622 00000100:00100000:2.0:1713481296.890436:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2900:3490:x1796714784563328:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.890437:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563623 00000100:00100000:3.0:1713481296.890442:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+2900:3492:x1796714784563392:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.890444:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43606 count 1 00010000:00010000:2.0:1713481296.890453:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.890455:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43608 count 1 00010000:00010000:2.0:1713481296.890460:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098409d40/0xdfc0fb148689917 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33bb expref: 26774 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.890464:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.890465:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.890466:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.890468:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.890474:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098409d40/0xdfc0fb148689917 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33bb expref: 26774 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.890479:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098409d40/0xdfc0fb148689917 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33bb expref: 26774 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.890479:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121692d00/0xdfc0fb148689902 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33c9 expref: 26774 pid: 15542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.890485:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784563456:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.890485:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.890487:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.890489:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.890494:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a540 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.890507:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121692d00/0xdfc0fb148689902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33c9 expref: 26774 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.890516:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121692d00/0xdfc0fb148689902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33c9 expref: 26774 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.890525:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784563520:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.890545:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965dc480 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.891256:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012003ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784560640:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.891281:0:16541:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.891288:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c02680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16582:1796714784561024:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.891316:0:15509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:15509:1796714784560832:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.891316:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120039180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784560768:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.891336:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.891352:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.891352:0:15509:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.891403:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20683:1959:x1796714882529408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5542us (5614us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.891408:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820708 00000100:00100000:1.0:1713481296.891421:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.891464:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531776 00000100:00100000:0.0:1713481296.891466:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531776 00010000:00010000:0.0:1713481296.891480:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800733d9440/0xdfc0fb1486898df lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3367 expref: 26775 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.891480:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.891490:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.891497:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531840 00000100:00100000:0.0:1713481296.891499:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531840 00010000:00010000:0.0:1713481296.891505:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce7600/0xdfc0fb148802c59 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632e5 expref: 20683 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.891512:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820720 00000100:00100000:2.0:1713481296.891515:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531968 00000100:00100000:0.0:1713481296.891516:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820721 00000100:00100000:1.0:1713481296.891517:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26775:1959:x1796714882531776:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.891518:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531968 00010000:00010000:1.0:1713481296.891523:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.891527:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800733d9440/0xdfc0fb1486898df lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3367 expref: 26775 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.891532:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563624 00010000:00010000:1.0:1713481296.891534:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800733d9440/0xdfc0fb1486898df lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3367 expref: 26775 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.891535:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20684:18792:x1796714882531968:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713481296.891541:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.891549:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800733d9440/0xdfc0fb1486898df lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3367 expref: 26775 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.891551:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d68480/0xdfc0fb148a3c430 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc52d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e31 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891557:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.891559:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20684:1959:x1796714882531840:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.891559:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.891561:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.891564:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc52d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.891565:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.891566:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.891568:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096ce7600/0xdfc0fb148802c59 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2782:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632e5 expref: 20684 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.891574:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096ce7600/0xdfc0fb148802c59 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2782:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632e5 expref: 20685 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.891575:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.891577:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.891577:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.891581:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d68480/0xdfc0fb148a3c430 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e31 expref: 20685 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.891586:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096ce7600/0xdfc0fb148802c59 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2782:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632e5 expref: 20685 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.891590:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095d68480/0xdfc0fb148a3c430 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e31 expref: 20685 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.891592:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26774:1959:x1796714882531776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 75us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.891596:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.891596:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820720 00010000:00010000:0.0:1713481296.891597:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.891597:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d68480, rc 0) 00010000:00010000:0.0:1713481296.891599:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.891604:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.891616:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20684:18792:x1796714882531968:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 79us (123us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.891618:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.891620:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.891622:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563624 00000100:00100000:0.0:1713481296.891629:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20684:1959:x1796714882531840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 110us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.891630:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882531904 00000100:00100000:1.0:1713481296.891632:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882531904 00000100:00100000:0.0:1713481296.891633:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820721 00010000:00010000:1.0:1713481296.891640:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134503180/0xdfc0fb148802c60 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632f3 expref: 20684 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.891645:0:16541:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.891651:0:16541:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.891655:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820722 00010000:00010000:2.0:1713481296.891657:0:16541:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.891658:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20683:1958:x1796714882531904:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.891676:0:16541:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891678:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.891681:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134503180/0xdfc0fb148802c60 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2783:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632f3 expref: 20683 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.891683:0:16541:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891687:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134503180/0xdfc0fb148802c60 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2783:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632f3 expref: 20683 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.891688:0:16541:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121d1d440 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.891689:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.891690:0:16541:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.891696:0:16541:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891701:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134503180/0xdfc0fb148802c60 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2783:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9632f3 expref: 20683 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.891709:0:16541:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891713:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.891714:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.891715:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.891715:0:16541:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121d1d440/0xdfc0fb148a3c2c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891720:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.891730:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.891730:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.891742:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20682:1958:x1796714882531904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 84us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.891745:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532160 00000100:00100000:1.0:1713481296.891746:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820722 00000100:00100000:0.0:1713481296.891747:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532160 00000100:00100000:0.0:1713481296.891759:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125712 00000100:00100000:0.0:1713481296.891762:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2168:18678:x1796714882532160:12345-192.168.202.24@tcp:35:rm.0 00010000:00010000:1.0:1713481296.891763:0:15509:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891768:0:15509:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891772:0:15509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891776:0:15509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891779:0:15509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891783:0:15509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e0eb840 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.891784:0:15509:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891788:0:15509:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891795:0:15509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.891799:0:15509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c2d2 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.891834:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800891b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:lustre-MDT0001-mdtlov_UUID+2901:3492:x1796714784560576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6874us (6911us total) trans 4295960844 rc 0/0 00000100:00100000:2.0:1713481296.891838:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563596 00000100:00100000:2.0:1713481296.891857:0:16541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532032 00000100:00100000:2.0:1713481296.891859:0:16541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532032 00000100:00100000:2.0:1713481296.891868:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563625 00000100:00100000:2.0:1713481296.891871:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:14753:x1796714882532032:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.891875:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:0.0:1713481296.891877:0:15487:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x9e:0x0].1843, 344 off1555312 00010000:00010000:2.0:1713481296.891882:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095d698c0/0xdfc0fb148a3c437 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e38 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.891892:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdd3cc0/0xdfc0fb148a13f3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3803b expref: 24483 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.891896:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.891897:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.891899:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d698c0/0xdfc0fb148a3c437 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e38 expref: 24483 pid: 16541 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1713481296.891903:0:15487:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0xb7:0x0].646, 424 off641728 00000100:00100000:1.0:1713481296.891905:0:15509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+316:3492:x1796714784560704:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6785us (6832us total) trans 4296040979 rc 0/0 00000004:00080000:0.0:1713481296.891906:0:15487:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009c43bb40 with version 16271 00010000:00010000:2.0:1713481296.891908:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdd3cc0/0xdfc0fb148a13f3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3803b expref: 24483 pid: 16524 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.891911:0:15509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563597 00010000:00010000:2.0:1713481296.891913:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cdd3cc0/0xdfc0fb148a13f3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3803b expref: 24483 pid: 16524 timeout: 815 lvb_type: 1 00000004:00080000:0.0:1713481296.891917:0:8638:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88007e4bd780 version 16271 rpc_version 16271 00000100:00100000:2.0:1713481296.891918:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784563584:192.168.202.24@tcp:104: 00000020:00100000:0.0:1713481296.891929:0:8638:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1713481296.891931:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e6b2480 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.891932:0:8638:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009c895c00 x1796714784563712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713481296.891942:0:8638:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c895c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784563712:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1713481296.891949:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012003bb80/2, rc 0, transno 1073683 00000100:00100000:2.0:1713481296.891953:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012003bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784560704:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713481296.891958:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008afeea00/2, rc 0, transno 993548 00000100:00100000:2.0:1713481296.891961:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008afeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784560576:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.891963:0:8638:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.891982:0:8638:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800981de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.891983:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784563712 00000100:00100000:1.0:1713481296.891987:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784563712 00000100:00100000:2.0:1713481296.891995:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713481296.892000:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784563776:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.892003:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713481296.892008:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82975 00000100:00100000:1.0:1713481296.892012:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+36:8638:x1796714784563712:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713481296.892013:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.892014:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784563840:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.892032:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784563776 00000100:00100000:2.0:1713481296.892034:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784563776 00000100:00100000:2.0:1713481296.892044:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563626 00000100:00100000:3.0:1713481296.892044:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.892046:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012003ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2901:3492:x1796714784563776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.892054:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43610 count 1 00000100:00100000:0.0:1713481296.892057:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784563840 00000100:00100000:0.0:1713481296.892060:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784563840 00010000:00010000:2.0:1713481296.892062:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892068:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121690fc0/0xdfc0fb148689909 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33d7 expref: 26773 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.892072:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.892073:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.892074:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563627 00010000:00010000:2.0:1713481296.892075:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.892076:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+316:3491:x1796714784563840:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.892084:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121690fc0/0xdfc0fb148689909 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33d7 expref: 26773 pid: 15542 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713481296.892085:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10122 count 1 00010000:00010000:2.0:1713481296.892092:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121690fc0/0xdfc0fb148689909 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33d7 expref: 26773 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.892093:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.892097:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784563904:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.892100:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f15b180/0xdfc0fb148802c83 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963355 expref: 20681 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.892107:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.892108:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.892110:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.892113:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb59180 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.892136:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f15b180/0xdfc0fb148802c83 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963355 expref: 20681 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.892141:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f15b180/0xdfc0fb148802c83 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963355 expref: 20681 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.892147:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121e9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784563968:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.892147:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.892149:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+37:8638:x1796714784563712:12345-0@lo:1000:osp_up1-0.0 Request processed in 135us (184us total) trans 4295107636 rc 0/0 00010000:00010000:2.0:1713481296.892151:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.892155:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82975 00010000:00010000:2.0:1713481296.892156:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892159:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.892161:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c1fcf00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.892163:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892166:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121d1c6c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.892168:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892171:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892180:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892184:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121d1c6c0/0xdfc0fb148a3c2cb lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.892193:0:8638:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c895c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8638:1796714784563712:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713481296.892227:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18678:x1796714882532160:12345-192.168.202.24@tcp:35:rm.0 Request processed in 464us (497us total) trans 4295105932 rc 0/0 00000100:00100000:0.0:1713481296.892231:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125712 00000100:00100000:2.0:1713481296.892303:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008afee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+317:3491:x1796714784560448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7421us (7451us total) trans 4296040980 rc 0/0 00000004:00080000:0.0:1713481296.892309:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e55f100/2, rc 0, transno 1073684 00000100:00100000:2.0:1713481296.892309:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563595 00000100:00100000:0.0:1713481296.892319:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784560448:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.892368:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800898a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784564032:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.892382:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.892398:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564032 00000100:00100000:2.0:1713481296.892402:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564032 00000100:00100000:2.0:1713481296.892418:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563628 00000100:00100000:2.0:1713481296.892421:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+317:3491:x1796714784564032:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.892432:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10123 count 1 00010000:00010000:2.0:1713481296.892441:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892448:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096ce6640/0xdfc0fb148802c8a lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963363 expref: 20681 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.892452:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.892453:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.892454:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.892465:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096ce6640/0xdfc0fb148802c8a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963363 expref: 20681 pid: 16497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.892478:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096ce6640/0xdfc0fb148802c8a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963363 expref: 20681 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.892487:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094069500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784564096:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.892520:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009fb59780 going to sleep for 11 seconds 00000001:00080000:3.0:1713481296.892970:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040965 00002000:00080000:3.0:1713481296.893062:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 57938 00000100:00100000:0.0:1713481296.893197:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.893229:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.893245:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532288 00000100:00100000:1.0:1713481296.893249:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532288 00000100:00100000:1.0:1713481296.893264:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532416 00000100:00100000:1.0:1713481296.893266:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532416 00000100:00100000:0.0:1713481296.893279:0:16495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16495:1796714784561344:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.893288:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485934 00000100:00100000:1.0:1713481296.893293:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2389:18729:x1796714882532288:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:0.0:1713481296.893303:0:16495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893316:0:15576:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.893317:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485935 00000100:00100000:2.0:1713481296.893322:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18578:x1796714882532416:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:1.0:1713481296.893328:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099062400/0xdfc0fb148a3c37a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x347f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dd6 expref: 2389 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893343:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff88009cbf1000) 00010000:00010000:2.0:1713481296.893354:0:15475:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713481296.893355:0:15576:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.893364:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008af43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784561408:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.893367:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880120bae640/0xdfc0fb148a3bee9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x37c5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ce1 expref: 2169 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893368:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.893374:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893380:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893388:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.893391:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893392:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092883a80/0xdfc0fb1489cba5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x37c5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa20260 expref: 2168 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893395:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.893398:0:15562:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15562:1796714784561792:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.893398:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.893403:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x0 (ffff8800919f3500) 00010000:00010000:2.0:1713481296.893414:0:15475:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.893423:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d04f600/0xdfc0fb148a3c3a4 lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49deb expref: 16952 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.893426:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:3.0:1713481296.893428:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784561600:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.893432:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:0.0:1713481296.893433:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d04f600, rc 0) 00010000:00010000:1.0:1713481296.893436:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.893439:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893443:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893448:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893449:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bcfc0/0xdfc0fb148a3c46f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x37c4:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00010000:00010000:3.0:1713481296.893450:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.893455:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:11552:x1796714882530496:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5473us (5631us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.893458:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bcfc0/0xdfc0fb148a3c46f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.893461:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563604 00010000:00010000:2.0:1713481296.893463:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bcfc0/0xdfc0fb148a3c46f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.893500:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.893502:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.893505:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893506:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893511:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893511:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893516:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.893518:0:15562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532480 00000100:00100000:0.0:1713481296.893521:0:15562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532480 00010000:00010000:1.0:1713481296.893521:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124e8cfc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.893524:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893529:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.893535:0:15562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563629 00010000:00010000:1.0:1713481296.893539:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x347f:0x0].0x0 (ffff880135313e00) 00000100:00100000:0.0:1713481296.893540:0:15562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:18844:x1796714882532480:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.893541:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713481296.893544:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.893546:0:15562:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.893548:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c468 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x347f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.893555:0:15562:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098087cc0/0xdfc0fb148a3c47d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e3f expref: -99 pid: 15562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.893567:0:15562:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.893571:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.893576:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.893576:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.893577:0:15562:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.893581:0:15562:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098087cc0/0xdfc0fb148a3c47d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e3f expref: 16953 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893581:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893586:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893590:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124e8e640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.893593:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.893595:0:15562:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098087cc0/0xdfc0fb148a3c47d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e3f expref: 16953 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893598:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:0.0:1713481296.893602:0:15562:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098087cc0, rc 0) 00010000:00010000:1.0:1713481296.893604:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.893606:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.893608:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000004:00200000:2.0:1713481296.893608:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x37c5:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.893613:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8e640/0xdfc0fb148a3c453 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893614:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.893618:0:15562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16953:18844:x1796714882532480:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 77us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.893618:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.893621:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00000100:00100000:0.0:1713481296.893624:0:15562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563629 00010000:00010000:2.0:1713481296.893624:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a9beac0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.893625:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893626:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893628:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893630:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893633:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c5:0x0].0x0 (ffff8800961a4400) 00010000:00010000:1.0:1713481296.893635:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893635:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.893637:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893638:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124e8f3c0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.893640:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893640:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9beac0/0xdfc0fb148a3c476 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x37c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893644:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893649:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff880135313400) 00010000:00010000:1.0:1713481296.893651:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.893653:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.893657:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.893657:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c45a lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:1.0:1713481296.893704:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:18729:x1796714882532288:12345-192.168.202.24@tcp:36:rm.0 Request processed in 411us (508us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713481296.893704:0:15475:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.893709:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485934 00010000:00010000:2.0:1713481296.893710:0:15475:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.893715:0:15475:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.893720:0:15475:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.893723:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532672 00000100:00100000:1.0:1713481296.893725:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532672 00010000:00010000:2.0:1713481296.893725:0:15475:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a9bd440 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.893727:0:15475:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.893732:0:15475:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.893737:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485936 00010000:00010000:2.0:1713481296.893739:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c4:0x0].0x0 (ffff8801302c2600) 00000100:00100000:1.0:1713481296.893740:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18988:x1796714882532672:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:2.0:1713481296.893742:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.893744:0:15475:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.893749:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bd440/0xdfc0fb148a3c461 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893765:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:2.0:1713481296.893765:0:15475:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88011faead80 reply state ffff88007c1a8000 transno 4295105933 ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bcfc0/0xdfc0fb148a3c46f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT0 00010000:00010000:2.0:1713481296.893771:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a9bcfc0/0xdfc0fb148a3c46f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT0 00010000:00010000:1.0:1713481296.893772:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097afa400/0xdfc0fb148a3c484 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e46 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.893775:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c4:0x0].0x3931 (ffff88011d822c00) 00010000:00010000:2.0:1713481296.893776:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713481296.893777:0:15475:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713481296.893798:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18578:x1796714882532416:12345-192.168.202.24@tcp:36:rm.0 Request processed in 476us (569us total) trans 4295105933 rc 0/0 00000100:00100000:2.0:1713481296.893803:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485935 00010000:00010000:1.0:1713481296.893814:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.893819:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893823:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893829:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.893833:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00000100:00100000:3.0:1713481296.893833:0:16493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784561856:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.893836:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:2.0:1713481296.893840:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784561664:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.893856:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121d1cb40/0xdfc0fb148a3c365 lrc: 3/0,0 mode: --/PW res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dcf expref: 20681 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893858:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1d40/0xdfc0fb148a3c499 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:0.0:1713481296.893860:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.893860:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3c3ab lrc: 3/0,0 mode: --/PW res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49df2 expref: 16952 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.893861:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1d40/0xdfc0fb148a3c499 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:2.0:1713481296.893863:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121d1cb40, rc 0) 00010000:00010000:1.0:1713481296.893865:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1d40/0xdfc0fb148a3c499 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00010000:00010000:3.0:1713481296.893871:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081c53cc0, rc 0) 00000100:00100000:2.0:1713481296.893874:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20681:10479:x1796714882529984:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6913us (6970us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.893879:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.893879:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563602 00000004:00200000:1.0:1713481296.893880:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x3474:0x0]: returning size 4096 00000004:00200000:1.0:1713481296.893883:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713481296.893892:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1d40/0xdfc0fb148a3c499 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:3.0:1713481296.893896:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:11388:x1796714882530560:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5899us (6057us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.893899:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT1 00000100:00100000:3.0:1713481296.893903:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563605 00010000:00010000:1.0:1713481296.893904:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893909:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893914:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893918:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097af9200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.893920:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893925:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893933:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:1.0:1713481296.893935:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.893938:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893942:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097af9200/0xdfc0fb148a3c48b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893956:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893961:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893966:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893971:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801204d1b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:1.0:1713481296.893973:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893978:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893985:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880135313c00) 00010000:00010000:1.0:1713481296.893987:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713481296.893989:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00010000:00010000:1.0:1713481296.893994:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c492 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT1 00000100:00100000:0.0:1713481296.894000:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532544 00000100:00100000:0.0:1713481296.894004:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532544 00010000:00010000:0.0:1713481296.894017:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880081723180/0xdfc0fb148a3011e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4323d expref: 2169 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.894023:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097afa400/0xdfc0fb148a3c484 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e46 expref: 2067 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894033:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1d40/0xdfc0fb148a3c499 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e46 expref: 2066 pid: 15576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.894034:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532736 00000100:00100000:0.0:1713481296.894036:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532736 00010000:00010000:1.0:1713481296.894037:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff880135313200) 00010000:00010000:1.0:1713481296.894039:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713481296.894040:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801204d1d40, rc 0) 00010000:00010000:0.0:1713481296.894045:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133df3840/0xdfc0fb1486898d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3375 expref: 26774 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.894056:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2066:18988:x1796714882532672:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 315us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.894060:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820723 00000100:00100000:1.0:1713481296.894060:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485936 00000100:00100000:0.0:1713481296.894065:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:1957:x1796714882532544:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.894072:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.894076:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880081723180/0xdfc0fb148a3011e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4323d expref: 2169 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.894089:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880081723180/0xdfc0fb148a3011e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4323d expref: 2169 pid: 15642 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.894100:0:8074:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5218:0x0].0x0 (ffff880092ed2100) 00010000:00010000:0.0:1713481296.894103:0:8074:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.894110:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.894115:0:8074:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.894151:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.894168:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:1957:x1796714882532544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.894174:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820723 00010000:00010000:2.0:1713481296.894184:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880081723180/0xdfc0fb148a3011e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5218:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa4323d expref: 2169 pid: 15642 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.894198:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078022d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000_UUID:15793:1796714784561280:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.894217:0:15793:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894220:0:15793:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894226:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00000100:00100000:2.0:1713481296.894253:0:15793:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009406b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784564160:0@lo:1000:mdt_io00_014.0 00000100:00100000:2.0:1713481296.894276:0:15793:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.894285:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820724 00000100:00100000:0.0:1713481296.894291:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011faea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26774:1957:x1796714882532736:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.894298:0:15793:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962ce180 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.894299:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.894303:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133df3840/0xdfc0fb1486898d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3375 expref: 26774 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.894312:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133df3840/0xdfc0fb1486898d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3375 expref: 26774 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.894316:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564160 00000100:00100000:1.0:1713481296.894319:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564160 00000100:00100000:2.0:1713481296.894321:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aa5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784562240:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.894330:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133df3840/0xdfc0fb1486898d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3375 expref: 26774 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.894334:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82976 00000100:00100000:1.0:1713481296.894337:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009406b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+37:15793:x1796714784564160:12345-0@lo:1000:mdt_io00_014.0 00010000:00010000:2.0:1713481296.894341:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.894344:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.894346:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.894349:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.894356:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.894373:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.894376:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894380:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894385:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.894386:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011faea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26773:1957:x1796714882532736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (506us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.894388:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.894392:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820724 00010000:00010000:2.0:1713481296.894392:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894396:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c50900 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.894398:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.894399:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009406b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+37:15793:x1796714784564160:12345-0@lo:1000:mdt_io00_014.0 Request processed in 59us (121us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.894402:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.894405:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82976 00010000:00010000:2.0:1713481296.894412:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894416:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081c50900/0xdfc0fb148a3c350 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.894451:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.894468:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532864 00000100:00100000:1.0:1713481296.894471:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532864 00010000:00010000:1.0:1713481296.894480:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086d58b40/0xdfc0fb148802c67 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963301 expref: 20681 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.894481:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.894491:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532992 00000100:00100000:1.0:1713481296.894492:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532992 00010000:00010000:1.0:1713481296.894499:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f8cfc0/0xdfc0fb14894219c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f7 expref: 20682 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.894502:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820725 00000100:00100000:0.0:1713481296.894507:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20682:1957:x1796714882532864:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.894513:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820726 00010000:00010000:0.0:1713481296.894514:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.894517:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20682:1957:x1796714882532992:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.894519:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086d58b40/0xdfc0fb148802c67 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963301 expref: 20682 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.894524:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.894524:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2902:3491:x1796714784561152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7911us (7962us total) trans 4295960845 rc 0/0 00010000:00010000:1.0:1713481296.894527:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f8cfc0/0xdfc0fb14894219c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6979:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f7 expref: 20682 pid: 16480 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.894528:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086d58b40/0xdfc0fb148802c67 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963301 expref: 20682 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.894529:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563600 00010000:00010000:1.0:1713481296.894536:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f8cfc0/0xdfc0fb14894219c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6979:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f7 expref: 20682 pid: 16480 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.894545:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086d58b40/0xdfc0fb148802c67 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963301 expref: 20682 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.894551:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f8cfc0/0xdfc0fb14894219c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6979:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03f7 expref: 20682 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.894557:0:15793:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009406b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_014:lustre-MDT0000-mdtlov_UUID:15793:1796714784564160:0@lo:1000:mdt_io00_014.0 00010000:00010000:0.0:1713481296.894565:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.894566:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.894566:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.894568:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.894569:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894572:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3c3ab lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49df2 expref: 16951 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.894576:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894578:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3c3ab lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49df2 expref: 16951 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894595:0:16552:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880081c53cc0/0xdfc0fb148a3c3ab lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6979:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49df2 expref: 16951 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.894601:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.894603:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800898a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784564224:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.894608:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.894609:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894612:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894615:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.894617:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.894618:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20680:1957:x1796714882532864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 111us (167us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.894618:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b161c0 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.894620:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59480 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.894620:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894622:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.894624:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820725 00010000:00010000:2.0:1713481296.894628:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5218:0x0].0x0 (ffff880092ed2100) 00010000:00010000:2.0:1713481296.894630:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.894631:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.894631:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894634:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b161c0/0xdfc0fb148a3c342 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.894638:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.894645:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.894651:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c51b00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.894654:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894656:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894659:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.894660:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.894678:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008af41f80/2, rc 0, transno 993549 00010000:00010000:2.0:1713481296.894680:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894683:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ccd200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.894685:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.894688:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008af41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784561152:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.894688:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.894690:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894693:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880132b7e800) 00010000:00010000:2.0:1713481296.894694:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.894696:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:3.0:1713481296.894696:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081c51b00/0xdfc0fb148a3c357 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894698:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccd200/0xdfc0fb148a3c32d lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000004:00080000:2.0:1713481296.894717:0:15793:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x2be4:0x0] 00010000:00010000:2.0:1713481296.894721:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894725:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894729:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894742:0:15793:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713481296.894749:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894754:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894758:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.894762:0:15565:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713481296.894763:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091cce640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.894765:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.894766:0:15565:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894770:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.894771:0:15565:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ccfa80 already unused, calling callback (ffffffffa0efd520) 00000100:00100000:0.0:1713481296.894773:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c03480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16523:1796714784562304:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.894774:0:15565:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894777:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff880086fad400) 00000004:00010000:1.0:1713481296.894778:0:15565:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894779:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.894781:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894786:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cce640/0xdfc0fb148a3c326 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.894791:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894793:0:15565:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894796:0:15565:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713481296.894805:0:15565:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 1/0,0 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894812:0:15565:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880091ccfa80/0xdfc0fb148a3c334 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdfc0fb148a3c33b expref: -99 pid: 15793 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.894813:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894819:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894824:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.894825:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.894827:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.894828:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713481296.894829:0:15565:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713481296.894829:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894833:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ca08b40 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:1.0:1713481296.894835:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800898a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784564288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.894835:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894840:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.894841:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532608 00000100:00100000:0.0:1713481296.894844:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532608 00010000:00010000:2.0:1713481296.894848:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:2.0:1713481296.894850:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.894851:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800798f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+319:3492:x1796714784561536:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8017us (8062us total) trans 4296040982 rc 0/0 00010000:00010000:2.0:1713481296.894852:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.894855:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009840a400/0xdfc0fb1486898e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3383 expref: 26773 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.894855:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.894857:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c318 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00000100:00100000:3.0:1713481296.894859:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563601 00010000:00010000:2.0:1713481296.894868:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.894870:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564288 00000100:00100000:0.0:1713481296.894872:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564288 00000004:00080000:1.0:1713481296.894874:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012003b100/2, rc 0, transno 1073686 00010000:00010000:2.0:1713481296.894874:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT0 00000100:00100000:1.0:1713481296.894879:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012003b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784561536:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.894879:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.894884:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ca09440 already unused, calling callback (ffffffffa0efc730) 00000100:00100000:0.0:1713481296.894886:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98402 00010000:00010000:2.0:1713481296.894886:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT0 00000100:00100000:0.0:1713481296.894890:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+37:3492:x1796714784564288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.894891:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT0 00000100:00100000:1.0:1713481296.894895:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820727 00010000:00010000:0.0:1713481296.894896:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.894897:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x32 (ffff8800992eef00) 00000100:00100000:1.0:1713481296.894898:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26773:1957:x1796714882532608:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.894899:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.894901:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.894903:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.894905:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ccd440/0xdfc0fb148a3c33b lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2be4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdfc0fb148a3c334 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894906:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009840a400/0xdfc0fb1486898e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3383 expref: 26773 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.894906:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09440/0xdfc0fb148a3c31f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.894912:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009840a400/0xdfc0fb1486898e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3383 expref: 26773 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.894917:0:9218:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2be4:0x0].0x0 (ffff880092a16a00) 00010000:00010000:1.0:1713481296.894923:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009840a400/0xdfc0fb1486898e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3383 expref: 26773 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.894932:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.894933:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.894933:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.894935:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.894940:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.894943:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:19010:x1796714882529920:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 8749us (8775us total) trans 0 rc -39/-39 00000100:00100000:2.0:1713481296.894948:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26117 00010000:00010000:1.0:1713481296.894951:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.894960:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+36:3492:x1796714784564288:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.894964:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26772:1957:x1796714882532608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.894965:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98402 00000100:00100000:1.0:1713481296.894968:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820727 00010000:00010000:0.0:1713481296.894989:0:16495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.894996:0:16495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.895003:0:16495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.895004:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ae1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784562368:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.895008:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800898a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3492:1796714784564288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.895010:0:16495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.895017:0:16495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.895018:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713481296.895022:0:16495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011e0ea880 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.895022:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009406b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784564352:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.895024:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.895025:0:16495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.895031:0:16495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.895035:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.895043:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784564416:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.895046:0:16495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.895052:0:16495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e0ea880/0xdfc0fb148a3c349 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.895063:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.895063:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564352 00000100:00100000:3.0:1713481296.895068:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564352 00000100:00100000:3.0:1713481296.895085:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564416 00000100:00100000:3.0:1713481296.895087:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564416 00000100:00100000:2.0:1713481296.895097:0:16462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563630 00000100:00100000:2.0:1713481296.895102:0:16462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2903:3492:x1796714784564352:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713481296.895104:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563631 00000100:00100000:3.0:1713481296.895108:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+319:3490:x1796714784564416:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.895115:0:16462:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43612 count 1 00002000:00080000:3.0:1713481296.895142:0:16481:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10124 count 1 00010000:00010000:2.0:1713481296.895151:0:16462:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.895155:0:16481:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.895157:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.895161:0:16462:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8b40/0xdfc0fb148689910 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33e5 expref: 26771 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.895166:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f5d8c0/0xdfc0fb148802c91 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963371 expref: 20679 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.895168:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.895169:0:16462:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.895172:0:16462:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.895173:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.895175:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.895178:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.895182:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.895186:0:16495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+2903:3491:x1796714784561216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8625us (8676us total) trans 4295960846 rc 0/0 00010000:00010000:2.0:1713481296.895189:0:16462:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e8b40/0xdfc0fb148689910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33e5 expref: 26771 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.895191:0:16495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563599 00010000:00010000:3.0:1713481296.895196:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f5d8c0/0xdfc0fb148802c91 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963371 expref: 20679 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.895198:0:16462:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e8b40/0xdfc0fb148689910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33e5 expref: 26771 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.895200:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.895206:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f5d8c0/0xdfc0fb148802c91 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963371 expref: 20679 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.895208:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532800 00000100:00100000:2.0:1713481296.895208:0:16462:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094068380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784564480:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.895210:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532800 00000100:00100000:3.0:1713481296.895217:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784564544:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.895219:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007995ed00/0xdfc0fb148916de5 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65bc expref: 20680 pid: 16460 timeout: 815 lvb_type: 1 00000004:00080000:0.0:1713481296.895221:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008af43b80/2, rc 0, transno 993550 00000100:00100000:2.0:1713481296.895225:0:16462:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.895226:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008af43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784561216:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.895228:0:8074:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882532928 00000100:00100000:1.0:1713481296.895229:0:8074:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882532928 00010000:00010000:1.0:1713481296.895234:0:8074:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880120960480/0xdfc0fb14895a168 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecf6 expref: 16952 pid: 16476 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.895236:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965dc600 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.895237:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533120 00000100:00100000:0.0:1713481296.895239:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533120 00000100:00100000:1.0:1713481296.895242:0:8074:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820728 00000100:00100000:1.0:1713481296.895245:0:8074:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20680:1957:x1796714882532800:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.895250:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125713 00010000:00010000:1.0:1713481296.895250:0:8074:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.895253:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a5bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2793:18930:x1796714882533120:12345-192.168.202.24@tcp:35:dd.0 00010000:00010000:1.0:1713481296.895259:0:8074:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007995ed00/0xdfc0fb148916de5 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xaf1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65bc expref: 20680 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.895262:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820729 00010000:00010000:1.0:1713481296.895264:0:8074:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007995ed00/0xdfc0fb148916de5 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xaf1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65bc expref: 20680 pid: 16460 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.895268:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:1957:x1796714882532928:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.895275:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.895277:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007995ed00/0xdfc0fb148916de5 lrc: 0/0,0 mode: --/PR res: [0x280000407:0xaf1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65bc expref: 20680 pid: 16460 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.895286:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880120960480/0xdfc0fb14895a168 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x6e23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecf6 expref: 16952 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.895288:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.895289:0:8074:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.895293:0:8074:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121d1cb40/0xdfc0fb148a3c365 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dcf expref: 20679 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895294:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880120960480/0xdfc0fb14895a168 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x6e23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecf6 expref: 16952 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.895300:0:8074:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1cb40/0xdfc0fb148a3c365 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dcf expref: 20679 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895312:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880120960480/0xdfc0fb14895a168 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x6e23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eecf6 expref: 16952 pid: 16476 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.895319:0:8074:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880121d1cb40/0xdfc0fb148a3c365 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xaf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49dcf expref: 20679 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895323:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.895325:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.895328:0:8074:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120406d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784564608:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.895328:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d04f600/0xdfc0fb148a3c3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49deb expref: 16951 pid: 15562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895335:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d04f600/0xdfc0fb148a3c3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49deb expref: 16951 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.895339:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a5bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18930:x1796714882533120:12345-192.168.202.24@tcp:35:dd.0 Request processed in 84us (155us total) trans 4295105934 rc 0/0 00000100:00100000:0.0:1713481296.895343:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125713 00000100:00100000:1.0:1713481296.895343:0:8074:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f869840 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.895351:0:16580:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011d04f600/0xdfc0fb148a3c3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x6e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49deb expref: 16951 pid: 15562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.895357:0:16580:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009406b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784564672:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.895374:0:16580:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.895405:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784562496:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.895407:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aa5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784562560:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.895430:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.895433:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.895455:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.895470:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.895475:0:16532:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085cad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784562624:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.895487:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533248 00000100:00100000:3.0:1713481296.895490:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533248 00000100:00100000:1.0:1713481296.895495:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784563264:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.895495:0:16532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.895505:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533504 00000100:00100000:3.0:1713481296.895507:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533504 00010000:00010000:1.0:1713481296.895508:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.895518:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563632 00000100:00100000:2.0:1713481296.895524:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800898a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:15045:x1796714882533248:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.895525:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563633 00000100:00100000:3.0:1713481296.895530:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:17935:x1796714882533504:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.895531:0:16509:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aa5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16509:1796714784562688:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.895531:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.895538:0:16493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.895540:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b3db00/0xdfc0fb148a3c4ae lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x9bee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e4d expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895546:0:16509:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124e8d440/0xdfc0fb148a3c3ea lrc: 3/0,0 mode: --/PW res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e07 expref: 20679 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.895550:0:16493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c4b5 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x9e55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e54 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713481296.895551:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0x9bee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.895553:0:16509:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124e8d440, rc 0) 00010000:00010000:2.0:1713481296.895559:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.895561:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.895562:0:16509:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ded0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20679:17924:x1796714882531200:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6314us (6344us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.895564:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3db00/0xdfc0fb148a3c4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e4d expref: 24485 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713481296.895564:0:16493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x9e55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713481296.895567:0:16509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563614 00010000:00010000:2.0:1713481296.895573:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b3db00/0xdfc0fb148a3c4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9bee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e4d expref: 24485 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.895575:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.895577:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.895581:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b3db00, rc 0) 00010000:00010000:3.0:1713481296.895581:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e54 expref: 16953 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.895592:0:16493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007c0d8900/0xdfc0fb148a3c4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e54 expref: 16953 pid: 16493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.895593:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800898a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24485:15045:x1796714882533248:12345-192.168.202.24@tcp:101:dd.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.895598:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563632 00010000:00010000:3.0:1713481296.895600:0:16493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c0d8900, rc 0) 00000100:00100000:3.0:1713481296.895618:0:16493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16953:17935:x1796714882533504:12345-192.168.202.24@tcp:101:dd.0 Request processed in 87us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.895624:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784562816:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.895625:0:16493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563633 00000100:00100000:2.0:1713481296.895636:0:15560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15560:1796714784562944:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.895637:0:16515:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097717100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784562880:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.895659:0:15560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.895684:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c3f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e0e expref: 24484 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.895687:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784563520:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.895694:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d04c480, rc 0) 00000100:00100000:2.0:1713481296.895702:0:16487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0000_UUID:16487:1796714784563136:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.895710:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24484:10409:x1796714882531264:12345-192.168.202.24@tcp:101:dd.0 Request processed in 6293us (6333us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.895712:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:3.0:1713481296.895714:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.895716:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563615 00000100:00100000:1.0:1713481296.895726:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533184 00000100:00100000:1.0:1713481296.895729:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533184 00010000:00010000:2.0:1713481296.895729:0:16487:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c414 lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e2a expref: 16952 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895739:0:16487:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007da133c0, rc 0) 00010000:00010000:1.0:1713481296.895740:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f15a400/0xdfc0fb148802c6e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96331d expref: 20679 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.895743:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784563072:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.895750:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121e9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784563968:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.895753:0:16487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:8499:x1796714882531712:12345-192.168.202.24@tcp:101:dd.0 Request processed in 5958us (6000us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.895757:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820730 00010000:00010000:3.0:1713481296.895761:0:16503:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c40d lrc: 3/0,0 mode: --/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e23 expref: 26771 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.895762:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20679:1958:x1796714882533184:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.895763:0:16487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563620 00010000:00010000:0.0:1713481296.895766:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895769:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713481296.895771:0:16503:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007aa15d40, rc 0) 00010000:00010000:1.0:1713481296.895773:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f15a400/0xdfc0fb148802c6e lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2786:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96331d expref: 20679 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.895780:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f15a400/0xdfc0fb148802c6e lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2786:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96331d expref: 20679 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.895788:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26771:18817:x1796714882531520:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6184us (6223us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.895794:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f15a400/0xdfc0fb148802c6e lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2786:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96331d expref: 20679 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.895795:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563619 00000100:00100000:2.0:1713481296.895800:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784563456:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.895801:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aa5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784564736:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.895803:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.895804:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.895806:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895811:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895813:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895821:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.895823:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.895830:0:9203:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094069180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784563904:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.895834:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20678:1958:x1796714882533184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.895837:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820730 00010000:00010000:2.0:1713481296.895842:0:9203:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.895851:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564736 00000100:00100000:3.0:1713481296.895855:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564736 00010000:00010000:1.0:1713481296.895858:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895862:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.895863:0:15510:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:15510:1796714784563008:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.895866:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895871:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.895873:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563634 00010000:00010000:1.0:1713481296.895874:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895878:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008484bcc0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:3.0:1713481296.895878:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aa5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2903:3491:x1796714784564736:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713481296.895879:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895883:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895886:0:15510:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e880/0xdfc0fb148a3c3ff lrc: 3/0,0 mode: --/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e15 expref: 16951 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.895890:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.895891:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43614 count 1 00010000:00010000:1.0:1713481296.895896:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008484bcc0/0xdfc0fb148a3c3b9 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.895896:0:15510:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e880, rc 0) 00010000:00010000:3.0:1713481296.895903:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.895907:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.895911:0:15510:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16951:18836:x1796714882531328:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 6334us (6461us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.895914:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012052f180/0xdfc0fb14868991e lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33f3 expref: 26770 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.895917:0:15510:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563617 00010000:00010000:3.0:1713481296.895920:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.895921:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.895924:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.895925:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533376 00000100:00100000:0.0:1713481296.895929:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533376 00010000:00010000:3.0:1713481296.895939:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012052f180/0xdfc0fb14868991e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33f3 expref: 26770 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.895941:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880089a49f80/0xdfc0fb148803202 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96330f expref: 20678 pid: 16480 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.895948:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012052f180/0xdfc0fb14868991e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33f3 expref: 26770 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.895951:0:16541:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0001_UUID:16541:1796714784563584:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.895959:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784564800:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.895960:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820731 00000100:00100000:0.0:1713481296.895964:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20678:1958:x1796714882533376:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.895971:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.895975:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880089a49f80/0xdfc0fb148803202 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2785:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96330f expref: 20678 pid: 16480 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.895975:0:16541:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095d698c0/0xdfc0fb148a3c437 lrc: 3/0,0 mode: --/PW res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e38 expref: 24483 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.895977:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800965dc480 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.895984:0:16541:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d698c0, rc 0) 00010000:00010000:0.0:1713481296.895989:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880089a49f80/0xdfc0fb148803202 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2785:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96330f expref: 20678 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.895997:0:16541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:14753:x1796714882532032:12345-192.168.202.24@tcp:101:dd.0 Request processed in 4124us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.896002:0:16541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563625 00010000:00010000:0.0:1713481296.896009:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880089a49f80/0xdfc0fb148803202 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2785:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96330f expref: 20678 pid: 16480 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.896018:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+320:3492:x1796714784561984:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7146us (7260us total) trans 4296040983 rc 0/0 00010000:00010000:0.0:1713481296.896022:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.896022:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563607 00010000:00010000:0.0:1713481296.896024:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.896027:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.896030:0:16498:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094069500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784564096:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.896033:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896045:0:16498:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896049:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713481296.896051:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120506a00/2, rc 0, transno 1073687 00000100:00100000:1.0:1713481296.896055:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784561984:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.896062:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20677:1958:x1796714882533376:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.896068:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820731 00000100:00100000:1.0:1713481296.896076:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784564864:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.896091:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896093:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.896097:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896104:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896116:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896116:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564864 00010000:00010000:0.0:1713481296.896144:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896145:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564864 00010000:00010000:0.0:1713481296.896150:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d04cfc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.896153:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896159:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896160:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563635 00000100:00100000:1.0:1713481296.896163:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+320:3492:x1796714784564864:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713481296.896171:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10125 count 1 00010000:00010000:0.0:1713481296.896172:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896179:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d04cfc0/0xdfc0fb148a3c3c0 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896179:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896187:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801345018c0/0xdfc0fb148802c98 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x278d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96337f expref: 20676 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.896191:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.896192:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.896193:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896203:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801345018c0/0xdfc0fb148802c98 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96337f expref: 20676 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.896208:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801345018c0/0xdfc0fb148802c98 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96337f expref: 20676 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.896214:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784564928:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.896226:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096236840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.896244:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.896254:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.896262:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533568 00000100:00100000:1.0:1713481296.896264:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533568 00010000:00010000:1.0:1713481296.896271:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121693cc0/0xdfc0fb1486898f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d339f expref: 26771 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.896274:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533312 00000100:00100000:0.0:1713481296.896278:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533312 00000100:00100000:1.0:1713481296.896281:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820732 00000100:00100000:1.0:1713481296.896284:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26771:1958:x1796714882533568:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.896288:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.896289:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce4fc0/0xdfc0fb148802c75 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96332b expref: 20677 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.896290:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121693cc0/0xdfc0fb1486898f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d339f expref: 26771 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.896295:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121693cc0/0xdfc0fb1486898f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d339f expref: 26771 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.896305:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121693cc0/0xdfc0fb1486898f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d339f expref: 26771 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.896309:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820733 00000100:00100000:0.0:1713481296.896314:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20677:1958:x1796714882533312:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.896315:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.896315:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.896317:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896321:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896322:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.896326:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096ce4fc0/0xdfc0fb148802c75 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2787:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96332b expref: 20677 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.896333:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.896334:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096ce4fc0/0xdfc0fb148802c75 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2787:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96332b expref: 20677 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.896341:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26770:1958:x1796714882533568:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.896347:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820732 00010000:00010000:0.0:1713481296.896349:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096ce4fc0/0xdfc0fb148802c75 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2787:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96332b expref: 20677 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.896355:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+321:3491:x1796714784561920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7453us (7577us total) trans 4296040984 rc 0/0 00010000:00010000:1.0:1713481296.896361:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.896362:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563608 00010000:00010000:0.0:1713481296.896363:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.896365:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.896365:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896368:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896371:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896375:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896377:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896383:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896389:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.896389:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800849ac240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.896391:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896397:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.896404:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800798f9500/2, rc 0, transno 1073688 00000100:00100000:0.0:1713481296.896405:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20676:1958:x1796714882533312:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 91us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.896410:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800798f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784561920:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.896411:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.896412:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820733 00010000:00010000:1.0:1713481296.896417:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800849ac240/0xdfc0fb148a3c3d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896438:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896445:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896452:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896458:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.896465:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.896465:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896470:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121d1cd80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.896474:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896479:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.896485:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533440 00000100:00100000:0.0:1713481296.896488:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533440 00010000:00010000:2.0:1713481296.896489:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.896493:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121d1cd80/0xdfc0fb148a3c3c7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896499:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e8fc0/0xdfc0fb1486898ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3391 expref: 26770 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.896518:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820734 00000100:00100000:0.0:1713481296.896522:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26770:1958:x1796714882533440:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.896528:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.896531:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2904:3490:x1796714784562176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7552us (7634us total) trans 4295960847 rc 0/0 00010000:00010000:0.0:1713481296.896532:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e8fc0/0xdfc0fb1486898ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3391 expref: 26770 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.896536:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563611 00010000:00010000:0.0:1713481296.896540:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e8fc0/0xdfc0fb1486898ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3391 expref: 26770 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.896556:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8fc0/0xdfc0fb1486898ed lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3391 expref: 26770 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.896558:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713481296.896562:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784564992:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713481296.896565:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.896567:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.896570:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896574:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713481296.896576:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896586:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784564992 00000100:00100000:1.0:1713481296.896588:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784564992 00000100:00100000:1.0:1713481296.896597:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563636 00010000:00010000:0.0:1713481296.896600:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.896600:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+322:3492:x1796714784564992:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.896600:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+322:3492:x1796714784562048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7681us (7760us total) trans 4296040985 rc 0/0 00000100:00100000:2.0:1713481296.896605:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563609 00002000:00080000:1.0:1713481296.896607:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10126 count 1 00010000:00010000:3.0:1713481296.896607:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.896613:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26769:1958:x1796714882533440:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 89us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.896615:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.896616:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.896619:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820734 00010000:00010000:1.0:1713481296.896622:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f158d80/0xdfc0fb148802c9f lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96338d expref: 20675 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.896624:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896625:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.896626:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.896628:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 4/0,1 mode: --/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.896631:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896637:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f158d80/0xdfc0fb148802c9f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96338d expref: 20675 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.896637:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896642:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f158d80/0xdfc0fb148802c9f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96338d expref: 20675 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.896644:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007aa15680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.896647:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896648:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784565056:192.168.202.24@tcp:104: 00000004:00080000:0.0:1713481296.896649:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b0fbb80/2, rc 0, transno 993551 00010000:00010000:3.0:1713481296.896654:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.896657:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784562176:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.896658:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880086caed80 going to sleep for 11 seconds 00010000:00010000:3.0:1713481296.896688:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.896692:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e55d880/2, rc 0, transno 1073689 00010000:00010000:3.0:1713481296.896696:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007aa15680/0xdfc0fb148a3c3ce lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896697:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009e55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784562048:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.896706:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784565120:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.896717:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.896726:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.896739:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784565184:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.896742:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.896753:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.896761:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.896770:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533696 00000100:00100000:0.0:1713481296.896773:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533696 00000100:00100000:1.0:1713481296.896783:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.896784:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880086d58000/0xdfc0fb148802c7c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963347 expref: 20676 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.896789:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784565120 00000100:00100000:2.0:1713481296.896792:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784565120 00000100:00100000:1.0:1713481296.896801:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.896806:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534656 00000100:00100000:2.0:1713481296.896808:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534656 00000100:00100000:0.0:1713481296.896811:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533824 00000100:00100000:0.0:1713481296.896814:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533824 00000100:00100000:1.0:1713481296.896815:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533952 00000100:00100000:2.0:1713481296.896816:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784565184 00000100:00100000:1.0:1713481296.896818:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533952 00000100:00100000:2.0:1713481296.896818:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784565184 00010000:00010000:0.0:1713481296.896824:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098409d40/0xdfc0fb148689917 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33bb expref: 26770 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.896829:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121692d00/0xdfc0fb148689902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33c9 expref: 26770 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.896832:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563637 00000100:00100000:2.0:1713481296.896836:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2905:3490:x1796714784565120:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.896842:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820735 00000100:00100000:1.0:1713481296.896846:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820736 00000100:00100000:0.0:1713481296.896847:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20676:1960:x1796714882533696:12345-192.168.202.24@tcp:103:ldlm_bl.0 00002000:00080000:2.0:1713481296.896848:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43616 count 1 00000100:00100000:1.0:1713481296.896851:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26770:1960:x1796714882533824:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.896854:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713481296.896855:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2905:3490:x1796714784562112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7920us (7986us total) trans 4295960848 rc 0/0 00010000:00010000:0.0:1713481296.896858:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880086d58000/0xdfc0fb148802c7c lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2789:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963347 expref: 20676 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.896858:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.896858:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896862:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098409d40/0xdfc0fb148689917 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33bb expref: 26770 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.896863:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563610 00010000:00010000:0.0:1713481296.896867:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880086d58000/0xdfc0fb148802c7c lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2789:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963347 expref: 20676 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.896872:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098409d40/0xdfc0fb148689917 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33bb expref: 26770 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.896872:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121693180/0xdfc0fb148689925 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3401 expref: 26770 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.896879:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.896880:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.896882:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880086d58000/0xdfc0fb148802c7c lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2789:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963347 expref: 20676 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.896883:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896888:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098409d40/0xdfc0fb148689917 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33bb expref: 26770 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.896893:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.896893:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563638 00010000:00010000:0.0:1713481296.896895:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.896897:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121693180/0xdfc0fb148689925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3401 expref: 26769 pid: 15542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.896898:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.896898:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16951:17009:x1796714882534656:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:1.0:1713481296.896903:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.896904:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896905:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.896905:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121693180/0xdfc0fb148689925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3401 expref: 26769 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.896906:0:16528:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.896907:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.896914:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.896915:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784565248:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.896917:0:16528:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c4d8 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcead:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e5b expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896920:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.896929:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a600 going to sleep for 11 seconds 00002000:00010000:3.0:1713481296.896929:0:16528:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcead:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.896931:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.896935:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20675:1960:x1796714882533696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 87us (179us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.896939:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.896941:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820735 00010000:00010000:3.0:1713481296.896941:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.896943:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563639 00010000:00010000:3.0:1713481296.896945:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcead:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e5b expref: 16952 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.896946:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26769:1960:x1796714882533824:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 93us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.896947:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+322:3491:x1796714784565184:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.896952:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820736 00002000:00080000:2.0:1713481296.896955:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10127 count 1 00010000:00010000:3.0:1713481296.896956:0:16528:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d3f8480/0xdfc0fb148a3c4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcead:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e5b expref: 16952 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.896962:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820737 00010000:00010000:2.0:1713481296.896962:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.896964:0:16528:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d3f8480, rc 0) 00000100:00100000:0.0:1713481296.896966:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26768:1960:x1796714882533952:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.896968:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f5cfc0/0xdfc0fb148802cad lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96339b expref: 20674 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.896972:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.896972:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.896973:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.896975:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 4/0,1 mode: --/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.896977:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121692d00/0xdfc0fb148689902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33c9 expref: 26768 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.896981:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:17009:x1796714882534656:12345-192.168.202.24@tcp:101:dd.0 Request processed in 83us (237us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.896984:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f5cfc0/0xdfc0fb148802cad lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96339b expref: 20674 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.896985:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121692d00/0xdfc0fb148689902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33c9 expref: 26768 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.896988:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563638 00010000:00010000:2.0:1713481296.896989:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f5cfc0/0xdfc0fb148802cad lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96339b expref: 20674 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.896996:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784565312:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.897002:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121692d00/0xdfc0fb148689902 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33c9 expref: 26768 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.897005:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.897005:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a540 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.897013:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897013:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.897014:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.897016:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.897017:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.897019:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897020:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897021:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897025:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897027:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897028:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.897031:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897031:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880079bcaf40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.897033:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897033:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897040:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897043:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124e8dd40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.897046:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897051:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897052:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.897055:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.897057:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c422 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897060:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897064:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.897068:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26767:1960:x1796714882533952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 101us (267us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.897068:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897071:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124e8dd40/0xdfc0fb148a3c41b lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.897074:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820737 00010000:00010000:3.0:1713481296.897076:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897083:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897089:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897096:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832a9200 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.897099:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897105:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.897113:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b0faa00/2, rc 0, transno 993552 00000100:00100000:0.0:1713481296.897141:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784562112:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.897142:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897154:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800832a9200/0xdfc0fb148a3c429 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.897175:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ed90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784565376:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.897200:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.897200:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2905:3490:x1796714784563328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6762us (6853us total) trans 4295960849 rc 0/0 00000100:00100000:2.0:1713481296.897205:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563622 00000100:00100000:2.0:1713481296.897220:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784565376 00000100:00100000:2.0:1713481296.897222:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784565376 00000100:00100000:1.0:1713481296.897225:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+323:3490:x1796714784563200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7195us (7240us total) trans 4296040986 rc 0/0 00000100:00100000:1.0:1713481296.897229:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563621 00000100:00100000:2.0:1713481296.897234:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563640 00000100:00100000:2.0:1713481296.897236:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ed91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2906:3492:x1796714784565376:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713481296.897241:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ec3f100/2, rc 0, transno 993553 00002000:00080000:2.0:1713481296.897243:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43618 count 1 00000100:00100000:0.0:1713481296.897248:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784563328:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.897252:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713481296.897257:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ec3d180/2, rc 0, transno 1073690 00010000:00010000:2.0:1713481296.897259:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8900/0xdfc0fb14868992c lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d340f expref: 26766 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.897262:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784563200:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.897262:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.897263:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.897265:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897274:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800782e8900/0xdfc0fb14868992c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d340f expref: 26766 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.897280:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800782e8900/0xdfc0fb14868992c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d340f expref: 26766 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.897285:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784565440:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.897300:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.897302:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+2906:3492:x1796714784563392:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6857us (6903us total) trans 4295960850 rc 0/0 00000100:00100000:2.0:1713481296.897309:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713481296.897309:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563623 00000100:00100000:2.0:1713481296.897314:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784565568:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713481296.897318:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ec43480/2, rc 0, transno 993554 00000100:00100000:0.0:1713481296.897325:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784563392:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.897326:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.897329:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713481296.897330:0:16512:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784565568 00000100:00100000:3.0:1713481296.897334:0:16512:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784565568 00000100:00100000:0.0:1713481296.897335:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784565504:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.897348:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534592 00000100:00100000:2.0:1713481296.897350:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534592 00000100:00100000:3.0:1713481296.897353:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563641 00000100:00100000:0.0:1713481296.897354:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713481296.897358:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+323:3491:x1796714784565568:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.897363:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485937 00000100:00100000:2.0:1713481296.897366:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2168:18951:x1796714882534592:12345-192.168.202.24@tcp:101:mrename.0 00002000:00080000:3.0:1713481296.897370:0:16512:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10128 count 1 00010000:00010000:2.0:1713481296.897375:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.897381:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800821f7a80/0xdfc0fb148a3c4f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e62 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897381:0:16512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897392:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dd16640/0xdfc0fb148802cb4 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633a9 expref: 20674 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.897394:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713481296.897398:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.897400:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784565632:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.897400:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.897402:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.897417:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.897420:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dd16640/0xdfc0fb148802cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633a9 expref: 20674 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.897423:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897429:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:3.0:1713481296.897429:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dd16640/0xdfc0fb148802cb4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633a9 expref: 20674 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.897433:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897439:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.897439:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784565696:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.897443:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897446:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.897458:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6f9f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.897464:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097240480/0xdfc0fb148a3c509 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897468:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097240480/0xdfc0fb148a3c509 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897471:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097240480/0xdfc0fb148a3c509 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.897475:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784565504 00000100:00100000:0.0:1713481296.897477:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00010000:2.0:1713481296.897478:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097240480/0xdfc0fb148a3c509 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.897478:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784565504 00010000:00010000:2.0:1713481296.897484:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897487:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897490:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897493:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897495:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097242640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.897497:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897501:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.897504:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784565632 00010000:00010000:2.0:1713481296.897505:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00000100:00100000:0.0:1713481296.897507:0:16515:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534720 00010000:00010000:2.0:1713481296.897507:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713481296.897507:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784565632 00010000:00010000:2.0:1713481296.897508:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.897511:0:16515:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534720 00010000:00010000:2.0:1713481296.897511:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097242640/0xdfc0fb148a3c4fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.897513:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563642 00000100:00100000:1.0:1713481296.897517:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2907:3492:x1796714784565504:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.897520:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT0 00010000:00010000:2.0:1713481296.897522:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.897524:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563643 00010000:00010000:2.0:1713481296.897525:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00002000:00080000:1.0:1713481296.897527:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43620 count 1 00010000:00010000:2.0:1713481296.897527:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097243180 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.897529:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT0 00000100:00100000:3.0:1713481296.897529:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2907:3490:x1796714784565632:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.897530:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563644 00010000:00010000:2.0:1713481296.897531:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT0 00000100:00100000:0.0:1713481296.897535:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20675:18792:x1796714882534720:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.897535:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.897535:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3931 (ffff8800932e8400) 00010000:00010000:2.0:1713481296.897536:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.897537:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00002000:00080000:3.0:1713481296.897541:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43622 count 1 00010000:00010000:0.0:1713481296.897542:0:16515:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.897542:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098409680/0xdfc0fb148689933 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d341d expref: 26766 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.897542:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097243180/0xdfc0fb148a3c502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT0 00010000:00010000:1.0:1713481296.897546:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.897547:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.897548:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.897552:0:16515:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca09b00/0xdfc0fb148a3c517 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc52e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e69 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897553:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897559:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098409680/0xdfc0fb148689933 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d341d expref: 26766 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.897564:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800898b9200/0xdfc0fb14868993a lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d342b expref: 26766 pid: 16494 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713481296.897565:0:16515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc52e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.897565:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098409680/0xdfc0fb148689933 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d341d expref: 26766 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.897565:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800821f7a80/0xdfc0fb148a3c4f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e62 expref: 2170 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.897571:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078d71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784565760:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.897571:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.897572:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097240480/0xdfc0fb148a3c509 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e62 expref: 2169 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.897573:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.897574:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.897575:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff8800932e8200) 00010000:00010000:3.0:1713481296.897575:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.897576:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.897577:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713481296.897578:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097240480, rc 0) 00010000:00010000:0.0:1713481296.897580:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca09b00/0xdfc0fb148a3c517 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e69 expref: 20676 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.897583:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096380480 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.897589:0:16515:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca09b00/0xdfc0fb148a3c517 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e69 expref: 20676 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.897589:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18951:x1796714882534592:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 222us (871us total) trans 0 rc 0/0 00010000:00010000:3.0:1713481296.897592:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800898b9200/0xdfc0fb14868993a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d342b expref: 26766 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.897593:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485937 00010000:00010000:0.0:1713481296.897596:0:16515:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca09b00, rc 0) 00010000:00010000:3.0:1713481296.897601:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800898b9200/0xdfc0fb14868993a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d342b expref: 26766 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.897610:0:16515:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20676:18792:x1796714882534720:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 75us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.897616:0:16515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563644 00000100:00100000:3.0:1713481296.897617:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784565824:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.897633:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ab15840 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.897684:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.897699:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534080 00000100:00100000:1.0:1713481296.897701:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534080 00010000:00010000:1.0:1713481296.897710:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008372a1c0/0xdfc0fb14891d45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca739 expref: 24483 pid: 15498 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.897718:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.897726:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820738 00000100:00100000:1.0:1713481296.897729:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1960:x1796714882534080:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.897735:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.897737:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008372a1c0/0xdfc0fb14891d45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca739 expref: 24483 pid: 15498 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.897738:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534208 00000100:00100000:0.0:1713481296.897741:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534208 00010000:00010000:1.0:1713481296.897743:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008372a1c0/0xdfc0fb14891d45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca739 expref: 24483 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.897751:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800770bf180/0xdfc0fb1489d034c lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2253d expref: 24484 pid: 16515 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1713481296.897754:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008372a1c0/0xdfc0fb14891d45a lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca739 expref: 24484 pid: 15498 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.897764:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.897770:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820739 00000100:00100000:0.0:1713481296.897774:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1960:x1796714882534208:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.897774:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1960:x1796714882534080:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 44us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.897778:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820738 00010000:00010000:0.0:1713481296.897780:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.897783:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800770bf180/0xdfc0fb1489d034c lrc: 4/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2253d expref: 24483 pid: 16515 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.897792:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800770bf180/0xdfc0fb1489d034c lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2253d expref: 24482 pid: 16515 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.897803:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.897809:0:16624:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534336 00010000:00010000:0.0:1713481296.897811:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800770bf180/0xdfc0fb1489d034c lrc: 0/0,0 mode: --/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa2253d expref: 24482 pid: 16515 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.897811:0:16624:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534336 00010000:00010000:1.0:1713481296.897816:0:16624:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdd3cc0/0xdfc0fb148a13f3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3803b expref: 24483 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.897822:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.897824:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.897825:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820740 00010000:00010000:0.0:1713481296.897827:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c40d lrc: 2/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e23 expref: 26766 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.897827:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882534336:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.897831:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.897835:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e23 expref: 26766 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897839:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cdd3cc0/0xdfc0fb148a13f3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3803b expref: 24482 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.897844:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cdd3cc0/0xdfc0fb148a13f3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3803b expref: 24482 pid: 16524 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.897851:0:6920:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007aa15d40/0xdfc0fb148a3c40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0x9f8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e23 expref: 26766 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897855:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cdd3cc0/0xdfc0fb148a13f3b lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3803b expref: 24482 pid: 16524 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.897858:0:6920:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c02a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784565888:192.168.202.24@tcp:105: 00010000:00010000:1.0:1713481296.897874:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.897875:0:6920:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e6b2540 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.897876:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.897879:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d698c0/0xdfc0fb148a3c437 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e38 expref: 24481 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897886:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d698c0/0xdfc0fb148a3c437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e38 expref: 24481 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.897904:0:16624:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095d698c0/0xdfc0fb148a3c437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x2e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e38 expref: 24481 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.897912:0:16624:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096e68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784565952:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.897914:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.897927:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534464 00000100:00100000:1.0:1713481296.897927:0:16624:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800963800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.897929:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534464 00010000:00010000:0.0:1713481296.897937:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f15b180/0xdfc0fb148802c83 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963355 expref: 20676 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.897956:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820741 00000100:00100000:0.0:1713481296.897959:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20676:1960:x1796714882534464:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.897963:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.897966:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f15b180/0xdfc0fb148802c83 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963355 expref: 20676 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.897966:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.897971:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f15b180/0xdfc0fb148802c83 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963355 expref: 20676 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.897973:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533632 00000100:00100000:1.0:1713481296.897975:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533632 00010000:00010000:0.0:1713481296.897981:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f15b180/0xdfc0fb148802c83 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x278a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963355 expref: 20677 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.897983:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a668fc0/0xdfc0fb148802ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963339 expref: 20677 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.897990:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.897991:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.897992:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.897994:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820742 00000100:00100000:1.0:1713481296.897996:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20676:1960:x1796714882533632:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.897997:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898000:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.898003:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a668fc0/0xdfc0fb148802ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2788:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963339 expref: 20676 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898010:0:9218:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.898012:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a668fc0/0xdfc0fb148802ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2788:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963339 expref: 20676 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.898019:0:9218:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20676:1960:x1796714882534464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 59us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.898022:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a668fc0/0xdfc0fb148802ca6 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2788:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963339 expref: 20676 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.898023:0:9218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820741 00010000:00010000:1.0:1713481296.898033:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.898034:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.898036:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898040:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898040:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898045:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898049:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898052:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898056:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898059:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098086640 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.898060:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.898061:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898064:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.898069:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20674:1960:x1796714882533632:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 71us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.898073:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820742 00010000:00010000:0.0:1713481296.898075:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898079:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098086640/0xdfc0fb148a3c445 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x278a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898095:0:16532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898101:0:16532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.898102:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.898105:0:16532:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.898108:0:16568:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533760 00010000:00010000:2.0:1713481296.898109:0:16532:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.898110:0:16568:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533760 00010000:00010000:2.0:1713481296.898113:0:16532:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898115:0:16568:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350a86c0/0xdfc0fb148a15ff6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3986e expref: 20674 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.898117:0:16532:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cf0d680 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.898134:0:16532:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898138:0:16532:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.898142:0:16568:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820743 00000100:00100000:1.0:1713481296.898144:0:16568:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20674:1960:x1796714882533760:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.898147:0:16532:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898149:0:16568:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.898151:0:16532:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0d680/0xdfc0fb148a3c3dc lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898152:0:16568:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350a86c0/0xdfc0fb148a15ff6 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x9b46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3986e expref: 20674 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.898160:0:16568:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350a86c0/0xdfc0fb148a15ff6 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x9b46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3986e expref: 20674 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.898174:0:16568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350a86c0/0xdfc0fb148a15ff6 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x9b46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa3986e expref: 20674 pid: 16453 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.898185:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.898186:0:16568:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.898190:0:16568:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124e8d440/0xdfc0fb148a3c3ea lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e07 expref: 20673 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898197:0:16568:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124e8d440/0xdfc0fb148a3c3ea lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e07 expref: 20673 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.898205:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800780dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+325:3491:x1796714784563840:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6126us (6160us total) trans 4296040987 rc 0/0 00000100:00100000:0.0:1713481296.898209:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563627 00010000:00010000:1.0:1713481296.898215:0:16568:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880124e8d440/0xdfc0fb148a3c3ea lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x9b46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e07 expref: 20673 pid: 16509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.898224:0:16568:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011fae8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784566016:192.168.202.24@tcp:105: 00000004:00080000:2.0:1713481296.898228:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120039180/2, rc 0, transno 1073691 00000100:00100000:1.0:1713481296.898240:0:16568:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800967a0000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.898243:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784563840:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.898258:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.898262:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.898263:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784566080:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.898275:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.898276:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.898286:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.898296:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882533888 00000100:00100000:1.0:1713481296.898297:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534016 00000100:00100000:0.0:1713481296.898298:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882533888 00000100:00100000:1.0:1713481296.898300:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534016 00010000:00010000:0.0:1713481296.898305:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990846c0/0xdfc0fb14893abc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db506 expref: 26768 pid: 16541 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.898313:0:16582:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782eb600/0xdfc0fb1486898fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33ad expref: 26768 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.898315:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534144 00000100:00100000:0.0:1713481296.898316:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534144 00010000:00010000:0.0:1713481296.898321:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132fe6400/0xdfc0fb14891fffe lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc4a5 expref: 20674 pid: 16453 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.898323:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008afedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+324:3492:x1796714784562432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9274us (9313us total) trans 4296040988 rc 0/0 00000100:00100000:2.0:1713481296.898329:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563612 00000100:00100000:1.0:1713481296.898331:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820744 00000100:00100000:0.0:1713481296.898334:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820745 00000100:00100000:1.0:1713481296.898335:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26768:1960:x1796714882533888:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713481296.898337:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26768:1960:x1796714882534016:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.898341:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.898342:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.898344:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782eb600/0xdfc0fb1486898fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33ad expref: 26768 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.898347:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990846c0/0xdfc0fb14893abc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db506 expref: 26768 pid: 16541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898349:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782eb600/0xdfc0fb1486898fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33ad expref: 26768 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.898355:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990846c0/0xdfc0fb14893abc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db506 expref: 26768 pid: 16541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898361:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782eb600/0xdfc0fb1486898fb lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33ad expref: 26768 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898367:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898368:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898370:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898371:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990846c0/0xdfc0fb14893abc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db506 expref: 26767 pid: 16541 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898374:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.898381:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.898383:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898384:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.898385:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c3f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e0e expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.898392:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26766:1960:x1796714882534016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 54us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.898392:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c3f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e0e expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.898395:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820745 00010000:00010000:1.0:1713481296.898407:0:16582:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011d04c480/0xdfc0fb148a3c3f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000408:0x1f29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e0e expref: 24481 pid: 16515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.898408:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820746 00000100:00100000:0.0:1713481296.898410:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20674:1960:x1796714882534144:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.898415:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.898417:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132fe6400/0xdfc0fb14891fffe lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc4a5 expref: 20674 pid: 16453 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.898419:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784566144:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.898423:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132fe6400/0xdfc0fb14891fffe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc4a5 expref: 20674 pid: 16453 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1713481296.898432:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fe6400/0xdfc0fb14891fffe lrc: 0/0,0 mode: --/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc4a5 expref: 20674 pid: 16453 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1713481296.898432:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008fdb90c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.898442:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898443:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898444:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e880/0xdfc0fb148a3c3ff lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e15 expref: 16951 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898449:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e880/0xdfc0fb148a3c3ff lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e15 expref: 16951 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.898454:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.898458:0:15550:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e880/0xdfc0fb148a3c3ff lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8067:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e15 expref: 16951 pid: 15510 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.898463:0:15550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120986300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784566208:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.898470:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.898472:0:15550:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e6b2480 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.898483:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784566080 00000100:00100000:0.0:1713481296.898485:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784566080 00000100:00100000:0.0:1713481296.898504:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563645 00000100:00100000:0.0:1713481296.898507:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+324:3493:x1796714784566080:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.898515:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10129 count 1 00000100:00100000:1.0:1713481296.898519:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.898522:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898530:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082160b40/0xdfc0fb148802cbb lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633b7 expref: 20673 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.898537:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898538:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898539:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898549:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082160b40/0xdfc0fb148802cbb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633b7 expref: 20673 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.898554:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082160b40/0xdfc0fb148802cbb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633b7 expref: 20673 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.898559:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120985f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784566272:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.898570:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e6b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.898584:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534272 00000004:00080000:0.0:1713481296.898587:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008afec000/2, rc 0, transno 1073692 00000100:00100000:2.0:1713481296.898587:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534272 00000100:00100000:0.0:1713481296.898591:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008afec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784562432:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.898596:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991ddf80/0xdfc0fb1488e7eca lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b554f expref: 16952 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.898602:0:9218:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534400 00000100:00100000:0.0:1713481296.898604:0:9218:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534400 00000100:00100000:2.0:1713481296.898607:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534528 00000100:00100000:2.0:1713481296.898608:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534528 00010000:00010000:0.0:1713481296.898611:0:9218:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121690fc0/0xdfc0fb148689909 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33d7 expref: 26766 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.898613:0:16553:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096ce6640/0xdfc0fb148802c8a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963363 expref: 20674 pid: 16497 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.898620:0:9218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820747 00000100:00100000:0.0:1713481296.898623:0:9218:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:1960:x1796714882534272:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713481296.898623:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820748 00010000:00010000:0.0:1713481296.898627:0:9218:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713481296.898627:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26766:1960:x1796714882534400:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.898630:0:9218:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991ddf80/0xdfc0fb1488e7eca lrc: 4/0,0 mode: PR/PR res: [0x280000407:0x8ea2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b554f expref: 16952 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.898630:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008339d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784566336:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.898631:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.898634:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121690fc0/0xdfc0fb148689909 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33d7 expref: 26766 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898635:0:9218:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991ddf80/0xdfc0fb1488e7eca lrc: 3/0,0 mode: PR/PR res: [0x280000407:0x8ea2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b554f expref: 16952 pid: 16467 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.898640:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121690fc0/0xdfc0fb148689909 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33d7 expref: 26766 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898647:0:9218:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991ddf80/0xdfc0fb1488e7eca lrc: 0/0,0 mode: --/PR res: [0x280000407:0x8ea2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9b554f expref: 16952 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.898651:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.898653:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121690fc0/0xdfc0fb148689909 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33d7 expref: 26766 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.898655:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898656:0:9218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.898658:0:9218:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c414 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e2a expref: 16951 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898676:0:9218:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c414 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e2a expref: 16951 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898681:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.898682:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.898684:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.898687:0:9218:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007da133c0/0xdfc0fb148a3c414 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8ea2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e2a expref: 16951 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898689:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.898692:0:9218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120986a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9218:1796714784566400:192.168.202.24@tcp:105: 00000100:00100000:0.0:1713481296.898702:0:9218:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800979343c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.898702:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.898713:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26765:1960:x1796714882534400:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.898717:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820748 00000100:00100000:2.0:1713481296.898731:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820749 00000100:00100000:2.0:1713481296.898733:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800728e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20674:1960:x1796714882534528:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.898738:0:16553:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.898740:0:16553:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096ce6640/0xdfc0fb148802c8a lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963363 expref: 20674 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.898745:0:16553:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096ce6640/0xdfc0fb148802c8a lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963363 expref: 20674 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.898754:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096ce6640/0xdfc0fb148802c8a lrc: 0/0,0 mode: --/PR res: [0x280000408:0x278b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963363 expref: 20674 pid: 16497 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.898766:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.898767:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.898769:0:16553:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898773:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898781:0:16553:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.898787:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20673:1960:x1796714882534528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.898790:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820749 00010000:00010000:2.0:1713481296.898803:0:15560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898808:0:15560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898812:0:15560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898816:0:15560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898820:0:15560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898823:0:15560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cf0e400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.898824:0:15560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898828:0:15560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898835:0:15560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.898839:0:15560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e400/0xdfc0fb148a3c3f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.898951:0:15560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+2908:3492:x1796714784562752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9463us (9533us total) trans 4295960851 rc 0/0 00000100:00100000:2.0:1713481296.898955:0:15560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563616 00000100:00100000:2.0:1713481296.898971:0:15560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784566336 00000100:00100000:2.0:1713481296.898973:0:15560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784566336 00000004:00080000:1.0:1713481296.898986:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800780daa00/2, rc 0, transno 993555 00000100:00100000:2.0:1713481296.898987:0:15560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563646 00000100:00100000:2.0:1713481296.898990:0:15560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008339ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+325:3493:x1796714784566336:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.898997:0:15560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10130 count 1 00000100:00100000:1.0:1713481296.899002:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784562752:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.899004:0:15560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097243840/0xdfc0fb148a3c52c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2792:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.899011:0:15560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dad46c0/0xdfc0fb148802cc2 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2792:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633c5 expref: 20672 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.899015:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.899016:0:15560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.899017:0:15560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097243840/0xdfc0fb148a3c52c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2792:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.899021:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713481296.899026:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007573a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784566464:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.899027:0:15560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dad46c0/0xdfc0fb148802cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2792:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633c5 expref: 20672 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.899031:0:15560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dad46c0/0xdfc0fb148802cc2 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2792:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633c5 expref: 20672 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.899037:0:15560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15560:1796714784566528:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.899039:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.899049:0:15560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a900 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.899061:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784566464 00010000:00010000:2.0:1713481296.899062:0:9203:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.899064:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784566464 00010000:00010000:2.0:1713481296.899066:0:9203:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.899074:0:9203:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.899078:0:9203:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.899079:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563647 00010000:00010000:2.0:1713481296.899081:0:9203:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.899082:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007573aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+2908:3491:x1796714784566464:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.899084:0:9203:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800992cf180 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.899086:0:9203:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.899090:0:9203:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713481296.899091:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43624 count 1 00010000:00010000:2.0:1713481296.899096:0:9203:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.899099:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e72640/0xdfc0fb148a3c533 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.899100:0:9203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800992cf180/0xdfc0fb148a3c43e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.899107:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121690240/0xdfc0fb148689941 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3439 expref: 26764 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.899111:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.899112:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.899114:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e72640/0xdfc0fb148a3c533 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.899147:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121690240/0xdfc0fb148689941 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3439 expref: 26764 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.899152:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121690240/0xdfc0fb148689941 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3439 expref: 26764 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.899159:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16528:1796714784566592:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.899172:0:16498:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.899181:0:16498:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.899183:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801243043c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.899188:0:16498:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.899194:0:16498:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.899200:0:16498:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.899204:0:16498:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a9bc240 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.899207:0:16498:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.899213:0:16498:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.899221:0:9203:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012003ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2909:3492:x1796714784563776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7173us (7207us total) trans 4295960852 rc 0/0 00010000:00010000:1.0:1713481296.899225:0:16498:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.899225:0:9203:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563626 00010000:00010000:1.0:1713481296.899230:0:16498:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007a9bc240/0xdfc0fb148a3c44c lrc: 0/0,0 mode: --/PW res: [0x280000408:0x278b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.899334:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120039c00/2, rc 0, transno 993556 00000100:00100000:1.0:1713481296.899344:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784563776:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.899387:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880075738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784566656:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.899409:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.899445:0:9203:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784566656 00000004:00080000:1.0:1713481296.899448:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800898a4e00/2, rc 0, transno 1073693 00000100:00100000:2.0:1713481296.899449:0:9203:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784566656 00000100:00100000:1.0:1713481296.899454:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800898a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784564032:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713481296.899457:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+326:3491:x1796714784564032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7033us (7072us total) trans 4296040989 rc 0/0 00000100:00100000:2.0:1713481296.899472:0:9203:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563648 00000100:00100000:2.0:1713481296.899477:0:9203:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2909:3491:x1796714784566656:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713481296.899488:0:9203:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43626 count 1 00010000:00010000:2.0:1713481296.899497:0:9203:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800972406c0/0xdfc0fb148a3c53a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.899500:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.899506:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008339f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784566720:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713481296.899507:0:9203:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009840b600/0xdfc0fb148689948 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3447 expref: 26764 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.899512:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.899513:0:9203:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.899515:0:9203:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800972406c0/0xdfc0fb148a3c53a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.899526:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.899527:0:9203:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009840b600/0xdfc0fb148689948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3447 expref: 26764 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.899532:0:9203:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009840b600/0xdfc0fb148689948 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3447 expref: 26764 pid: 15496 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.899539:0:9203:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9203:1796714784566784:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.899550:0:16493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784566720 00000100:00100000:3.0:1713481296.899554:0:16493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784566720 00000100:00100000:2.0:1713481296.899557:0:9203:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096380a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.899568:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563628 00000100:00100000:3.0:1713481296.899575:0:16493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563649 00000100:00100000:3.0:1713481296.899580:0:16493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008339dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+326:3493:x1796714784566720:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713481296.899592:0:16493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10131 count 1 00010000:00010000:3.0:1713481296.899603:0:16493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096e71f80/0xdfc0fb148a3c541 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2793:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.899612:0:16493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dd15200/0xdfc0fb148802cc9 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2793:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633d3 expref: 20672 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.899618:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.899620:0:16493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.899622:0:16493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e71f80/0xdfc0fb148a3c541 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2793:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.899639:0:16493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dd15200/0xdfc0fb148802cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2793:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633d3 expref: 20672 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.899648:0:16493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dd15200/0xdfc0fb148802cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2793:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633d3 expref: 20672 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.899658:0:16493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16493:1796714784566848:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.899701:0:16493:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.900055:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.900094:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534784 00000100:00100000:1.0:1713481296.900099:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534784 00000100:00100000:1.0:1713481296.900141:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563650 00000100:00100000:1.0:1713481296.900147:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:18844:x1796714882534784:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713481296.900176:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.900189:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915a400/0xdfc0fb148a3c548 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xcbd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e70 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713481296.900202:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xcbd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.900212:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.900214:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.900218:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915a400/0xdfc0fb148a3c548 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e70 expref: 16953 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.900227:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915a400/0xdfc0fb148a3c548 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xcbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e70 expref: 16953 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.900234:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915a400, rc 0) 00000100:00100000:1.0:1713481296.900255:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16953:18844:x1796714882534784:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.900261:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563650 00000100:00100000:0.0:1713481296.901481:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.901506:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.901520:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535616 00000100:00100000:2.0:1713481296.901525:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535616 00000100:00100000:1.0:1713481296.901526:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.901545:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534848 00000100:00100000:2.0:1713481296.901546:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534848 00000100:00100000:1.0:1713481296.901551:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.901556:0:10467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882534976 00000100:00100000:2.0:1713481296.901559:0:10467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882534976 00000100:00100000:0.0:1713481296.901565:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485938 00000100:00100000:0.0:1713481296.901570:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2794:18946:x1796714882535616:12345-192.168.202.24@tcp:101:lfs.0 00000100:00100000:2.0:1713481296.901577:0:10467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485939 00000100:00100000:2.0:1713481296.901581:0:10467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008339c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2388:18980:x1796714882534848:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:0.0:1713481296.901585:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.901588:0:10467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.901591:0:8074:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120406d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8074:1796714784564608:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.901592:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09200/0xdfc0fb148a3c54f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e93 expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.901595:0:10467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097241440/0xdfc0fb148a3c556 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e77 expref: -99 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.901619:0:8074:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.901639:0:8074:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20672:1957:x1796714882532800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6391us (6480us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.901643:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00000100:00100000:1.0:1713481296.901645:0:8074:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820728 00010000:00010000:0.0:1713481296.901646:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901651:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901653:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901655:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901657:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901676:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.901681:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901682:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901685:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901688:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901689:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901709:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097afa400/0xdfc0fb148a3c579 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901713:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097afa400/0xdfc0fb148a3c579 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901717:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097afa400/0xdfc0fb148a3c579 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.901721:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800898a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16552:1796714784564224:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.901723:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901724:0:10467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097240240/0xdfc0fb148a3c580 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10467 initiator: MDT0 00010000:00010000:0.0:1713481296.901726:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901729:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901729:0:10467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097240240/0xdfc0fb148a3c580 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901732:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901734:0:10467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097240240/0xdfc0fb148a3c580 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901735:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091ccfa80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.901737:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901740:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.901742:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.901744:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88009dc1f200) 00010000:00010000:0.0:1713481296.901745:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.901747:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901750:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ccfa80/0xdfc0fb148a3c564 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000004:00200000:2.0:1713481296.901754:0:10467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2caf:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.901756:0:10467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713481296.901757:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.901758:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20671:1957:x1796714882532992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 7239us (7276us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.901760:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901763:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.901764:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820726 00000004:00010000:2.0:1713481296.901764:0:10467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880097240240/0xdfc0fb148a3c580 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901766:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801204d1b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.901768:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901769:0:10467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901771:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901773:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901774:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff8800961a4600) 00010000:00010000:0.0:1713481296.901776:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.901776:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901777:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901779:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801204d1b00/0xdfc0fb148a3c572 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.901779:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901782:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097242880 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.901784:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901789:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901795:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:2.0:1713481296.901797:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.901798:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901801:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097242880/0xdfc0fb148a3c55d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901807:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca09200/0xdfc0fb148a3c54f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e93 expref: 2796 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.901809:0:10467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901812:0:10467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901815:0:10467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901818:0:10467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097240fc0 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.901819:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097afa400/0xdfc0fb148a3c579 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x13b7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e93 expref: 2795 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.901819:0:10467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901822:0:10467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10467 initiator: MDT1 00010000:00010000:0.0:1713481296.901823:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x13b7:0x0].0x0 (ffff880131402e00) 00010000:00010000:0.0:1713481296.901824:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713481296.901825:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097afa400, rc 0) 00010000:00010000:2.0:1713481296.901825:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff880081c76e00) 00010000:00010000:2.0:1713481296.901826:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.901828:0:10467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00010000:00010000:2.0:1713481296.901833:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097240fc0/0xdfc0fb148a3c56b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10467 initiator: MDT1 00000100:00100000:0.0:1713481296.901841:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18946:x1796714882535616:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 271us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.901845:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485938 00000100:00100000:3.0:1713481296.901848:0:16481:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16481:1796714784564544:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.901860:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485940 00010000:00010000:2.0:1713481296.901861:0:10467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097241440/0xdfc0fb148a3c556 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e77 expref: 2390 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.901863:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008339fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18578:x1796714882534976:12345-192.168.202.24@tcp:36:rm.0 00010000:00010000:3.0:1713481296.901872:0:16481:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.901873:0:10467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097240240/0xdfc0fb148a3c580 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2caf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e77 expref: 2389 pid: 10467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.901877:0:10467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2caf:0x0].0x0 (ffff88009926ea00) 00010000:00010000:2.0:1713481296.901879:0:10467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713481296.901880:0:15576:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713481296.901880:0:10467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097240240, rc 0) 00010000:00010000:0.0:1713481296.901889:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134565b00/0xdfc0fb148a30d03 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x386a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa43681 expref: 2169 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.901897:0:10467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008339c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2389:18980:x1796714882534848:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 316us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.901904:0:10467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485939 00010000:00010000:0.0:1713481296.901905:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c92d680/0xdfc0fb148a15c14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x386a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa393dd expref: 2168 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.901914:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x386a:0x0].0x0 (ffff880084bb6100) 00010000:00010000:0.0:1713481296.901927:0:15576:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.901935:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:3.0:1713481296.901936:0:10554:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10554:1796714784564800:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.901938:0:16462:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094068380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16462:1796714784564480:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.901939:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901943:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901948:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c58e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x37c4:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901951:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c58e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.901952:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.901954:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c58e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:3.0:1713481296.901954:0:10554:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.901964:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535168 00010000:00010000:2.0:1713481296.901965:0:16462:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.901967:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535168 00010000:00010000:0.0:1713481296.901979:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.901983:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.901985:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563651 00000100:00100000:2.0:1713481296.901985:0:16580:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009406b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16580:1796714784564672:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.901989:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.901989:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20671:15045:x1796714882535168:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.901995:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713481296.901996:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713481296.902006:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c59c lrc: 2/0,0 mode: --/PW res: [0x280000408:0x83d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e7e expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.902010:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:1957:x1796714882532928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 6742us (6808us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.902015:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820729 00002000:00010000:1.0:1713481296.902018:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000408:0x83d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.902028:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.902029:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.902033:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c59c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e7e expref: 20672 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902042:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e0eb840/0xdfc0fb148a3c59c lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x83d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e7e expref: 20672 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902049:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e0eb840, rc 0) 00000100:00100000:1.0:1713481296.902064:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20672:15045:x1796714882535168:12345-192.168.202.24@tcp:101:dd.0 Request processed in 74us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.902069:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563651 00000100:00100000:2.0:1713481296.902080:0:15793:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535104 00000100:00100000:2.0:1713481296.902083:0:15793:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535104 00000040:00080000:0.0:1713481296.902091:0:15576:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].13928, 64 off899584 00000100:00100000:2.0:1713481296.902109:0:15793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26118 00000100:00100000:2.0:1713481296.902113:0:15793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008339ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2066:18988:x1796714882535104:12345-192.168.202.24@tcp:36:mrename.0 00010000:00010000:0.0:1713481296.902135:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.902139:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:0.0:1713481296.902140:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902145:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902146:0:15793:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713481296.902148:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.902151:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535424 00010000:00010000:0.0:1713481296.902152:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.902154:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535424 00010000:00010000:0.0:1713481296.902155:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902155:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801204d1d40/0xdfc0fb148a3c499 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3474:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e46 expref: 2066 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.902157:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902160:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124e8cfc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.902161:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902164:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902168:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x386a:0x0].0x0 (ffff8800802fe500) 00010000:00010000:0.0:1713481296.902169:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713481296.902169:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff880135313200) 00010000:00010000:0.0:1713481296.902171:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 3/0,0 mode: --/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902174:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8cfc0/0xdfc0fb148a3c5a3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x386a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.902178:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563652 00010000:00010000:2.0:1713481296.902181:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ff2f180/0xdfc0fb148a30b04 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2ca1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa435a8 expref: 2065 pid: 10467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.902183:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008339d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26765:17935:x1796714882535424:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1713481296.902187:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902190:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.902190:0:16498:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.902193:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902193:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca1:0x0].0x0 (ffff880120760000) 00010000:00010000:0.0:1713481296.902195:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124e8e640 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.902197:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:1.0:1713481296.902199:0:16498:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c5aa lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb79f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e85 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.902200:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902203:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x386a:0x0].0x0 (ffff8800802fe500) 00010000:00010000:0.0:1713481296.902204:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713481296.902205:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902207:0:15793:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.902208:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8e640/0xdfc0fb148a3c595 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x386a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00002000:00010000:1.0:1713481296.902210:0:16498:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000407:0xb79f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.902219:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.902219:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:1.0:1713481296.902220:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.902224:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c5aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e85 expref: 26766 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902226:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902232:0:16498:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e0e9680/0xdfc0fb148a3c5aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000407:0xb79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e85 expref: 26766 pid: 16498 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902233:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902239:0:16498:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e0e9680, rc 0) 00010000:00010000:2.0:1713481296.902242:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.902247:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902252:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.902255:0:16498:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008339d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26766:17935:x1796714882535424:12345-192.168.202.24@tcp:101:dd.0 Request processed in 71us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.902260:0:16498:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563652 00010000:00010000:2.0:1713481296.902262:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:2.0:1713481296.902267:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902272:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902289:0:15576:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902293:0:15576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902296:0:15576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902299:0:15576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902302:0:15576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097af9200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:0.0:1713481296.902303:0:15576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902306:0:15576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15576 initiator: MDT0 00010000:00010000:0.0:1713481296.902309:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c4:0x0].0x0 (ffff88009cbf1000) 00010000:00010000:0.0:1713481296.902310:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713481296.902312:0:15576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902313:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.902314:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af9200/0xdfc0fb148a3c587 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x37c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15576 initiator: MDT0 00000100:00100000:1.0:1713481296.902314:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.902317:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902321:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000004:00010000:0.0:1713481296.902323:0:15576:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008339fb80 reply state ffff88009d4a2000 transno 4295105935 ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c58e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x37c4:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902326:0:15793:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15793 initiator: MDT0 00010000:00010000:0.0:1713481296.902327:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124e8f3c0/0xdfc0fb148a3c58e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x37c4:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902329:0:15793:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902330:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x37c4:0x0].0x30 (ffff88009a053400) 00010000:00010000:0.0:1713481296.902332:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713481296.902333:0:15576:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713481296.902333:0:15793:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000001:00080000:3.0:1713481296.902341:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040981 00000100:00100000:1.0:1713481296.902349:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.902352:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008339fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2169:18578:x1796714882534976:12345-192.168.202.24@tcp:36:rm.0 Request processed in 488us (826us total) trans 4295105935 rc 0/0 00000100:00100000:0.0:1713481296.902359:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485940 00000100:00100000:1.0:1713481296.902370:0:3484:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.902372:0:15576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535488 00000100:00100000:0.0:1713481296.902374:0:15576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535488 00010000:00010000:2.0:1713481296.902377:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902380:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.902381:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535232 00000100:00100000:1.0:1713481296.902383:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535232 00010000:00010000:2.0:1713481296.902383:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902386:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086d26f40 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.902387:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902390:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902394:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e8b40/0xdfc0fb148689910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33e5 expref: 26766 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.902394:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3474:0x0].0x0 (ffff88009926e300) 00010000:00010000:2.0:1713481296.902395:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713481296.902397:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.902400:0:15576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485941 00010000:00010000:2.0:1713481296.902400:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086d26f40/0xdfc0fb148a3c5cd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00000100:00100000:0.0:1713481296.902403:0:15576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2795:18938:x1796714882535488:12345-192.168.202.24@tcp:101:rm.0 00000100:00100000:1.0:1713481296.902406:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535360 00010000:00010000:0.0:1713481296.902408:0:15576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.902408:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535360 00010000:00010000:0.0:1713481296.902414:0:15576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c5d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e8c expref: -99 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902415:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902416:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012052f180/0xdfc0fb14868991e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33f3 expref: 26767 pid: 16522 timeout: 815 lvb_type: 1 00002000:00080000:3.0:1713481296.902416:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58066 00010000:00010000:2.0:1713481296.902418:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902421:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902424:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880086d25200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.902425:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.902428:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820750 00010000:00010000:2.0:1713481296.902428:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902431:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2ca1:0x0].0x0 (ffff88009926e400) 00000100:00100000:1.0:1713481296.902432:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26767:1960:x1796714882535232:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.902432:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1713481296.902433:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902436:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880086d25200/0xdfc0fb148a3c5c6 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2ca1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902439:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.902442:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e8b40/0xdfc0fb148689910 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33e5 expref: 26767 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.902447:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902450:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e8b40/0xdfc0fb148689910 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33e5 expref: 26767 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.902450:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902452:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902454:0:15576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800980846c0/0xdfc0fb148a3c5db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902455:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800982bd200 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.902456:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902459:0:15576:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800980846c0/0xdfc0fb148a3c5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902459:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902462:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff88009926ec00) 00010000:00010000:0.0:1713481296.902463:0:15576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800980846c0/0xdfc0fb148a3c5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902464:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.902465:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902466:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8b40/0xdfc0fb148689910 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33e5 expref: 26767 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.902468:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bd200/0xdfc0fb148a3c5bf lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902475:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.902475:0:15793:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15793 initiator: MDT1 00000004:00200000:0.0:1713481296.902476:0:15576:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x51f4:0x0]: returning size 4096 00010000:00010000:1.0:1713481296.902476:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:0.0:1713481296.902478:0:15576:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713481296.902478:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902479:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902481:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00000004:00010000:0.0:1713481296.902483:0:15576:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800980846c0/0xdfc0fb148a3c5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15576 initiator: MDT0 00010000:00010000:2.0:1713481296.902483:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:1.0:1713481296.902486:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902486:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c51b00 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.902487:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902490:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902493:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff88009dc1fa00) 00010000:00010000:2.0:1713481296.902494:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.902495:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902497:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081c51b00/0xdfc0fb148a3c5b1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902498:0:15576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d8f8fc0/0xdfc0fb148a3c5d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e8c expref: 2797 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902500:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.902504:0:15793:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902506:0:15576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800980846c0/0xdfc0fb148a3c5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x51f4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e8c expref: 2796 pid: 15576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902509:0:15793:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902510:0:15576:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x51f4:0x0].0x0 (ffff8800999bd800) 00010000:00010000:0.0:1713481296.902511:0:15576:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713481296.902512:0:15793:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.902514:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800867ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26766:1960:x1796714882535232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 80us (164us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.902514:0:15793:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081c50d80 already unused, calling callback (ffffffffa0efc730) 00010000:00010000:2.0:1713481296.902515:0:15793:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902518:0:15793:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15793 initiator: MDT1 00000100:00100000:1.0:1713481296.902519:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820750 00010000:00010000:2.0:1713481296.902521:0:15793:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff88009926e500) 00010000:00010000:2.0:1713481296.902522:0:15793:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713481296.902523:0:15793:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:2.0:1713481296.902525:0:15793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081c50d80/0xdfc0fb148a3c5b8 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15793 initiator: MDT1 00010000:00010000:0.0:1713481296.902530:0:15576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800980846c0, rc 0) 00000100:00100000:1.0:1713481296.902535:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820751 00000100:00100000:1.0:1713481296.902539:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26765:1960:x1796714882535360:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713481296.902545:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713481296.902546:0:15576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+2796:18938:x1796714882535488:12345-192.168.202.24@tcp:101:rm.0 Request processed in 142us (234us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.902549:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012052f180/0xdfc0fb14868991e lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33f3 expref: 26765 pid: 16522 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.902551:0:15576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485941 00000100:00100000:2.0:1713481296.902551:0:15793:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008339ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18988:x1796714882535104:12345-192.168.202.24@tcp:36:mrename.0 Request processed in 437us (1000us total) trans 0 rc -39/-39 00000100:00100000:2.0:1713481296.902555:0:15793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26118 00010000:00010000:1.0:1713481296.902558:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012052f180/0xdfc0fb14868991e lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33f3 expref: 26765 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.902575:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012052f180/0xdfc0fb14868991e lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d33f3 expref: 26765 pid: 16522 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.902586:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.902588:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.902591:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.902592:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:1.0:1713481296.902597:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.902601:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535296 00000100:00100000:2.0:1713481296.902603:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535296 00010000:00010000:2.0:1713481296.902610:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5d8c0/0xdfc0fb148802c91 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963371 expref: 20672 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.902613:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.902621:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535680 00000100:00100000:2.0:1713481296.902623:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535680 00010000:00010000:1.0:1713481296.902625:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.902627:0:16580:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801345018c0/0xdfc0fb148802c98 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x278d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96337f expref: 20673 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.902629:0:10554:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.902634:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820752 00000100:00100000:2.0:1713481296.902637:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007573b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20673:1960:x1796714882535296:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.902638:0:10554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.902642:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26764:1960:x1796714882535360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 101us (270us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.902642:0:16580:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.902644:0:16580:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f5d8c0/0xdfc0fb148802c91 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963371 expref: 20673 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.902646:0:10554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.902648:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820751 00010000:00010000:2.0:1713481296.902650:0:16580:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f5d8c0/0xdfc0fb148802c91 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963371 expref: 20673 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.902653:0:10554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902660:0:10554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902661:0:16580:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f5d8c0/0xdfc0fb148802c91 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x278c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963371 expref: 20673 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.902680:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820753 00010000:00010000:3.0:1713481296.902683:0:10554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c0d86c0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:1.0:1713481296.902684:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20672:1959:x1796714882535680:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.902686:0:10554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.902688:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.902689:0:16580:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.902691:0:16580:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902693:0:10554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902694:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.902696:0:16580:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902698:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801345018c0/0xdfc0fb148802c98 lrc: 5/0,0 mode: PR/PR res: [0x280000408:0x278d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96337f expref: 20672 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.902706:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801345018c0/0xdfc0fb148802c98 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96337f expref: 20672 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.902709:0:16580:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.902709:0:10554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902715:0:10554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c0d86c0/0xdfc0fb148a3c4bc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.902721:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007573b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20672:1960:x1796714882535296:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 83us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.902723:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.902725:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.902725:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820752 00010000:00010000:1.0:1713481296.902728:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902734:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902744:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.902759:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20671:1959:x1796714882535680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.902764:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820753 00010000:00010000:1.0:1713481296.902800:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801345018c0/0xdfc0fb148802c98 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x278d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96337f expref: 20670 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.902815:0:16497:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0000_UUID:16497:1796714784564928:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.902836:0:16497:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902844:0:16497:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902851:0:16497:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902858:0:16497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902864:0:16497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902871:0:16497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.902876:0:16497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801204d2f40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.902879:0:16497:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.902881:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aa5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2910:3491:x1796714784564736:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7001us (7056us total) trans 4295960853 rc 0/0 00010000:00010000:1.0:1713481296.902885:0:16497:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.902889:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563634 00010000:00010000:1.0:1713481296.902896:0:16497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.902897:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aa5df80/2, rc 0, transno 993557 00010000:00010000:1.0:1713481296.902902:0:16497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801204d2f40/0xdfc0fb148a3c4c3 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x278d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.902908:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aa5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784564736:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.902915:0:16481:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902923:0:16481:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902930:0:16481:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902936:0:16481:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902943:0:16481:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902949:0:16481:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800832a8d80 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.902952:0:16481:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902958:0:16481:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902973:0:16481:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.902979:0:16481:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800832a8d80/0xdfc0fb148a3c4a7 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x278c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.903040:0:16497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+329:3492:x1796714784564864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6875us (6945us total) trans 4296040991 rc 0/0 00000100:00100000:0.0:1713481296.903042:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784566912:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.903047:0:16497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563635 00000100:00100000:0.0:1713481296.903058:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713481296.903076:0:16497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784566912 00000100:00100000:1.0:1713481296.903079:0:16497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784566912 00000100:00100000:1.0:1713481296.903099:0:16497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563653 00000100:00100000:1.0:1713481296.903103:0:16497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_068:lustre-MDT0001-mdtlov_UUID+2910:3493:x1796714784566912:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.903113:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00080000:1.0:1713481296.903116:0:16497:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43627 count 1 00000100:00100000:2.0:1713481296.903137:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535744 00000100:00100000:2.0:1713481296.903141:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535744 00010000:00010000:1.0:1713481296.903146:0:16497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb148a3c5e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.903157:0:16497:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121692ac0/0xdfc0fb14868994f lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3455 expref: 26763 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713481296.903159:0:16481:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+328:3490:x1796714784564416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8048us (8093us total) trans 4296040992 rc 0/0 00000100:00100000:2.0:1713481296.903161:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563654 00010000:00010000:1.0:1713481296.903163:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.903164:0:16497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.903165:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16952:17009:x1796714882535744:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.903166:0:16481:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563631 00010000:00010000:1.0:1713481296.903167:0:16497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800735b6400/0xdfc0fb148a3c5e2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903170:0:10554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.903173:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.903178:0:10554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880086d24000/0xdfc0fb148a3c5e9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xceae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49e9a expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.903181:0:16497:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121692ac0/0xdfc0fb14868994f lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3455 expref: 26763 pid: 9203 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.903183:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00010000:2.0:1713481296.903187:0:10554:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xceae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713481296.903190:0:16497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121692ac0/0xdfc0fb14868994f lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3455 expref: 26763 pid: 9203 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.903193:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.903194:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.903197:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086d24000/0xdfc0fb148a3c5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e9a expref: 16953 pid: 10554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.903199:0:16497:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120406d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_068:lustre-OST0001_UUID:16497:1796714784566976:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.903199:0:16481:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535872 00000100:00100000:3.0:1713481296.903202:0:16481:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535872 00010000:00010000:2.0:1713481296.903203:0:10554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880086d24000/0xdfc0fb148a3c5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49e9a expref: 16953 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903208:0:10554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880086d24000, rc 0) 00000100:00100000:0.0:1713481296.903213:0:6920:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c02a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6920:1796714784565888:192.168.202.24@tcp:105: 00000100:00100000:1.0:1713481296.903220:0:16497:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091d59900 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.903223:0:10554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16953:17009:x1796714882535744:12345-192.168.202.24@tcp:101:dd.0 Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1713481296.903223:0:16481:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563655 00000100:00100000:2.0:1713481296.903228:0:10554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563654 00000100:00100000:3.0:1713481296.903228:0:16481:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:10479:x1796714882535872:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1713481296.903236:0:16481:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713481296.903248:0:16481:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3c5f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x29bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ea8 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.903255:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120405500/2, rc 0, transno 1073696 00000100:00100000:2.0:1713481296.903260:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784564416:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.903263:0:16481:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801320baf40/0xdfc0fb148916dec lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x29bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65c3 expref: 24483 pid: 16474 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.903271:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.903272:0:16481:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.903275:0:16481:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e72d00/0xdfc0fb148a3c5f0 lrc: 4/0,0 mode: --/PW res: [0x2c0000408:0x29bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ea8 expref: 24483 pid: 16481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.903282:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713481296.903286:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784567040:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.903293:0:16481:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801320baf40/0xdfc0fb148916dec lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x29bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65c3 expref: 24483 pid: 16474 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.903302:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.903302:0:16481:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801320baf40/0xdfc0fb148916dec lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x29bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9c65c3 expref: 24483 pid: 16474 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.903312:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713481296.903313:0:16481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16481:1796714784567104:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.903323:0:10554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567040 00000100:00100000:0.0:1713481296.903325:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:1960:x1796714882534208:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5550us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.903326:0:10554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567040 00000100:00100000:0.0:1713481296.903330:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820739 00000100:00100000:3.0:1713481296.903331:0:16481:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6240 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.903340:0:10554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563656 00000100:00100000:2.0:1713481296.903343:0:10554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+328:3491:x1796714784567040:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.903353:0:10554:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10132 count 1 00010000:00010000:2.0:1713481296.903363:0:10554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880086d24fc0/0xdfc0fb148a3c5f7 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2794:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903370:0:10554:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a66ba80/0xdfc0fb148802cec lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2794:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633e1 expref: 20669 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.903375:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.903376:0:10554:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.903377:0:10554:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880086d24fc0/0xdfc0fb148a3c5f7 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2794:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903388:0:10554:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a66ba80/0xdfc0fb148802cec lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2794:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633e1 expref: 20669 pid: 15499 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.903393:0:10554:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a66ba80/0xdfc0fb148802cec lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2794:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633e1 expref: 20669 pid: 15499 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.903399:0:15550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120986300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15550:1796714784566208:192.168.202.24@tcp:105: 00000100:00100000:2.0:1713481296.903400:0:10554:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011fae9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10554:1796714784567168:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.903411:0:10554:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6f9c00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.903422:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.903429:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535808 00000100:00100000:0.0:1713481296.903430:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20669:1960:x1796714882534144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5019us (5144us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.903432:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535808 00000100:00100000:0.0:1713481296.903434:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820746 00000100:00100000:2.0:1713481296.903451:0:15475:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 485942 00000100:00100000:2.0:1713481296.903454:0:15475:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2064:18951:x1796714882535808:12345-192.168.202.24@tcp:101:mrename.0 00010000:00010000:2.0:1713481296.903460:0:15475:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713481296.903466:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.903466:0:15475:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800880b0900/0xdfc0fb148a3c5fe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ea1 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903505:0:15475:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800880b1b00/0xdfc0fb148a3c605 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15475 initiator: MDT0 00000100:00100000:1.0:1713481296.903512:0:16624:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096e68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16624:1796714784565952:192.168.202.24@tcp:105: 00010000:00010000:2.0:1713481296.903512:0:15475:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800880b1b00/0xdfc0fb148a3c605 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15475 initiator: MDT1 00000100:00100000:0.0:1713481296.903518:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.903518:0:15475:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800880b1b00/0xdfc0fb148a3c605 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15475 initiator: MDT1 00000100:00100000:3.0:1713481296.903520:0:16512:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16512:1796714784565696:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.903526:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882535936 00000100:00100000:0.0:1713481296.903528:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882535936 00010000:00010000:3.0:1713481296.903537:0:16512:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.903539:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536000 00010000:00010000:1.0:1713481296.903539:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.903540:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536000 00000100:00100000:0.0:1713481296.903548:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563657 00000100:00100000:1.0:1713481296.903551:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24482:1960:x1796714882534336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5722us (5747us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.903552:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20669:18792:x1796714882535936:12345-192.168.202.24@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713481296.903555:0:16503:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800780d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784565824:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.903558:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820740 00010000:00010000:0.0:1713481296.903559:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1713481296.903563:0:15475:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x2aaf:0x0]: returning size 4096 00000004:00200000:2.0:1713481296.903566:0:15475:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713481296.903568:0:16503:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.903569:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c60c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc52f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49eaf expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713481296.903580:0:16532:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000407:0xc52f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713481296.903589:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.903591:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.903591:0:15475:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800880b0900/0xdfc0fb148a3c5fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ea1 expref: 2066 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.903595:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c60c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49eaf expref: 20670 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.903596:0:16568:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011fae8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16568:1796714784566016:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.903605:0:16532:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008484b180/0xdfc0fb148a3c60c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xc52f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49eaf expref: 20670 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903605:0:15475:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800880b1b00/0xdfc0fb148a3c605 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2aaf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ea1 expref: 2065 pid: 15475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903609:0:15475:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2aaf:0x0].0x0 (ffff880096824c00) 00010000:00010000:0.0:1713481296.903611:0:16532:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008484b180, rc 0) 00010000:00010000:2.0:1713481296.903611:0:15475:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713481296.903612:0:15475:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800880b1b00, rc 0) 00010000:00010000:1.0:1713481296.903617:0:16568:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.903625:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20670:18792:x1796714882535936:12345-192.168.202.24@tcp:101:dir_create.sh.0 Request processed in 72us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.903627:0:15475:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+2065:18951:x1796714882535808:12345-192.168.202.24@tcp:101:mrename.0 Request processed in 171us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.903631:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2563657 00000100:00100000:1.0:1713481296.903631:0:16568:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20670:1960:x1796714882533760:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5484us (5526us total) trans 0 rc 0/0 00000100:00100000:2.0:1713481296.903631:0:15475:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 485942 00000100:00100000:1.0:1713481296.903636:0:16568:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820743 00000100:00100000:0.0:1713481296.903647:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563658 00000100:00100000:0.0:1713481296.903651:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16953:18817:x1796714882536000:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.903657:0:16532:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.903684:0:16532:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097647a80/0xdfc0fb148a3c613 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x8772:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49eb6 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.903692:0:16488:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784565312:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.903704:0:16532:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091931b00/0xdfc0fb1489d0402 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x8772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22583 expref: 20668 pid: 16497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.903711:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.903712:0:16532:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.903715:0:16532:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097647a80/0xdfc0fb148a3c613 lrc: 4/0,0 mode: --/PW res: [0x280000408:0x8772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49eb6 expref: 16954 pid: 16532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.903717:0:16488:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.903730:0:16532:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091931b00/0xdfc0fb1489d0402 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x8772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22583 expref: 20668 pid: 16497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.903731:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800728e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16582:1796714784566144:192.168.202.24@tcp:105: 00010000:00010000:0.0:1713481296.903739:0:16532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091931b00/0xdfc0fb1489d0402 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x8772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa22583 expref: 20668 pid: 16497 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1713481296.903744:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784565248:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.903748:0:16532:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081c01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16532:1796714784567232:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.903752:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.903764:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800728e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26763:1960:x1796714882533888:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5428us (5501us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.903766:0:16532:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e6b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.903769:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820744 00010000:00010000:2.0:1713481296.903769:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.903785:0:16491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ec3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0001_UUID:16491:1796714784565440:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.903799:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.903800:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16538:1796714784565056:192.168.202.24@tcp:104: 00010000:00010000:2.0:1713481296.903804:0:16491:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.903813:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536064 00000100:00100000:0.0:1713481296.903816:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536064 00010000:00010000:1.0:1713481296.903819:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,1 mode: --/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.903831:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563659 00000100:00100000:0.0:1713481296.903835:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20669:14753:x1796714882536064:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.903839:0:16490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078d71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16490:1796714784565760:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.903842:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.903850:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097644480/0xdfc0fb148a3c61a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xc17c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ebd expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.903856:0:16490:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.903865:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdd1680/0xdfc0fb148a13f49 lrc: 2/0,0 mode: PR/PR res: [0x280000407:0xc17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38042 expref: 20670 pid: 16521 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.903872:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.903873:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.903877:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097644480/0xdfc0fb148a3c61a lrc: 4/0,0 mode: --/PW res: [0x280000407:0xc17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ebd expref: 20670 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.903878:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096e69500/2, rc 0, transno 1073695 00000100:00100000:1.0:1713481296.903885:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784564864:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.903901:0:16462:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.903903:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdd1680/0xdfc0fb148a13f49 lrc: 3/0,0 mode: PR/PR res: [0x280000407:0xc17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38042 expref: 20670 pid: 16521 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.903908:0:16462:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.903912:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdd1680/0xdfc0fb148a13f49 lrc: 4/0,0 mode: PR/PR res: [0x280000407:0xc17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa38042 expref: 20670 pid: 16521 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.903914:0:16462:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.903914:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784567296:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.903919:0:16462:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.903921:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b03480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16545:1796714784567360:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.903926:0:16462:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.903930:0:16462:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097b3d8c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.903933:0:16462:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.903936:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e688b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.903938:0:16462:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.903940:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713481296.903950:0:16462:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.903955:0:16462:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b3d8c0/0xdfc0fb148a3c4a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.903963:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.903969:0:16498:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567296 00000100:00100000:2.0:1713481296.903972:0:16498:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567296 00000100:00100000:0.0:1713481296.903980:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.903990:0:16498:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563660 00000100:00100000:2.0:1713481296.903993:0:16498:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ec41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+329:3491:x1796714784567296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.904001:0:16498:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10133 count 1 00010000:00010000:2.0:1713481296.904009:0:16498:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800880b3840/0xdfc0fb148a3c621 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2795:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904011:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.904017:0:16498:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800992b8fc0/0xdfc0fb148802cd0 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2795:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633ef expref: 20670 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.904021:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904022:0:16498:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904023:0:16498:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800880b3840/0xdfc0fb148a3c621 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2795:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904033:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.904034:0:16498:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800992b8fc0/0xdfc0fb148802cd0 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2795:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633ef expref: 20670 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.904039:0:16498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800992b8fc0/0xdfc0fb148802cd0 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2795:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633ef expref: 20670 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.904043:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536256 00000100:00100000:2.0:1713481296.904045:0:16498:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16498:1796714784567424:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.904046:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536256 00000100:00100000:2.0:1713481296.904055:0:16498:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c6f9f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.904058:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f5cfc0/0xdfc0fb148802cad lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96339b expref: 20671 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.904071:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536448 00000100:00100000:0.0:1713481296.904073:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536448 00010000:00010000:0.0:1713481296.904081:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800898b9200/0xdfc0fb14868993a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d342b expref: 26763 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.904100:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536320 00000100:00100000:0.0:1713481296.904102:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536320 00000100:00100000:1.0:1713481296.904103:0:16462:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+2911:3492:x1796714784564352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8999us (9065us total) trans 4295960854 rc 0/0 00010000:00010000:0.0:1713481296.904110:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800782e8900/0xdfc0fb14868992c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d340f expref: 26764 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.904110:0:16462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563630 00000100:00100000:0.0:1713481296.904151:0:15550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536192 00000100:00100000:0.0:1713481296.904154:0:15550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536192 00000100:00100000:2.0:1713481296.904156:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820754 00000100:00100000:2.0:1713481296.904159:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20672:1959:x1796714882536256:12345-192.168.202.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713481296.904161:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820755 00010000:00010000:0.0:1713481296.904164:0:15550:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f158d80/0xdfc0fb148802c9f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96338d expref: 20672 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.904164:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713481296.904166:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26764:1959:x1796714882536448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.904167:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f5cfc0/0xdfc0fb148802cad lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96339b expref: 20672 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.904173:0:16582:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.904173:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f5cfc0/0xdfc0fb148802cad lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96339b expref: 20672 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.904178:0:16582:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800898b9200/0xdfc0fb14868993a lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d342b expref: 26764 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.904179:0:15550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820756 00000100:00100000:0.0:1713481296.904184:0:15550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26764:1958:x1796714882536320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.904184:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f5cfc0/0xdfc0fb148802cad lrc: 0/0,0 mode: --/PR res: [0x280000408:0x278f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96339b expref: 20672 pid: 9201 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.904187:0:16582:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800898b9200/0xdfc0fb14868993a lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d342b expref: 26764 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.904190:0:15550:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.904195:0:15550:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800782e8900/0xdfc0fb14868992c lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d340f expref: 26764 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.904196:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904196:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904198:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904203:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800898b9200/0xdfc0fb14868993a lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d342b expref: 26764 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.904204:0:15550:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800782e8900/0xdfc0fb14868992c lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d340f expref: 26764 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.904206:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904215:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.904216:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904217:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713481296.904219:0:15550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800782e8900/0xdfc0fb14868992c lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d340f expref: 26763 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.904219:0:16582:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904225:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904225:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20671:1959:x1796714882536256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (264us total) trans 0 rc 0/0 00010000:00010000:0.0:1713481296.904228:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.904230:0:15550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.904230:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820754 00010000:00010000:0.0:1713481296.904232:0:15550:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904244:0:15550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904245:0:16624:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820757 00010000:00010000:1.0:1713481296.904249:0:16582:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713481296.904249:0:16624:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20670:1959:x1796714882536192:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713481296.904254:0:16503:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904255:0:16624:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.904259:0:16624:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f158d80/0xdfc0fb148802c9f lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x278e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96338d expref: 20670 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.904260:0:15550:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713481296.904262:0:16503:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.904263:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26762:1959:x1796714882536448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 96us (282us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.904267:0:16624:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f158d80/0xdfc0fb148802c9f lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x278e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96338d expref: 20670 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.904270:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820755 00010000:00010000:3.0:1713481296.904270:0:16503:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904272:0:15550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26762:1958:x1796714882536320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.904277:0:15550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820756 00010000:00010000:2.0:1713481296.904281:0:16624:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f158d80/0xdfc0fb148802c9f lrc: 0/0,0 mode: --/PR res: [0x280000408:0x278e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96338d expref: 20670 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.904283:0:16503:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904290:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.904290:0:16503:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904292:0:16624:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904295:0:16624:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.904296:0:16503:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096e718c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:3.0:1713481296.904299:0:16503:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904301:0:16624:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.904305:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009406b480/2, rc 0, transno 993558 00010000:00010000:3.0:1713481296.904306:0:16503:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904307:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.904313:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009406b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784564352:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.904318:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536384 00010000:00010000:2.0:1713481296.904318:0:16624:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.904320:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536384 00010000:00010000:3.0:1713481296.904324:0:16503:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904325:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904327:0:16552:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098409680/0xdfc0fb148689933 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d341d expref: 26761 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.904330:0:16503:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e718c0/0xdfc0fb148a3c51e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904331:0:16624:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20669:1959:x1796714882536192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 81us (298us total) trans 0 rc 0/0 00010000:00010000:1.0:1713481296.904332:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904335:0:16624:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820757 00000100:00100000:0.0:1713481296.904338:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820758 00010000:00010000:1.0:1713481296.904338:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904340:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26761:1959:x1796714882536384:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.904344:0:16552:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713481296.904344:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904347:0:16552:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098409680/0xdfc0fb148689933 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d341d expref: 26761 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.904349:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904352:0:16552:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098409680/0xdfc0fb148689933 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d341d expref: 26761 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.904354:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099159d40 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.904356:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904362:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904363:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098409680/0xdfc0fb148689933 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d341d expref: 26761 pid: 15496 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.904374:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 2/0,0 mode: --/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904377:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.904378:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.904379:0:16552:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904379:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099159d40/0xdfc0fb148a3c4ca lrc: 0/0,0 mode: --/PW res: [0x280000408:0x278e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904380:0:16488:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904384:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904385:0:16488:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904389:0:16488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904392:0:16552:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713481296.904392:0:16488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904396:0:16488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904399:0:16488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133072ac0 already unused, calling callback (ffffffffa084eb20) 00000100:00100000:0.0:1713481296.904400:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26760:1959:x1796714882536384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 58us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1713481296.904401:0:16488:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904403:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820758 00010000:00010000:2.0:1713481296.904405:0:16488:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904418:0:16488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 2/0,0 mode: --/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904422:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00010000:00010000:2.0:1713481296.904422:0:16488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133072ac0/0xdfc0fb148a3c4df lrc: 0/0,0 mode: --/PW res: [0x280000408:0x278f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904430:0:6920:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536128 00000100:00100000:0.0:1713481296.904432:0:6920:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536128 00010000:00010000:0.0:1713481296.904437:0:6920:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121693180/0xdfc0fb148689925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3401 expref: 26760 pid: 15542 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.904445:0:6920:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820759 00000100:00100000:0.0:1713481296.904456:0:6920:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26760:1958:x1796714882536128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713481296.904460:0:6920:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713481296.904463:0:6920:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121693180/0xdfc0fb148689925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3401 expref: 26760 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.904468:0:6920:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121693180/0xdfc0fb148689925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3401 expref: 26760 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.904484:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121693180/0xdfc0fb148689925 lrc: 0/0,0 mode: --/PR res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3401 expref: 26760 pid: 15542 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.904493:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.904494:0:6920:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.904494:0:16503:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2911:3490:x1796714784565632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6963us (7074us total) trans 4295960855 rc 0/0 00010000:00010000:0.0:1713481296.904495:0:6920:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904499:0:6920:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.904502:0:16503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563643 00000100:00100000:1.0:1713481296.904504:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+331:3492:x1796714784564992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7902us (7927us total) trans 4296040993 rc 0/0 00010000:00010000:0.0:1713481296.904507:0:6920:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713481296.904510:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563636 00000100:00100000:0.0:1713481296.904515:0:6920:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26759:1958:x1796714882536128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 67us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1713481296.904518:0:6920:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820759 00010000:00010000:0.0:1713481296.904531:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904534:0:16490:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904535:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904536:0:16488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+330:3491:x1796714784565184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7587us (7774us total) trans 4296040994 rc 0/0 00010000:00010000:0.0:1713481296.904540:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904540:0:16490:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904540:0:16488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563639 00010000:00010000:0.0:1713481296.904543:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904546:0:16490:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713481296.904547:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081c00a80/2, rc 0, transno 993559 00010000:00010000:0.0:1713481296.904550:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904552:0:16490:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.904552:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784565632:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713481296.904554:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880133072d00 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.904555:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904557:0:16490:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904559:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904562:0:16490:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800991598c0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:1.0:1713481296.904564:0:16490:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904566:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904570:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133072d00/0xdfc0fb148a3c4d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904570:0:16490:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713481296.904570:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094069180/2, rc 0, transno 1073698 00000100:00100000:2.0:1713481296.904574:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784565184:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713481296.904581:0:16490:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.904587:0:16490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991598c0/0xdfc0fb148a3c510 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904596:0:16491:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904601:0:16491:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904605:0:16491:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904609:0:16491:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904612:0:16491:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904619:0:16491:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800821f6400 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:2.0:1713481296.904621:0:16491:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904624:0:16491:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904633:0:16491:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.904638:0:16491:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800821f6400/0xdfc0fb148a3c4e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xaa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904705:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2913:3490:x1796714784565120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7868us (7979us total) trans 4295960856 rc 0/0 00000100:00100000:0.0:1713481296.904709:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563637 00000004:00080000:3.0:1713481296.904717:0:3490:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121e9d880/2, rc 0, transno 993560 00000100:00100000:3.0:1713481296.904722:0:3490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784565120:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713481296.904730:0:16490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+2912:3492:x1796714784565504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7211us (7374us total) trans 4295960857 rc 0/0 00000100:00100000:0.0:1713481296.904736:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713481296.904736:0:16490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563642 00000100:00100000:0.0:1713481296.904741:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011ec3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784567488:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.904756:0:16491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ed91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+2911:3492:x1796714784565376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7518us (7556us total) trans 4295960858 rc 0/0 00000100:00100000:0.0:1713481296.904759:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.904760:0:16491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563640 00000100:00100000:2.0:1713481296.904779:0:16491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567488 00000100:00100000:2.0:1713481296.904781:0:16491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567488 00000100:00100000:0.0:1713481296.904788:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784567552:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.904795:0:16491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563661 00000100:00100000:0.0:1713481296.904797:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713481296.904798:0:16491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_062:lustre-MDT0001-mdtlov_UUID+330:3493:x1796714784567488:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713481296.904808:0:16491:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10134 count 1 00000100:00100000:3.0:1713481296.904809:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800728e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784567616:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.904811:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567552 00000100:00100000:0.0:1713481296.904813:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567552 00010000:00010000:2.0:1713481296.904818:0:16491:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800880b1440/0xdfc0fb148a3c628 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2796:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.904819:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784567680:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.904823:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563662 00000100:00100000:0.0:1713481296.904825:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+2911:3493:x1796714784567552:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.904827:0:16491:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dad5d40/0xdfc0fb148802cd7 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633fd expref: 20668 pid: 9201 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713481296.904833:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43629 count 1 00000100:00100000:3.0:1713481296.904836:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.904838:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904839:0:16491:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904842:0:16491:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800880b1440/0xdfc0fb148a3c628 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.904848:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097646d00/0xdfc0fb148a3c62f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713481296.904855:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c897b80/2, rc 0, transno 993561 00010000:00010000:0.0:1713481296.904856:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800898bbcc0/0xdfc0fb148689956 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3463 expref: 26758 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.904858:0:16491:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dad5d40/0xdfc0fb148802cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633fd expref: 20668 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.904860:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.904860:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.904862:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097646d00/0xdfc0fb148a3c62f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.904862:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784565504:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.904867:0:16491:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dad5d40/0xdfc0fb148802cd7 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633fd expref: 20668 pid: 9201 timeout: 815 lvb_type: 1 00000004:00080000:1.0:1713481296.904871:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ed90700/2, rc 0, transno 993562 00010000:00010000:0.0:1713481296.904872:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800898bbcc0/0xdfc0fb148689956 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3463 expref: 26758 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.904874:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011ed90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784565376:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.904876:0:16491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007573b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_062:lustre-OST0000_UUID:16491:1796714784567744:192.168.202.24@tcp:104: 00010000:00010000:0.0:1713481296.904877:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800898bbcc0/0xdfc0fb148689956 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3463 expref: 26758 pid: 16494 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.904878:0:16503:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567616 00000100:00100000:3.0:1713481296.904881:0:16503:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567616 00000100:00100000:0.0:1713481296.904883:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880086b44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16523:1796714784567808:192.168.202.24@tcp:104: 00000004:00080000:1.0:1713481296.904886:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094069500/2, rc 0, transno 1073697 00000100:00100000:1.0:1713481296.904891:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784564992:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.904892:0:16491:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a600 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.904894:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011e1a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713481296.904899:0:16503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563663 00000100:00100000:3.0:1713481296.904904:0:16503:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800780d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+2912:3490:x1796714784567616:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.904915:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00002000:00080000:3.0:1713481296.904916:0:16503:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43631 count 1 00010000:00010000:3.0:1713481296.904928:0:16503:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3c636 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904933:0:15497:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536512 00000100:00100000:0.0:1713481296.904934:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784567936:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.904936:0:15497:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536512 00010000:00010000:3.0:1713481296.904939:0:16503:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012052ef40/0xdfc0fb14868995d lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3471 expref: 26758 pid: 16484 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.904945:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.904945:0:15497:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dd16640/0xdfc0fb148802cb4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633a9 expref: 20669 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.904946:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.904948:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784567872:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713481296.904948:0:16503:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.904950:0:16503:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e721c0/0xdfc0fb148a3c636 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.904956:0:15497:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820760 00000100:00100000:2.0:1713481296.904959:0:15497:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20669:1958:x1796714882536512:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.904963:0:15497:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.904966:0:15497:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dd16640/0xdfc0fb148802cb4 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2790:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633a9 expref: 20669 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.904968:0:16503:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012052ef40/0xdfc0fb14868995d lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3471 expref: 26758 pid: 16484 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713481296.904970:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.904971:0:15497:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dd16640/0xdfc0fb148802cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2790:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633a9 expref: 20669 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.904977:0:16503:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012052ef40/0xdfc0fb14868995d lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d3471 expref: 26758 pid: 16484 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.904983:0:15497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dd16640/0xdfc0fb148802cb4 lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2790:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633a9 expref: 20669 pid: 16538 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.904987:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567936 00000100:00100000:3.0:1713481296.904988:0:16503:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16503:1796714784568064:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.904989:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567936 00010000:00010000:2.0:1713481296.904993:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713481296.904994:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.904994:0:15497:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.904996:0:15497:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.904999:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567872 00010000:00010000:2.0:1713481296.905000:0:15497:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.905001:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567872 00000100:00100000:0.0:1713481296.905006:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784567680 00000100:00100000:3.0:1713481296.905007:0:16503:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366b6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.905008:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784567680 00000100:00100000:1.0:1713481296.905010:0:3491:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713481296.905012:0:15497:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.905014:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563664 00000100:00100000:1.0:1713481296.905015:0:3491:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784568000:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713481296.905017:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880086b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+2914:3493:x1796714784567936:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713481296.905021:0:15497:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880086b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20668:1958:x1796714882536512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 61us (106us total) trans 0 rc 0/0 00002000:00080000:0.0:1713481296.905024:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43635 count 1 00010000:00010000:3.0:1713481296.905024:0:16512:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.905025:0:15497:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820760 00000100:00100000:1.0:1713481296.905030:0:3491:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713481296.905031:0:16512:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905032:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097645b00/0xdfc0fb148a3c63d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa73:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905038:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800898bb600/0xdfc0fb14868996b lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d348d expref: 26758 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.905039:0:16512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905042:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.905043:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713481296.905043:0:16487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784568000 00010000:00010000:0.0:1713481296.905044:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097645b00/0xdfc0fb148a3c63d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713481296.905044:0:16487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784568000 00010000:00010000:3.0:1713481296.905046:0:16512:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.905052:0:16490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563665 00010000:00010000:3.0:1713481296.905053:0:16512:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905056:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800898bb600/0xdfc0fb14868996b lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d348d expref: 26758 pid: 16494 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.905056:0:16487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563666 00000100:00100000:1.0:1713481296.905057:0:16490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+331:3492:x1796714784567872:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.905060:0:16487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:lustre-MDT0001-mdtlov_UUID+2915:3491:x1796714784567680:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713481296.905060:0:16512:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124310000 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.905061:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800898bb600/0xdfc0fb14868996b lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d348d expref: 26758 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.905063:0:16512:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.905067:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16538:1796714784568128:192.168.202.24@tcp:104: 00002000:00080000:1.0:1713481296.905069:0:16490:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10135 count 1 00010000:00010000:3.0:1713481296.905070:0:16512:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713481296.905071:0:16487:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43633 count 1 00000100:00100000:0.0:1713481296.905076:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801329bbd80 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.905079:0:16490:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c644 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2797:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.905081:0:16487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800880b2880/0xdfc0fb148a3c64b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa71:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.905082:0:16512:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.905087:0:16515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563667 00010000:00010000:1.0:1713481296.905089:0:16490:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dd14000/0xdfc0fb148802cde lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2797:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96340b expref: 20667 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.905089:0:16512:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124310000/0xdfc0fb148a3c4ed lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.905090:0:16515:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0001-mdtlov_UUID+2915:3491:x1796714784568000:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713481296.905091:0:16487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132fe6f40/0xdfc0fb148689964 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d347f expref: 26758 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.905095:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1713481296.905096:0:16515:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:43637 count 1 00010000:00010000:1.0:1713481296.905097:0:16490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.905099:0:16490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880079bcaf40/0xdfc0fb148a3c644 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2797:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.905101:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.905102:0:16515:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097646880/0xdfc0fb148a3c652 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xaa75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.905103:0:16487:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.905105:0:16487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800880b2880/0xdfc0fb148a3c64b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905108:0:16515:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098408000/0xdfc0fb148689979 lrc: 2/0,0 mode: PR/PR res: [0x2c0000406:0xaa75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d349b expref: 26758 pid: 16500 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.905111:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.905112:0:16515:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.905113:0:16515:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097646880/0xdfc0fb148a3c652 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xaa75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.905115:0:16490:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dd14000/0xdfc0fb148802cde lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2797:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96340b expref: 20667 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.905138:0:16487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132fe6f40/0xdfc0fb148689964 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d347f expref: 26758 pid: 9203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.905139:0:16515:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098408000/0xdfc0fb148689979 lrc: 3/0,0 mode: PR/PR res: [0x2c0000406:0xaa75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d349b expref: 26758 pid: 16500 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.905143:0:16490:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dd14000/0xdfc0fb148802cde lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2797:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f96340b expref: 20667 pid: 16538 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1713481296.905144:0:16515:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098408000/0xdfc0fb148689979 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d349b expref: 26758 pid: 16500 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.905144:0:16487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132fe6f40/0xdfc0fb148689964 lrc: 4/0,0 mode: PR/PR res: [0x2c0000406:0xaa71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f8d347f expref: 26758 pid: 9203 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.905149:0:16515:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16515:1796714784568320:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.905151:0:16487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134628e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_058:lustre-OST0001_UUID:16487:1796714784568256:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.905152:0:16490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801358de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16490:1796714784568192:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.905157:0:16515:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091872000 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.905163:0:16487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880121d5a540 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.905169:0:16490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134be6000 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.905198:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1713481296.905212:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.905212:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536576 00000100:00100000:1.0:1713481296.905215:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536576 00000100:00100000:0.0:1713481296.905227:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1713481296.905232:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536640 00000100:00100000:1.0:1713481296.905234:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536640 00000100:00100000:0.0:1713481296.905235:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.905238:0:15510:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536704 00000100:00100000:2.0:1713481296.905242:0:15510:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536704 00000100:00100000:1.0:1713481296.905244:0:16509:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536768 00000100:00100000:1.0:1713481296.905246:0:16509:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536768 00000100:00100000:0.0:1713481296.905250:0:16541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563668 00000100:00100000:0.0:1713481296.905253:0:16541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007814aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+16955:18836:x1796714882536576:12345-192.168.202.24@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713481296.905260:0:16541:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713481296.905262:0:15510:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563669 00000100:00100000:2.0:1713481296.905266:0:15510:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:10409:x1796714882536640:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.905266:0:16512:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+332:3491:x1796714784565568:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7907us (7938us total) trans 4296040995 rc 0/0 00010000:00010000:0.0:1713481296.905267:0:16541:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097647cc0/0xdfc0fb148a3c659 lrc: 2/0,0 mode: --/PW res: [0x280000407:0x8068:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ec4 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.905267:0:16509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563670 00010000:00010000:2.0:1713481296.905271:0:15510:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713481296.905272:0:16509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007814a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+24483:17924:x1796714882536704:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:3.0:1713481296.905274:0:16512:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563641 00010000:00010000:0.0:1713481296.905277:0:16541:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2d2640/0xdfc0fb1489202c1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0x8068:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc5fc expref: 20667 pid: 16486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.905277:0:15510:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800880b2640/0xdfc0fb148a3c660 lrc: 2/0,0 mode: --/PW res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ecb expref: -99 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.905280:0:16509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713481296.905281:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.905282:0:16541:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713481296.905284:0:16541:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097647cc0/0xdfc0fb148a3c659 lrc: 4/0,0 mode: --/PW res: [0x280000407:0x8068:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ec4 expref: 16956 pid: 16541 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.905289:0:16509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca09440/0xdfc0fb148a3c667 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0xb363:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ed2 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.905290:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096baf3c0/0xdfc0fb14891d182 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca740 expref: 24484 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.905293:0:16541:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2d2640/0xdfc0fb1489202c1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0x8068:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc5fc expref: 20667 pid: 16486 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713481296.905297:0:16512:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563671 00010000:00010000:0.0:1713481296.905298:0:16541:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2d2640/0xdfc0fb1489202c1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0x8068:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9cc5fc expref: 20667 pid: 16486 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1713481296.905298:0:15510:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973dcb40/0xdfc0fb14893abd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db50d expref: 26759 pid: 16458 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713481296.905303:0:16541:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098c40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_108:lustre-OST0000_UUID:16541:1796714784568384:192.168.202.24@tcp:104: 00010000:00010000:1.0:1713481296.905303:0:16509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302b21c0/0xdfc0fb148a16281 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0xb363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39875 expref: 24485 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.905303:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713481296.905303:0:16512:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26759:11388:x1796714882536768:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1713481296.905305:0:15510:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.905308:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.905308:0:15510:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800880b2640/0xdfc0fb148a3c660 lrc: 5/0,0 mode: --/PW res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ecb expref: 24485 pid: 15510 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.905310:0:16509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.905313:0:16541:0:(client.c:2539:ptlrpc_set_wait()) set ffff880091872c00 going to sleep for 11 seconds 00010000:00010000:1.0:1713481296.905313:0:16509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca09440/0xdfc0fb148a3c667 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0xb363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ed2 expref: 24485 pid: 16509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713481296.905313:0:16512:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713481296.905323:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973dcb40/0xdfc0fb14893abd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db50d expref: 26759 pid: 16458 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.905323:0:16512:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3c66e lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x7a8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ed9 expref: -99 pid: 16512 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.905327:0:16509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801302b21c0/0xdfc0fb148a16281 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0xb363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39875 expref: 24485 pid: 16494 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713481296.905331:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973dcb40/0xdfc0fb14893abd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9db50d expref: 26760 pid: 16458 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.905336:0:16509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801302b21c0/0xdfc0fb148a16281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0xb363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa39875 expref: 24485 pid: 16494 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.905338:0:16512:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982bcd80/0xdfc0fb148942443 lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x7a8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03fe expref: 24485 pid: 16467 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713481296.905341:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784568448:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.905344:0:16509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072aea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16509:1796714784568512:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.905345:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713481296.905346:0:16512:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713481296.905349:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120985f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784566272:192.168.202.24@tcp:104: 00010000:00010000:3.0:1713481296.905350:0:16512:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e70240/0xdfc0fb148a3c66e lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x7a8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ed9 expref: 26760 pid: 16512 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.905362:0:16509:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134be6600 going to sleep for 11 seconds 00010000:00010000:2.0:1713481296.905367:0:15510:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096baf3c0/0xdfc0fb14891d182 lrc: 3/0,0 mode: PR/PR res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca740 expref: 24485 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713481296.905367:0:16512:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982bcd80/0xdfc0fb148942443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x7a8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03fe expref: 24485 pid: 16467 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.905374:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713481296.905374:0:15510:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096baf3c0/0xdfc0fb14891d182 lrc: 4/0,0 mode: PR/PR res: [0x2c0000408:0x1f2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9ca740 expref: 24485 pid: 16526 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1713481296.905377:0:16512:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982bcd80/0xdfc0fb148942443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x7a8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9e03fe expref: 24485 pid: 16467 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1713481296.905380:0:15510:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:15510:1796714784568576:192.168.202.24@tcp:104: 00000100:00100000:3.0:1713481296.905387:0:16512:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800780dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16512:1796714784568640:192.168.202.24@tcp:104: 00000100:00100000:2.0:1713481296.905390:0:15510:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a16c540 going to sleep for 11 seconds 00000100:00100000:0.0:1713481296.905391:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000004:00080000:1.0:1713481296.905392:0:3491:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c2fdc00/2, rc 0, transno 1073699 00000100:00100000:1.0:1713481296.905398:0:3491:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3491:1796714784565568:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713481296.905406:0:16512:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ab15840 going to sleep for 11 seconds 00000100:00100000:2.0:1713481296.905407:0:14813:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536832 00000100:00100000:2.0:1713481296.905409:0:14813:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536832 00010000:00010000:2.0:1713481296.905418:0:14813:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082160b40/0xdfc0fb148802cbb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633b7 expref: 20668 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1713481296.905420:0:3490:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713481296.905428:0:3490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3490:1796714784568704:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.905432:0:14813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 820761 00000100:00100000:0.0:1713481296.905435:0:3483:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1713481296.905435:0:14813:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20668:1960:x1796714882536832:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713481296.905439:0:14813:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713481296.905441:0:14813:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082160b40/0xdfc0fb148802cbb lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2791:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633b7 expref: 20668 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.905446:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714882536896 00010000:00010000:2.0:1713481296.905446:0:14813:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082160b40/0xdfc0fb148802cbb lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2791:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633b7 expref: 20668 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1713481296.905449:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714882536896 00000100:00100000:3.0:1713481296.905454:0:3490:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713481296.905455:0:14813:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082160b40/0xdfc0fb148802cbb lrc: 0/0,0 mode: --/PR res: [0x280000408:0x2791:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9633b7 expref: 20668 pid: 9202 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1713481296.905463:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.905463:0:14813:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713481296.905465:0:14813:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.905469:0:16488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784568704 00010000:00010000:2.0:1713481296.905469:0:14813:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 4/0,1 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713481296.905471:0:16488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784568704 00010000:00010000:2.0:1713481296.905482:0:14813:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713481296.905485:0:15509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2563672 00000100:00100000:0.0:1713481296.905490:0:15509:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:c85b7817-fcb9-4a7e-bd0c-1b030d68b615+26761:11552:x1796714882536896:12345-192.168.202.24@tcp:101:dd.0 00000100:00100000:1.0:1713481296.905490:0:16488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563673 00000100:00100000:2.0:1713481296.905491:0:14813:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dc2f579b-2a3f-4320-87ed-ca3e338db9d3+20667:1960:x1796714882536832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1713481296.905494:0:16488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:lustre-MDT0001-mdtlov_UUID+332:3490:x1796714784568704:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713481296.905495:0:14813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 820761 00010000:00010000:0.0:1713481296.905498:0:15509:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:1.0:1713481296.905504:0:16488:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10136 count 1 00010000:00010000:0.0:1713481296.905506:0:15509:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097644d80/0xdfc0fb148a3c675 lrc: 2/0,0 mode: --/PW res: [0x2c0000407:0x82d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa8f7532e5fa49ee0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.905516:0:16488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c67c lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2798:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905520:0:15509:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013222a880/0xdfc0fb14895a05e lrc: 2/0,0 mode: PR/PR res: [0x2c0000407:0x82d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eed0b expref: 26762 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.905525:0:16488:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800992bb840/0xdfc0fb148802ce5 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963419 expref: 20666 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.905526:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.905528:0:15509:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.905530:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.905531:0:15509:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097644d80/0xdfc0fb148a3c675 lrc: 4/0,0 mode: --/PW res: [0x2c0000407:0x82d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5fa49ee0 expref: 26762 pid: 15509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713481296.905531:0:16488:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713481296.905533:0:16488:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca08b40/0xdfc0fb148a3c67c lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905546:0:15509:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013222a880/0xdfc0fb14895a05e lrc: 3/0,0 mode: PR/PR res: [0x2c0000407:0x82d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eed0b expref: 26762 pid: 16479 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713481296.905548:0:16488:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800992bb840/0xdfc0fb148802ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963419 expref: 20666 pid: 9202 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.905555:0:15509:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013222a880/0xdfc0fb14895a05e lrc: 4/0,0 mode: PR/PR res: [0x2c0000407:0x82d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f9eed0b expref: 26762 pid: 16479 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1713481296.905556:0:16488:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800992bb840/0xdfc0fb148802ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963419 expref: 20666 pid: 9202 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.905565:0:15509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098c43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15509:1796714784568768:192.168.202.24@tcp:104: 00000100:00100000:1.0:1713481296.905566:0:16488:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880072ae8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_059:lustre-OST0000_UUID:16488:1796714784568832:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.905583:0:15509:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ff513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713481296.905587:0:16488:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134be6a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713481296.905596:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905603:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905616:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,1 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905622:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 2/0,0 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905628:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905634:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ca0bcc0 already unused, calling callback (ffffffffa084eb20) 00010000:00010000:0.0:1713481296.905637:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 3/0,0 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905641:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 4/0,0 mode: PW/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905653:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 2/0,0 mode: --/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905657:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca0bcc0/0xdfc0fb148a3c525 lrc: 0/0,0 mode: --/PW res: [0x280000408:0x2791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713481296.905833:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+333:3493:x1796714784566080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7323us (7553us total) trans 4296040996 rc 0/0 00000100:00100000:0.0:1713481296.905840:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563645 00000004:00080000:1.0:1713481296.905858:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081c03b80/2, rc 0, transno 1073700 00000100:00100000:1.0:1713481296.905867:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3493:1796714784566080:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.905897:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3492:1796714784568896:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713481296.905917:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713481296.905935:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796714784568896 00000100:00100000:0.0:1713481296.905939:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796714784568896 00000100:00100000:0.0:1713481296.905955:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563674 00000100:00100000:0.0:1713481296.905959:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+333:3492:x1796714784568896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713481296.905970:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000408:10137 count 1 00010000:00010000:0.0:1713481296.905980:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800909f7600/0xdfc0fb148a3c683 lrc: 3/0,1 mode: --/PW res: [0x280000408:0x2799:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.905991:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dad7600/0xdfc0fb148802cf3 lrc: 2/0,0 mode: PR/PR res: [0x280000408:0x2799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963427 expref: 20666 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.905997:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.905998:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713481296.906001:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909f7600/0xdfc0fb148a3c683 lrc: 4/0,1 mode: --/PW res: [0x280000408:0x2799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713481296.906017:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dad7600/0xdfc0fb148802cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000408:0x2799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963427 expref: 20666 pid: 9201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713481296.906025:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dad7600/0xdfc0fb148802cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000408:0x2799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0xa8f7532e5f963427 expref: 20666 pid: 9201 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1713481296.906035:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a2a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16533:1796714784568960:192.168.202.24@tcp:104: 00000100:00100000:0.0:1713481296.906058:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880083593240 going to sleep for 11 seconds 00000001:00080000:3.0:1713481296.909203:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040990 00002000:00080000:3.0:1713481296.909251:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58194 00000001:00080000:3.0:1713481296.913013:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040997 00002000:00080000:3.0:1713481296.913050:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58322 00000001:00080000:3.0:1713481296.917006:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040998 00002000:00080000:3.0:1713481296.917034:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58450 00000001:00080000:3.0:1713481296.920811:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296040999 00002000:00080000:3.0:1713481296.920838:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58578 00000001:00080000:3.0:1713481296.924619:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041000 00002000:00080000:3.0:1713481296.924645:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58706 00000001:00080000:3.0:1713481296.928444:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041001 00002000:00080000:3.0:1713481296.928472:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58834 00000001:00080000:3.0:1713481296.932205:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041002 00002000:00080000:3.0:1713481296.932232:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 58962 00000001:00080000:3.0:1713481296.936165:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041003 00002000:00080000:3.0:1713481296.936193:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 59090 00000001:00080000:3.0:1713481296.939978:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041004 00002000:00080000:3.0:1713481296.940005:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 59218 00000001:00080000:3.0:1713481296.943907:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041005 00002000:00080000:3.0:1713481296.943935:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 59346 00000001:00080000:3.0:1713481296.947681:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041006 00002000:00080000:3.0:1713481296.947710:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 59474 00000001:00080000:3.0:1713481296.951466:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041007 00002000:00080000:3.0:1713481296.951493:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 59602 00000001:00080000:3.0:1713481296.955312:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041008 00002000:00080000:3.0:1713481296.955341:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 59730 00000001:00080000:3.0:1713481296.959175:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041009 00002000:00080000:3.0:1713481296.959205:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 128 objects in group 0x280000408 at 59858 00000001:00080000:3.0:1713481296.962950:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041010 00002000:00080000:3.0:1713481296.962979:0:16469:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 16 objects in group 0x280000408 at 59986 00000001:00080000:3.0:1713481296.963432:0:16469:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4296041011 00000100:00100000:3.0:1713481296.963545:0:16469:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0001-mdtlov_UUID+349:10542:x1796714784388416:12345-0@lo:5:osp-pre-0-1.0 Request processed in 732815us (732871us total) trans 4296041012 rc 0/0 00000100:00100000:3.0:1713481296.963555:0:16469:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559220 00000020:00080000:3.0:1713481296.963561:0:16469:0:(tgt_main.c:804:tgt_ses_key_exit()) total 79 transactions per RPC 00000100:00100000:0.0:1713481296.963622:0:10542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083b86680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10542:1796714784388416:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1713481296.963640:0:10542:0:(osp_precreate.c:724:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000408:0xa43f:0x0]-[0x280000408:0xea61:0x0] 00010000:00010000:1.0:1713481297.793314:0:11387:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 66355 lines, 66355 kept, 0 dropped, 0 bad.